00000001:02000400:2.0F:1787826664.434528:0:3291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787826672.899420:0:3493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1787826673.872878:0:3556:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1415 MB/s 00000001:01000000:1.0:1787826674.122669:0:3556:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1715 MB/s 00000001:01000000:1.0:1787826674.372311:0:3556:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10595 MB/s 00000020:02000000:3.0F:1787826674.653922:0:3585:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_68_geb35bb6 00000400:02000000:0.0F:1787826675.013777:0:3600:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.106@tcp [8/256/0/180] 00008000:02000000:2.0:1787826677.337103:0:3749:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787826697.955380:0:5713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787826702.525029:0:6462:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787826702.525035:0:6462:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787826702.525036:0:6462:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787826702.525150:0:6462:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b011845f 00000080:02000400:1.0:1787826702.525158:0:6462:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787826702.529682:0:6462:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787826702.529690:0:6462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787826702.529709:0:6462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000db6b47f4) 00000020:00000080:1.0:1787826702.529723:0:6462:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787826702.545841:0:6462:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787826702.545896:0:6462:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1787826702.555911:0:6462:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787826702.556098:0:6462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787826702.556104:0:6462:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787826702.556113:0:6462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a7953028 00000020:01000004:3.0:1787826702.556118:0:6462:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787826702.556122:0:6462:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787826702.556126:0:6462:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b011845f from MGS 00000020:01000004:3.0:1787826702.556130:0:6462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787826702.556145:0:6462:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001a0ec461) 00000020:00000080:3.0:1787826702.556154:0:6462:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787826702.556241:0:6462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b011845f from MGS, refs=2 00080000:01000000:3.0:1787826702.556246:0:6462:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787826702.556252:0:6462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a7953036 00000100:00100000:3.0:1787826702.556360:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787826702.556472:0:6462:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787826702.556477:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787826702.556815:0:6462:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787826702.556823:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787826702.557671:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787826702.557763:0:6462:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787826702.557766:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787826702.558053:0:6462:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787826702.558061:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787826702.558328:0:6462:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787826702.558346:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787826702.558749:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826702.558752:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826702.558754:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826702.558907:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826702.558910:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826702.558912:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826702.559675:0:6462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787826702.562461:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787826702.809322:0:6462:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6583 MB/s 00000001:01000000:2.0:1787826703.059283:0:6462:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 8000 MB/s 00000001:01000000:2.0:1787826703.309707:0:6462:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1439 MB/s 00000001:01000000:2.0:1787826703.559474:0:6462:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1779 MB/s 00080000:10000000:2.0:1787826703.562646:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1787826703.569006:0:6462:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:3.0:1787826703.569385:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787826703.569489:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787826703.569513:0:6462:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787826703.569561:0:6462:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787826703.569695:0:6462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787826703.569717:0:6462:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787826703.570194:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787826703.570470:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787826703.570478:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787826703.570935:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787826703.570944:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787826703.571177:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787826703.571186:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787826703.571704:0:6481:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787826703.571713:0:6462:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787826703.571738:0:6462:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.106@tcp' 00000020:01000004:1.0:1787826703.571740:0:6462:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787826703.571788:0:6462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.106@tcp (typ=mgc) 00000020:00000080:1.0:1787826703.571800:0:6462:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.106@tcp (0000000031c7b116) 00000020:00000080:1.0:1787826703.571816:0:6462:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787826703.571913:0:6462:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000072647d0d@MGC192.168.203.106@tcp: add connection 192.168.203.106@tcp at head 00010000:00010000:1.0:1787826703.572178:0:6462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.106@tcp-0 is initialized 00000040:01000000:1.0:1787826703.572185:0:6462:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787826703.576494:0:6482:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787826703.576598:0:6462:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.106@tcp (uuid 6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1) 00000020:00000080:0.0:1787826703.576619:0:6462:0:(genops.c:1385:class_connect()) connect: client 6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1, cookie 0xc0fefc09a7953044 00000100:00080000:0.0:1787826703.576630:0:6462:0:(import.c:510:import_select_connection()) MGC192.168.203.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826703.576683:0:6462:0:(import.c:624:import_select_connection()) MGC192.168.203.106@tcp: import 0000000072647d0d using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826703.576715:0:6462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef9cfb76 x1874672143564928/t0(0) o250->MGC192.168.203.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826703.576739:0:6462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1->MGS 00000020:01000004:0.0:1787826703.576758:0:6462:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787826703.576763:0:6462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787826703.576785:0:6462:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006ee1f3cb) 00000020:00000080:0.0:1787826703.576797:0:6462:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787826703.577159:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef9cfb76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3615:1874672143564928:0@lo:250: 00000100:00100000:1.0:1787826703.577281:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.577798:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143564928 00000100:00100000:2.0:1787826703.577806:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143564928 00000100:00100000:2.0:1787826703.577847:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826703.577854:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac7c542e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3615:x1874672143564928:12345-0@lo:250: 00010000:00080000:2.0:1787826703.577875:0:6478:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1@0@lo t0 exp 0000000000000000 cur 78 last 0 00000020:00000080:2.0:1787826703.577904:0:6478:0:(genops.c:1385:class_connect()) connect: client 6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1, cookie 0xc0fefc09a7953052 00000100:00080000:2.0:1787826703.578053:0:6478:0:(import.c:65:import_set_state_nolock()) 000000007babdce2 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826703.578118:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac7c542e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:3615:x1874672143564928:12345-0@lo:250: Request processed in 264us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826703.578125:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787826703.578151:0:3615:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787826703.578159:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.106@tcp: connect to target with instance 0 00000100:00080000:3.0:1787826703.578164:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787826703.578167:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787826703.578169:0:3615:0:(import.c:65:import_set_state_nolock()) 0000000072647d0d MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787826703.578172:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787826703.578180:0:3615:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787826703.578184:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef9cfb76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3615:1874672143564928:0@lo:250: 00000100:00100000:1.0:1787826703.583848:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787826703.584029:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787826703.584035:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787826703.584591:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787826703.584604:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787826703.584919:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787826703.584925:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787826703.585508:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787826703.585643:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787826703.585648:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787826703.588105:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787826703.588122:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787826703.613868:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787826703.614053:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787826703.614062:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787826703.615451:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787826703.615462:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787826703.615992:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787826703.616139:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787826703.616144:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787826703.616512:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787826703.616519:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787826703.617401:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787826703.617492:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787826703.617495:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787826703.618155:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787826703.618161:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787826703.618610:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787826703.618735:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787826703.618740:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787826703.619279:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787826703.619284:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787826703.631089:0:6462:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787826703.631344:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787826703.631350:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787826703.632300:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787826703.632337:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787826703.633052:0:6462:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787826703.633063:0:6462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787826703.633711:0:6462:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787826703.633744:0:6462:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787826703.633751:0:6462:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787826703.633840:0:6462:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787826703.633873:0:6462:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787826703.633877:0:6462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787826703.633879:0:6462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826703.633880:0:6462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826703.633881:0:6462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826703.633883:0:6462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826703.633884:0:6462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826703.633885:0:6462:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826703.633887:0:6462:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826703.633888:0:6462:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787826703.633889:0:6462:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787826703.633890:0:6462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826703.633892:0:6462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826703.633894:0:6462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787826703.633896:0:6462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826703.633896:0:6462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826703.633897:0:6462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826703.633898:0:6462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826703.633901:0:6462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826703.633902:0:6462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826703.633903:0:6462:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826703.633903:0:6462:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826703.633904:0:6462:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787826703.633904:0:6462:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787826703.633905:0:6462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826703.633905:0:6462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826703.633924:0:6462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787826703.633944:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565056:0@lo:253: 00000100:00100000:1.0:1787826703.634009:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826703.634060:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565056 00000100:00100000:0.0:1787826703.634067:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565056 00000100:00100000:1.0:1787826703.634071:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d79d6340 going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.634210:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787826703.634265:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c62df6ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:6462:x1874672143565056:12345-0@lo:253: 20000000:01000000:0.0:1787826703.634310:0:6480:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787826703.634313:0:6480:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787826703.634622:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787826703.634640:0:6480:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787826703.634884:0:6480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826703.635589:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787826703.635675:0:6480:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787826703.635679:0:6480:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787826703.635683:0:6480:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787826703.635686:0:6480:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787826703.635699:0:6480:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787826703.635847:0:6480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826703.636018:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787826703.636031:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787826703.636045:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787826703.636060:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787826703.636073:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787826703.636176:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787826703.636184:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787826703.636195:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787826703.636200:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787826703.636255:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787826703.636267:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787826703.636282:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787826703.636301:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787826703.636340:0:6480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787826703.636357:0:6480:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787826703.636364:0:6480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826703.636475:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787826703.636490:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787826703.636505:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787826703.636517:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787826703.636528:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787826703.636535:0:6480:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787826703.636555:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787826703.636562:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787826703.636572:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787826703.636584:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787826703.636596:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787826703.636602:0:6480:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787826703.636622:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787826703.636629:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787826703.636640:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787826703.636654:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787826703.636709:0:6480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787826703.636729:0:6480:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787826703.636735:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787826703.636992:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787826703.637092:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787826703.637110:0:6480:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.106@tcp for mdt 20000000:01000000:1.0:1787826703.637111:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:1.0:1787826703.637123:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787826703.637128:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787826703.637140:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787826703.637147:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:1.0:1787826703.637158:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787826703.637163:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787826703.637175:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787826703.637187:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787826703.637210:0:6480:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787826703.637231:0:6480:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787826703.637235:0:6480:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787826703.637282:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787826703.637284:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787826703.637536:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787826703.637700:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787826703.637716:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787826703.637727:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787826703.637736:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787826703.637738:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787826703.637975:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787826703.638059:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787826703.638081:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787826703.638092:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787826703.638101:0:6480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787826703.638103:0:6480:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787826703.638106:0:6480:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787826703.638109:0:6480:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787826703.638112:0:6480:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787826703.638117:0:6480:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787826703.639192:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787826703.639351:0:6480:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787826703.644921:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787826703.644958:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787826703.644974:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787826703.644992:0:6480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787826703.645011:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645036:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645043:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645047:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645051:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645054:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645060:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f159bd7c already unused, calling callback (00000000110c4810) 00010000:00010000:0.0:1787826703.645063:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645069:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645081:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645087:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.645093:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f159bd7c/0xc0fefc09a7953059 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826703.645119:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787826703.651081:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c62df6ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:6462:x1874672143565056:12345-0@lo:253: Request processed in 16814us (17066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826703.651094:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787826703.651123:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565056:0@lo:253: 10000000:01000000:1.0:1787826703.651140:0:6462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787826703.651143:0:6462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826703.651145:0:6462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826703.651147:0:6462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826703.651148:0:6462:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787826703.651149:0:6462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826703.651151:0:6462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826703.651152:0:6462:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826703.651153:0:6462:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826703.651154:0:6462:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787826703.651155:0:6462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826703.651157:0:6462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787826703.651173:0:6462:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b011845f from lustre-MDT0000 10000000:01000000:1.0:1787826703.651208:0:6462:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787826703.651211:0:6462:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787826703.651231:0:6462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d5450ee99b8 10000000:01000000:1.0:1787826703.651237:0:6462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826703.651252:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d5450ee99b8 from 1 10000000:01000000:1.0:1787826703.651255:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787826703.651286:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.651304:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.651314:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.651339:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565184:0@lo:101: 00000100:00100000:1.0:1787826703.651373:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.651414:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:2.0:1787826703.651457:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565184 00000100:00100000:2.0:1787826703.651462:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565184 00000100:00100000:2.0:1787826703.651499:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826703.651505:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003ea0dde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:6462:x1874672143565184:12345-0@lo:101: 00010000:00010000:2.0:1787826703.651519:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826703.651529:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953060 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.651545:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.651551:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.651557:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009733c047, rc 0) 00000100:00100000:2.0:1787826703.651583:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003ea0dde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+6:6462:x1874672143565184:12345-0@lo:101: Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826703.651587:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826703.651622:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565184:0@lo:101: 00010000:00010000:1.0:1787826703.651635:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.651643:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.651702:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565312:0@lo:501: 00000100:00100000:1.0:1787826703.651728:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.651747:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.651830:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565312 00000100:00100000:0.0:1787826703.651844:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565312 00000100:00100000:0.0:1787826703.651875:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826703.651880:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060920a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+6:6462:x1874672143565312:12345-0@lo:501: 00000100:00100000:0.0:1787826703.651960:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060920a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+6:6462:x1874672143565312:12345-0@lo:501: Request processed in 79us (232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826703.651966:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826703.652034:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565312:0@lo:501: 10000000:01000000:1.0:1787826703.652061:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787826703.652078:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.652085:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826703.652102:0:6462:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d5448400800 10000000:01000000:1.0:1787826703.652106:0:6462:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787826703.652109:0:6462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d5448400800 10000000:01000000:1.0:1787826703.652111:0:6462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787826703.652112:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d5448400800 from 1 10000000:01000000:1.0:1787826703.652114:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787826703.652124:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000193c93d4/0xc0fefc09a795306e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.652128:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000193c93d4/0xc0fefc09a795306e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.652132:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000193c93d4/0xc0fefc09a795306e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.652139:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565440:0@lo:101: 00000100:00100000:1.0:1787826703.652160:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.652180:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:2.0:1787826703.652262:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565440 00000100:00100000:2.0:1787826703.652267:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565440 00000100:00100000:2.0:1787826703.652398:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787826703.652489:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfb54b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+6:6462:x1874672143565440:12345-0@lo:101: 00010000:00010000:2.0:1787826703.652496:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826703.652505:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ecc6c0c/0xc0fefc09a7953075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795306e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.652519:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ecc6c0c/0xc0fefc09a7953075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795306e expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.652527:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ecc6c0c/0xc0fefc09a7953075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795306e expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.652534:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ecc6c0c, rc 0) 00000100:00100000:2.0:1787826703.652580:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfb54b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+7:6462:x1874672143565440:12345-0@lo:101: Request processed in 175us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826703.652586:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787826703.652619:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565440:0@lo:101: 00010000:00010000:1.0:1787826703.652627:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000193c93d4/0xc0fefc09a795306e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953075 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.652631:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000193c93d4/0xc0fefc09a795306e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953075 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826703.652637:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787826703.652645:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000193c93d4/0xc0fefc09a795306e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953075 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.652657:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 00000000193c93d4/0xc0fefc09a795306e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953075 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826703.652661:0:6462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787826703.652663:0:6462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826703.652666:0:6462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d5448400800 10000000:01000000:1.0:1787826703.652667:0:6462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787826703.652670:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787826703.652671:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787826703.652688:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.652692:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.652696:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.652702:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565568:0@lo:101: 00000100:00100000:1.0:1787826703.652719:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.652741:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.653108:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565568 00000100:00100000:0.0:1787826703.653112:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565568 00000100:00100000:0.0:1787826703.653142:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787826703.653148:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003af24b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+7:6462:x1874672143565568:12345-0@lo:101: 00010000:00010000:0.0:1787826703.653155:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826703.653162:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795307c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.653174:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795307c expref: 8 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.653181:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795307c expref: 8 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.653186:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be680569, rc 0) 00000100:00100000:0.0:1787826703.653239:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003af24b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+8:6462:x1874672143565568:12345-0@lo:101: Request processed in 90us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826703.653248:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565568:0@lo:101: 00000100:00100000:0.0:1787826703.653253:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787826703.653258:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.653265:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.653299:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565696:0@lo:501: 00000100:00100000:1.0:1787826703.653315:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.653345:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.653512:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565696 00000100:00100000:0.0:1787826703.653516:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565696 00000100:00100000:0.0:1787826703.653534:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826703.653540:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053d3b9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+8:6462:x1874672143565696:12345-0@lo:501: 00000100:00100000:0.0:1787826703.653624:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053d3b9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6462:x1874672143565696:12345-0@lo:501: Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826703.653632:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787826703.653652:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565696:0@lo:501: 00000100:00100000:1.0:1787826703.653699:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565824:0@lo:503: 00000100:00100000:1.0:1787826703.653730:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.653747:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.653826:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565824 00000100:00100000:0.0:1787826703.653830:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565824 00000100:00100000:0.0:1787826703.653895:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787826703.653903:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af93e74e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6462:x1874672143565824:12345-0@lo:503: 00000100:00100000:0.0:1787826703.653998:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af93e74e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6462:x1874672143565824:12345-0@lo:503: Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826703.654004:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787826703.654023:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143565824:0@lo:503: 00000100:00100000:2.0:1787826703.654348:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6507:1874672143565952:0@lo:502: 00000100:00100000:2.0:1787826703.654437:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.654462:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a369bc1c going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.654480:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143565952 00000100:00100000:3.0:1787826703.654486:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143565952 00000100:00100000:3.0:1787826703.654518:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826703.654526:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d1a7baa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6507:x1874672143565952:12345-0@lo:502: 00000100:00100000:3.0:1787826703.654590:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d1a7baa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6507:x1874672143565952:12345-0@lo:502: Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826703.654595:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826703.654624:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6507:1874672143565952:0@lo:502: 00000020:01000000:2.0:1787826703.654646:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826703.654656:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.654658:0:6507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826703.654662:0:6507:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787826703.654665:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826703.654682:0:6507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d44e7502) 00000020:00000080:2.0:1787826703.654696:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787826703.654701:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787826703.654860:0:6507:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787826703.654867:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a7953091 00000020:00000080:2.0:1787826703.655072:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787826703.655076:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826703.655079:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.655080:0:6507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826703.655083:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826703.655086:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.655087:0:6507:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787826703.655089:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826703.655095:0:6507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000047984167) 00000020:00000080:2.0:1787826703.655104:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787826703.655107:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787826703.655109:0:6507:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787826703.655111:0:6507:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787826703.655117:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787826703.655157:0:6507:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b011845f from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787826703.655168:0:6507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ff573ecf) 00000020:00000080:2.0:1787826703.655175:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787826703.655269:0:6507:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787826703.655276:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0fefc09a79530a6 00000020:00000080:2.0:1787826703.655370:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787826703.655376:0:6507:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787826703.655390:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc0fefc09a79530ad 00080000:01000000:2.0:1787826703.655395:0:6507:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787826703.655398:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a79530b4 00080000:10000000:2.0:1787826703.655683:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787826703.655789:0:6507:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787826703.659840:0:6507:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787826703.693585:0:6507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787826703.693810:0:6507:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787826703.695920:0:6507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787826703.696117:0:6507:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787826703.697537:0:6507:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c08f59bf) 00000020:00000080:2.0:1787826703.697553:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787826703.697633:0:6507:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787826703.697640:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a79530c2 00000020:00000080:3.0:1787826703.697929:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787826703.698634:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1787826703.700024:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1787826703.701026:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1787826703.702416:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1787826703.703649:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1787826703.704769:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787826703.705785:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc0fefc09a79530c9 00000020:00000080:2.0:1787826703.706047:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787826703.706057:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826703.706063:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.706065:0:6507:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787826703.706068:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826703.706072:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.706079:0:6507:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787826703.706083:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787826703.706084:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787826703.706087:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826703.706089:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.706090:0:6507:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787826703.706093:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826703.706097:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.706098:0:6507:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787826703.706101:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787826703.706138:0:6507:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787826703.706186:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6507:1874672143566080:0@lo:502: 00000100:00100000:2.0:1787826703.706281:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.706335:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000915d66c8 going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.706680:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566080 00000100:00100000:0.0:1787826703.706687:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566080 00000100:00100000:0.0:1787826703.706732:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826703.706740:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e89bc35e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6507:x1874672143566080:12345-0@lo:502: 00000100:00100000:0.0:1787826703.706846:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e89bc35e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6507:x1874672143566080:12345-0@lo:502: Request processed in 107us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826703.706853:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787826703.706895:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6507:1874672143566080:0@lo:502: 00000020:01000000:2.0:1787826703.706921:0:6507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826703.706925:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826703.706927:0:6507:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787826703.706940:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787826703.707023:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787826703.707047:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787826703.707064:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.707074:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826703.707081:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 1 10000000:01000000:1.0:1787826703.707084:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787826703.707106:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.707113:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.707125:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.707140:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566208:0@lo:101: 00000100:00100000:1.0:1787826703.707167:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.707180:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.707235:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566208 00000100:00100000:3.0:1787826703.707239:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566208 00000100:00100000:3.0:1787826703.707265:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787826703.707270:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034d2be34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:6462:x1874672143566208:12345-0@lo:101: 00010000:00010000:3.0:1787826703.707278:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826703.707286:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79530d0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826703.707308:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826703.707314:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826703.707321:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051c7364b, rc 0) 00000100:00100000:3.0:1787826703.707363:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034d2be34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:6462:x1874672143566208:12345-0@lo:101: Request processed in 93us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826703.707371:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826703.707385:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566208:0@lo:101: 00010000:00010000:1.0:1787826703.707397:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.707406:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.707869:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566336:0@lo:256: 00000100:00100000:1.0:1787826703.707892:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.707912:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.707922:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566336 00000100:00100000:0.0:1787826703.707925:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566336 00000100:00100000:0.0:1787826703.707952:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826703.707957:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001121c789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:6462:x1874672143566336:12345-0@lo:256: 20000000:01000000:0.0:1787826703.707969:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787826703.707980:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787826703.708053:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001121c789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:6462:x1874672143566336:12345-0@lo:256: Request processed in 95us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826703.708059:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787826703.708100:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566336:0@lo:256: 10000000:01000000:1.0:1787826703.708781:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826703.708795:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.708803:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826703.708810:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5448400800 from 1 10000000:01000000:1.0:1787826703.708813:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826703.708829:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.708836:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.709449:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.709464:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566464:0@lo:101: 00000100:00100000:1.0:1787826703.709498:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.709528:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.709553:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566464 00000100:00100000:3.0:1787826703.709560:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566464 00000100:00100000:3.0:1787826703.709597:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787826703.709605:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f045369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:6462:x1874672143566464:12345-0@lo:101: 00010000:00010000:3.0:1787826703.709615:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826703.709629:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79530de expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826703.709646:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79530de expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826703.709654:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79530de expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826703.709661:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a473459, rc 0) 00000100:00100000:3.0:1787826703.709699:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f045369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:6462:x1874672143566464:12345-0@lo:101: Request processed in 96us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826703.709706:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826703.709737:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566464:0@lo:101: 00010000:00010000:1.0:1787826703.709750:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.709758:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.709812:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566592:0@lo:501: 00000100:00100000:1.0:1787826703.709830:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.709842:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:0.0:1787826703.709858:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566592 00000100:00100000:0.0:1787826703.709862:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566592 00000100:00100000:0.0:1787826703.709883:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787826703.709887:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9e9a799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:6462:x1874672143566592:12345-0@lo:501: 00000100:00100000:0.0:1787826703.710005:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9e9a799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:6462:x1874672143566592:12345-0@lo:501: Request processed in 117us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826703.710012:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826703.710053:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566592:0@lo:501: 00000100:00100000:1.0:1787826703.710089:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566720:0@lo:503: 00000100:00100000:1.0:1787826703.710124:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.710142:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.710169:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566720 00000100:00100000:3.0:1787826703.710174:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566720 00000100:00100000:3.0:1787826703.710200:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826703.710207:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af620eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:6462:x1874672143566720:12345-0@lo:503: 00000040:00080000:3.0:1787826703.710262:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787826703.710308:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af620eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:6462:x1874672143566720:12345-0@lo:503: Request processed in 101us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826703.710316:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826703.710339:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000102fa21d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566720:0@lo:503: 00000040:00080000:1.0:1787826703.711088:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787826703.711143:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787826703.711170:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787826703.711185:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.711193:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826703.711258:0:6462:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787826703.711261:0:6462:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d5448400800 10000000:01000000:0.0:1787826703.711264:0:6462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d5448400800 10000000:01000000:0.0:1787826703.711268:0:6462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826703.711272:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5448400800 from 1 10000000:01000000:0.0:1787826703.711275:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826703.711293:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.711300:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.711315:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826703.711338:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566848:0@lo:101: 00000100:00100000:0.0:1787826703.711362:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.711390:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566848 00000100:00100000:0.0:1787826703.711395:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e82782bf going to sleep for 11 seconds 00000100:00100000:2.0:1787826703.711395:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566848 00000100:00100000:2.0:1787826703.711422:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787826703.711427:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dad2b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:6462:x1874672143566848:12345-0@lo:101: 00010000:00010000:2.0:1787826703.711433:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826703.711439:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79530ec expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.711451:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.711456:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.711465:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d641aec, rc 0) 00000100:00100000:2.0:1787826703.711493:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dad2b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6462:x1874672143566848:12345-0@lo:101: Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826703.711497:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787826703.711524:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566848:0@lo:101: 00010000:00010000:0.0:1787826703.711535:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826703.711543:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826703.711582:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566976:0@lo:501: 00000100:00100000:0.0:1787826703.711607:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826703.711626:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e82782bf going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.711652:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143566976 00000100:00100000:3.0:1787826703.711657:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143566976 00000100:00100000:3.0:1787826703.711682:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787826703.711688:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ab07a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6462:x1874672143566976:12345-0@lo:501: 00000100:00100000:3.0:1787826703.711770:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ab07a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6462:x1874672143566976:12345-0@lo:501: Request processed in 83us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826703.711778:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826703.711796:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143566976:0@lo:501: 00000100:00100000:0.0:1787826703.711831:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143567104:0@lo:503: 00000100:00100000:0.0:1787826703.711864:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826703.711882:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e82782bf going to sleep for 11 seconds 00000100:00100000:2.0:1787826703.711903:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143567104 00000100:00100000:2.0:1787826703.711909:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143567104 00000100:00100000:2.0:1787826703.711947:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787826703.711955:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb1fa561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6462:x1874672143567104:12345-0@lo:503: 00000100:00100000:2.0:1787826703.712047:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb1fa561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6462:x1874672143567104:12345-0@lo:503: Request processed in 94us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826703.712055:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787826703.712069:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143567104:0@lo:503: 00000100:00100000:0.0:1787826703.712367:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6512:1874672143567232:0@lo:502: 00000100:00100000:0.0:1787826703.712399:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826703.712427:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d67acb66 going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.712439:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143567232 00000100:00100000:3.0:1787826703.712445:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143567232 00000100:00100000:0.0:1787826703.712482:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826703.712495:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb4dd082 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6512:x1874672143567232:12345-0@lo:502: 00000100:00100000:0.0:1787826703.712566:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb4dd082 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6512:x1874672143567232:12345-0@lo:502: Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826703.712573:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787826703.712600:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab2b0e06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6512:1874672143567232:0@lo:502: 00000020:01000004:3.0:1787826703.712650:0:6512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787826703.712671:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f43bcf38) 00000020:00000080:3.0:1787826703.712687:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787826703.712752:0:6512:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b011845f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787826703.712755:0:6512:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b011845f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787826703.712757:0:6512:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b011845f 4 00010000:00080000:3.0:1787826703.712775:0:6512:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000047340d84@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1787826703.714145:0:6512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787826703.714340:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787826703.714370:0:6512:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826703.714386:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc0fefc09a7953101 00000100:00080000:3.0:1787826703.714394:0:6512:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826703.714397:0:6512:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000047340d84 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826703.714421:0:6512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000019506127 x1874672143567360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826703.714438:0:6512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787826703.714467:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019506127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1874672143567360:0@lo:38: 00000100:00100000:1.0:1787826703.714523:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.714572:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143567360 00000100:00100000:2.0:1787826703.714577:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143567360 00000100:00100000:2.0:1787826703.714603:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826703.714607:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000102fa21d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1874672143567360:12345-0@lo:38: 00000100:00100000:1.0:1787826703.714609:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787826703.714620:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787826703.714648:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000102fa21d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1874672143567360:12345-0@lo:38: Request processed in 39us (126us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787826703.714659:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826703.714665:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826703.714672:0:3615:0:(import.c:65:import_set_state_nolock()) 0000000047340d84 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826703.714677:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787826703.714682:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019506127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1874672143567360:0@lo:38: 00000100:00100000:2.0:1787826703.714740:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6512:1874672143567488:0@lo:502: 00000100:00100000:2.0:1787826703.714787:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.714809:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a11258c going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.714812:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143567488 00000100:00100000:3.0:1787826703.714818:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143567488 00000100:00100000:3.0:1787826703.714859:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787826703.714869:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000298b5cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6512:x1874672143567488:12345-0@lo:502: 00000100:00100000:3.0:1787826703.714964:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000298b5cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6512:x1874672143567488:12345-0@lo:502: Request processed in 99us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826703.714972:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787826703.714987:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6512:1874672143567488:0@lo:502: 00000040:00080000:2.0:1787826703.715013:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787826703.715073:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787826703.715093:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826703.715103:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.715110:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787826703.715144:0:6462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787826703.715145:0:6462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826703.715146:0:6462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826703.715147:0:6462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826703.715148:0:6462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826703.715148:0:6462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826703.715149:0:6462:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826703.715150:0:6462:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826703.715151:0:6462:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787826703.715152:0:6462:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787826703.715153:0:6462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826703.715154:0:6462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826703.715156:0:6462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787826703.715157:0:6462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826703.715158:0:6462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826703.715159:0:6462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826703.715159:0:6462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826703.715160:0:6462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826703.715161:0:6462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826703.715162:0:6462:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826703.715162:0:6462:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826703.715163:0:6462:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787826703.715168:0:6462:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787826703.715169:0:6462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826703.715170:0:6462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826703.715181:0:6462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787826703.715188:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de8d31f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143567616:0@lo:253: 00000100:00100000:1.0:1787826703.715246:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.715266:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143567616 00000100:00100000:1.0:1787826703.715270:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc8856a6 going to sleep for 11 seconds 00000100:00100000:2.0:1787826703.715272:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143567616 00000100:00100000:2.0:1787826703.715307:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787826703.715323:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b4c1527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6462:x1874672143567616:12345-0@lo:253: 20000000:01000000:2.0:1787826703.715355:0:6480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787826703.715367:0:6480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826703.718252:0:6480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826703.718268:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787826703.718277:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826703.718282:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826703.718300:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718315:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718323:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718364:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718376:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 12 pid: 6479 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.718390:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143567744:0@lo:104: 00000100:00100000:1.0:1787826703.718439:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826703.718474:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b4c1527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6462:x1874672143567616:12345-0@lo:253: Request processed in 3151us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826703.718485:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787826703.718488:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d01615db going to sleep for 11 seconds 00000100:00100000:3.0:1787826703.718490:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143567744 00000100:00100000:3.0:1787826703.718495:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143567744 00000100:00100000:0.0:1787826703.718499:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de8d31f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6462:1874672143567616:0@lo:253: 10000000:01000000:0.0:1787826703.718514:0:6462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787826703.718516:0:6462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826703.718519:0:6462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826703.718520:0:6462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826703.718522:0:6462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826703.718523:0:6462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826703.718525:0:6462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826703.718526:0:6462:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826703.718528:0:6462:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826703.718529:0:6462:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787826703.718531:0:6462:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:3.0:1787826703.718532:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:0.0:1787826703.718534:0:6462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826703.718537:0:6462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787826703.718540:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787826703.718546:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017a18b85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143567744:12345-0@lo:104: 00000100:00100000:1.0:1787826703.718551:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000020:02000000:0.0:1787826703.718553:0:6462:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787826703.718560:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826703.718618:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826703.718624:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143567744:0@lo:104: 00000100:00100000:3.0:1787826703.718626:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017a18b85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143567744:12345-0@lo:104: Request processed in 83us (186us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826703.718633:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787826703.718638:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787826703.718639:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718646:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.718649:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e53472d0 already unused, calling callback (000000000e52dd1f) 10000000:00010000:2.0:1787826703.718655:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.718663:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826703.718681:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826703.718686:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826703.718712:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.718717:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826703.718733:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.718739:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 00000000e53472d0/0xc0fefc09a79530d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530d7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826703.718763:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826703.718764:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826703.718766:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826703.718788:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143567872:0@lo:103: 00000100:00100000:3.0:1787826703.718825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826703.718857:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143567872 00000100:00100000:1.0:1787826703.718862:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143567872 00010000:00010000:1.0:1787826703.718878:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 12 pid: 6479 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.718899:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826703.718904:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e85b4f44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:3617:x1874672143567872:12345-0@lo:103: 00010000:00010000:1.0:1787826703.718911:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826703.718914:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 12 pid: 6479 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718920:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 12 pid: 6479 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718928:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051c7364b/0xc0fefc09a79530d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79530d0 expref: 12 pid: 6479 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718937:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718943:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826703.718954:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000672748s 00010000:00010000:1.0:1787826703.718957:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718963:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718977:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718982:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718987:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc123c48 already unused, calling callback (00000000110c4810) 00010000:00010000:1.0:1787826703.718990:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.718995:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.719013:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826703.719022:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826703.719044:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.719055:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e85b4f44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:3617:x1874672143567872:12345-0@lo:103: Request processed in 150us (229us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826703.719055:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826703.719071:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787826703.719071:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc123c48/0xc0fefc09a7953108 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826703.719079:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d94cf6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143567872:0@lo:103: 00080000:10000000:0.0:1787826703.721568:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1787826703.721688:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787826703.721863:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787826703.721993:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787826703.722157:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1787826703.722393:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787826703.723114:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1787826703.723300:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787826703.723475:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1787826703.723607:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787826703.723796:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1787826703.723955:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1787826703.725747:0:6462:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787826703.730951:0:6462:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787826703.730959:0:6519:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787826703.730963:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787826703.732178:0:6520:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1787826703.733504:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787826703.734263:0:6462:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787826703.734388:0:6462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787826703.735345:0:6462:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787826703.735358:0:6462:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787826703.735458:0:6462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826703.744241:0:6462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787826703.746566:0:6520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787826703.746635:0:6520:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787826703.746640:0:6520:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1787826703.746799:0:6462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787826703.746846:0:6462:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787826703.747050:0:6462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787826703.747308:0:6462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1787826703.747971:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787826703.748109:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787826703.748285:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787826703.748422:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787826703.748550:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787826703.748652:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787826703.748801:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787826703.748882:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787826703.748987:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787826703.749112:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787826703.749238:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787826703.749350:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787826703.749483:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787826703.749598:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787826703.749738:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787826703.749860:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787826703.750101:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787826703.750300:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787826703.750445:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787826703.750586:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787826703.750727:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787826703.750881:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787826703.751007:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787826703.751132:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787826703.751262:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787826703.751402:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787826703.751520:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787826703.751626:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787826703.751754:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787826703.751910:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787826703.752053:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787826703.752185:0:6462:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787826703.752365:0:6462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1787826703.754521:0:6462:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787826703.754553:0:6462:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d6a41cb3988 00100000:10000000:0.0:1787826703.754561:0:6462:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787826703.754992:0:6462:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787826703.755008:0:6462:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787826703.755028:0:6462:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787826703.755043:0:6462:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787826703.755806:0:6462:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826703.755992:0:6462:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787826704.593306:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826705.112950:0:6764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1787826705.418329:0:6816:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826705.418447:0:6816:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787826705.617365:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826706.641341:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787826707.024036:0:6918:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826707.024151:0:6918:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787826707.665332:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826708.689304:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787826709.073333:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826709.073340:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 3 10000000:01000000:3.0:1787826709.073345:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826709.073380:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826709.073387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787826709.073394:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00010000:00010000:3.0:1787826709.073395:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826709.073397:0:37:0:(import.c:65:import_set_state_nolock()) 0000000047340d84 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826709.073410:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000047340d84 using connection 192.168.203.106@tcp/0@lo 00010000:00010000:3.0:1787826709.073410:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826709.073431:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000677f117d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143568000:0@lo:101: 00000100:00100000:0.0:1787826709.073445:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000900d12b2 x1874672143568256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826709.073487:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143568128:0@lo:400: 00000100:00100000:0.0:1787826709.073491:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000900d12b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1874672143568256:0@lo:38: 00000100:00100000:3.0:1787826709.073516:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826709.073536:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826709.073564:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568000 00000100:00100000:3.0:1787826709.073570:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3dcfd25 going to sleep for 11 seconds 00000100:00100000:2.0:1787826709.073573:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568000 00000100:00100000:0.0:1787826709.073578:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826709.073595:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568128 00000100:00100000:3.0:1787826709.073600:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568128 00000100:00100000:1.0:1787826709.073604:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568256 00000100:00100000:1.0:1787826709.073611:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568256 00000100:00100000:3.0:1787826709.073631:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787826709.073639:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787826709.073647:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826709.073647:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002242bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143568000:12345-0@lo:101: 00000100:00100000:2.0:1787826709.073653:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3c906a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:3618:x1874672143568128:12345-0@lo:400: 00000100:00100000:1.0:1787826709.073660:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd145760 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1874672143568256:12345-0@lo:38: 00010000:00010000:3.0:1787826709.073663:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826709.073675:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795310f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787826709.073683:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 83 last 0 00010000:00010000:3.0:1787826709.073698:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795310f expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826709.073709:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795310f expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826709.073715:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3c906a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:3618:x1874672143568128:12345-0@lo:400: Request processed in 68us (180us total) trans 0 rc 0/0 00000020:00000080:1.0:1787826709.073730:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc0fefc09a795311d 00000100:00100000:2.0:1787826709.073730:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1787826709.073733:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006141ed5a, rc 0) 00000100:00100000:0.0:1787826709.073761:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143568128:0@lo:400: 00000100:00100000:3.0:1787826709.073780:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002242bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143568000:12345-0@lo:101: Request processed in 140us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826709.073789:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00100000:1.0:1787826709.073797:0:6487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787826709.073798:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000677f117d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143568000:0@lo:101: 00010000:00010000:2.0:1787826709.073814:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826709.073826:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826709.073880:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048e51b63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143568384:0@lo:256: 00000100:00100000:2.0:1787826709.073916:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826709.073936:0:6487:0:(import.c:65:import_set_state_nolock()) 00000000215bef4f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826709.073937:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000126573cc going to sleep for 11 seconds 00000100:00100000:0.0:1787826709.073964:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568384 00000100:00100000:0.0:1787826709.073970:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568384 00000100:00100000:1.0:1787826709.073991:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd145760 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1874672143568256:12345-0@lo:38: Request processed in 333us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826709.074000:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787826709.074009:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787826709.074015:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000900d12b2 x1874672143568256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826709.074021:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec984c8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143568384:12345-0@lo:256: 00000100:00080000:2.0:1787826709.074036:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 20000000:01000000:0.0:1787826709.074041:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00080000:2.0:1787826709.074042:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787826709.074048:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787826709.074050:0:3615:0:(import.c:65:import_set_state_nolock()) 0000000047340d84 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826709.074055:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000900d12b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1874672143568256:0@lo:38: 20000000:01000000:0.0:1787826709.074057:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826709.074061:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787826709.074158:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec984c8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143568384:12345-0@lo:256: Request processed in 142us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826709.074165:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787826709.074184:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048e51b63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143568384:0@lo:256: 10000000:01000000:2.0:1787826709.074239:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826709.074244:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826709.074256:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826709.714479:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826710.147800:0:7415:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826710.147804:0:7415:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787826710.147805:0:7415:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787826710.147919:0:7415:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000605c6fe6 00000020:01000004:2.0:1787826710.147934:0:7415:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787826710.147944:0:7415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826710.147965:0:7415:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000069101ab9) 00000020:00000080:2.0:1787826710.147985:0:7415:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787826710.168457:0:7415:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1787826710.168531:0:7415:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1787826710.178201:0:7415:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787826710.178493:0:7415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787826710.178504:0:7415:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787826710.178515:0:7415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc0fefc09a795312b 00000020:01000004:0.0:1787826710.178522:0:7415:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787826710.178542:0:7415:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787826710.178545:0:7415:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787826710.178551:0:7415:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787826710.178576:0:7415:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787826710.178579:0:7415:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787826710.188106:0:7415:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787826710.188143:0:7415:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.106@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1787826710.188147:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787826710.188149:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826710.188150:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826710.188151:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826710.188152:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826710.188153:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826710.188155:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826710.188156:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787826710.188157:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787826710.188158:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826710.188160:0:7415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826710.188168:0:7415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1787826710.188170:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826710.188171:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826710.188171:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826710.188172:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826710.188173:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826710.188174:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826710.188175:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826710.188176:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787826710.188176:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787826710.188177:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826710.188178:0:7415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826710.188202:0:7415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787826710.188292:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143568512:0@lo:253: 00000100:00100000:1.0:1787826710.188362:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.188404:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568512 00000100:00100000:3.0:1787826710.188412:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568512 00000100:00100000:1.0:1787826710.188418:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000005585ee4b going to sleep for 11 seconds 00000100:00100000:3.0:1787826710.188468:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787826710.188476:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000168342b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143568512:12345-0@lo:253: 20000000:01000000:3.0:1787826710.188505:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787826710.188510:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1787826710.188516:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1787826710.188518:0:6479:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1787826710.188547:0:6479:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1787826710.188802:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826710.188916:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787826710.188930:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787826710.188962:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787826710.188984:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787826710.189001:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787826710.189048:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1787826710.189056:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787826710.189068:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787826710.189074:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787826710.189086:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787826710.189090:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787826710.189102:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787826710.189115:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787826710.189203:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787826710.189263:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787826710.189296:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787826710.189303:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787826710.189318:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787826710.189324:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:3.0:1787826710.189335:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787826710.189340:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787826710.189353:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787826710.189368:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787826710.189377:0:6479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787826710.189445:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787826710.189454:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787826710.189466:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787826710.189482:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787826710.189496:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787826710.189502:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787826710.189512:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787826710.189530:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787826710.189535:0:6479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787826710.189555:0:6479:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787826710.189562:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787826710.189808:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787826710.189925:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787826710.189956:0:6479:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.106@tcp for mdt 20000000:01000000:0.0:1787826710.189957:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787826710.189968:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787826710.189972:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787826710.189983:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787826710.189986:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:0.0:1787826710.189995:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787826710.189999:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787826710.190005:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787826710.190018:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787826710.190069:0:6479:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787826710.190075:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787826710.190262:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787826710.190506:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787826710.190519:0:6479:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.106@tcp for mdt 20000000:01000000:3.0:1787826710.190521:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787826710.190533:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787826710.190538:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787826710.190547:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787826710.190552:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:3.0:1787826710.190561:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787826710.190573:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787826710.190585:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787826710.190598:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787826710.190614:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787826710.190616:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787826710.190619:0:6479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787826710.190655:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787826710.190657:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787826710.190861:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787826710.190873:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787826710.190880:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787826710.190968:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787826710.190987:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787826710.191003:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787826710.191012:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787826710.191014:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787826710.191154:0:7424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787826710.191171:0:7424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787826710.191187:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787826710.191266:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787826710.191301:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787826710.191322:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787826710.191332:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787826710.191334:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787826710.191581:0:7425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787826710.191602:0:7425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787826710.191630:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787826710.191711:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1787826710.191729:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1787826710.191743:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1787826710.191753:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787826710.191755:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787826710.191759:0:6479:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787826710.191764:0:6479:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787826710.192012:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1787826710.192097:0:6479:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787826710.197784:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787826710.197826:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.197844:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.197850:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795307c expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.197870:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.197876:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.197915:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.197930:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 12 pid: 6478 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826710.197943:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143568640:0@lo:104: 00000100:00100000:0.0:1787826710.197999:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826710.198058:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795307c expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.198066:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795307c expref: 12 pid: 6480 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826710.198074:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004620ca69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143568768:0@lo:104: 00000100:00100000:0.0:1787826710.198094:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826710.198120:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.198128:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 12 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826710.198134:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d02b9859 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143568896:0@lo:104: 00000100:00100000:1.0:1787826710.198139:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568640 00000100:00100000:1.0:1787826710.198146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568640 00000100:00100000:0.0:1787826710.198159:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826710.198180:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089985dbb going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.198181:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568768 00000100:00100000:1.0:1787826710.198184:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568768 00000100:00100000:1.0:1787826710.198195:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143568896 00000100:00100000:1.0:1787826710.198198:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143568896 00000100:00100000:3.0:1787826710.198206:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826710.198235:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1b0b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:6479:x1874672143568640:12345-0@lo:104: 00010000:00010000:3.0:1787826710.198245:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.198246:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826710.198259:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe9ee50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:6479:x1874672143568768:12345-0@lo:104: 00010000:00010000:1.0:1787826710.198268:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.198312:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826710.198324:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1b0b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:6479:x1874672143568640:12345-0@lo:104: Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826710.198330:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787826710.198332:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787826710.198338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe9ee50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:6479:x1874672143568768:12345-0@lo:104: Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.198345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787826710.198352:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787826710.198356:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143568640:0@lo:104: 00000100:00100000:3.0:1787826710.198362:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e28c7600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6479:x1874672143568896:12345-0@lo:104: 00010000:00010000:1.0:1787826710.198367:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1787826710.198372:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004620ca69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143568768:0@lo:104: 00010000:00010000:1.0:1787826710.198373:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.198382:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198395:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f159bd7c already unused, calling callback (000000000e52dd1f) 00010000:00010000:2.0:1787826710.198395:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787826710.198400:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198408:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826710.198415:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826710.198421:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826710.198438:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826710.198444:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e28c7600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6479:x1874672143568896:12345-0@lo:104: Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.198446:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d02b9859 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143568896:0@lo:104: 00000100:00100000:3.0:1787826710.198451:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787826710.198453:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198465:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826710.198486:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198492:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 00000000f159bd7c/0xc0fefc09a79530ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.198493:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.198499:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787826710.198508:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787826710.198513:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143569024:0@lo:103: 00010000:00010000:1.0:1787826710.198514:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198534:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005fc0249e already unused, calling callback (000000000e52dd1f) 10000000:00010000:1.0:1787826710.198536:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198550:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.198559:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787826710.198562:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826710.198569:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826710.198592:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198598:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826710.198614:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.198614:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569024 00000100:00100000:3.0:1787826710.198619:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569024 00000100:00100000:0.0:1787826710.198621:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3d999ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143569152:0@lo:103: 00010000:00010000:1.0:1787826710.198625:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 000000005fc0249e/0xc0fefc09a7953060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953067 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198637:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826710.198641:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826710.198641:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 13 pid: 6478 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198645:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826710.198653:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.198674:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569152 00000100:00100000:3.0:1787826710.198678:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569152 00010000:00010000:3.0:1787826710.198691:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 14 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.198704:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826710.198705:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787826710.198707:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826710.198711:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826710.198715:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826710.198717:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019506127 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3618:x1874672143569024:12345-0@lo:103: 00010000:00010000:1.0:1787826710.198726:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.198728:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000743dda74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3616:x1874672143569152:12345-0@lo:103: 00010000:00010000:0.0:1787826710.198730:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826710.198737:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 14 pid: 6478 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198741:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b87715c already unused, calling callback (000000000e52dd1f) 10000000:00010000:1.0:1787826710.198743:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.198746:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826710.198747:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 14 pid: 6478 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198749:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.198753:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 14 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.198764:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d641aec/0xc0fefc09a79530f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79530ec expref: 14 pid: 6478 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.198771:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 14 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826710.198773:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.198785:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826710.198790:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009733c047/0xc0fefc09a7953067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953060 expref: 13 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826710.198793:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787826710.198814:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019506127 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:3618:x1874672143569024:12345-0@lo:103: Request processed in 100us (259us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826710.198820:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826710.198821:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787826710.198821:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198828:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826710.198841:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.198847:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a795307c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953083 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826710.198861:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3d999ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143569152:0@lo:103: 00000100:00100000:3.0:1787826710.198864:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000743dda74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:3616:x1874672143569152:12345-0@lo:103: Request processed in 137us (209us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826710.198869:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826710.198872:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143569024:0@lo:103: 00010000:00010000:1.0:1787826710.198873:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826710.198875:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787826710.198877:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826710.198878:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826710.198887:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de8d31f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143569280:0@lo:103: 00000100:00100000:0.0:1787826710.198912:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826710.198942:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569280 00000100:00100000:2.0:1787826710.198947:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569280 00010000:00010000:2.0:1787826710.198961:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795307c expref: 11 pid: 6480 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826710.198983:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826710.198989:0:6472:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787826710.198991:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d02b9859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:3616:x1874672143569280:12345-0@lo:103: 00000100:00100000:0.0:1787826710.199000:0:6472:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787826710.199003:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826710.199008:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795307c expref: 11 pid: 6480 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199015:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795307c expref: 11 pid: 6480 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199031:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be680569/0xc0fefc09a7953083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795307c expref: 11 pid: 6480 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199037:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199042:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199050:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199054:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199058:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199062:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199065:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004eae7503 already unused, calling callback (00000000110c4810) 00010000:00010000:2.0:1787826710.199067:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199071:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199084:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.199098:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826710.199108:0:6479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.199115:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.199120:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004eae7503/0xc0fefc09a7953132 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826710.199132:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787826710.199136:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d02b9859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:3616:x1874672143569280:12345-0@lo:103: Request processed in 145us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.199145:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826710.199150:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de8d31f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143569280:0@lo:103: 00000100:00100000:2.0:1787826710.200524:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000168342b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:7415:x1874672143568512:12345-0@lo:253: Request processed in 12047us (12161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.200535:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787826710.200559:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143568512:0@lo:253: 10000000:01000000:1.0:1787826710.200575:0:7415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787826710.200578:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826710.200579:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826710.200581:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826710.200582:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1787826710.200583:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826710.200584:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826710.200586:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826710.200587:0:7415:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787826710.200588:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826710.200589:0:7415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787826710.200607:0:7415:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000605c6fe6 from lustre-MDT0001 10000000:01000000:1.0:1787826710.200638:0:7415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787826710.200641:0:7415:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787826710.200646:0:7415:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 10000000:01000000:1.0:1787826710.200649:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787826710.200668:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.200676:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.200684:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.200695:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569408:0@lo:101: 00000100:00100000:1.0:1787826710.200721:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.200748:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d31ae7a going to sleep for 11 seconds 00000100:00100000:0.0:1787826710.200788:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569408 00000100:00100000:0.0:1787826710.200793:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569408 00000100:00100000:0.0:1787826710.200822:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826710.200826:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f7b0388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+9:7415:x1874672143569408:12345-0@lo:101: 00010000:00010000:0.0:1787826710.200835:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826710.200842:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003676197c/0xc0fefc09a7953140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953139 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.200855:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003676197c/0xc0fefc09a7953140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953139 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.200861:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003676197c/0xc0fefc09a7953140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953139 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.200865:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003676197c, rc 0) 00000100:00100000:0.0:1787826710.200892:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f7b0388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:7415:x1874672143569408:12345-0@lo:101: Request processed in 61us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826710.200896:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787826710.200916:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569408:0@lo:101: 00010000:00010000:1.0:1787826710.200927:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.200943:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.201015:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569536:0@lo:501: 00000100:00100000:1.0:1787826710.201046:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.201062:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d31ae7a going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.201082:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569536 00000100:00100000:2.0:1787826710.201086:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569536 00000100:00100000:2.0:1787826710.201114:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787826710.201120:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f16ac4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:7415:x1874672143569536:12345-0@lo:501: 00000100:00100000:2.0:1787826710.201182:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f16ac4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:7415:x1874672143569536:12345-0@lo:501: Request processed in 63us (136us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826710.201189:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826710.201240:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569536:0@lo:501: 10000000:01000000:1.0:1787826710.201259:0:7415:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787826710.201292:0:7415:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787826710.201296:0:7415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.201303:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.201308:0:7415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.201324:0:7415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826710.201342:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787826710.201344:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d54789ce800 00010000:00010000:2.0:1787826710.201349:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826710.201350:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787826710.201357:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d5450ee99b8 10000000:01000000:1.0:1787826710.201362:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1787826710.201363:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc123c48 already unused, calling callback (000000000e52dd1f) 10000000:01000000:1.0:1787826710.201366:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d5450ee99b8 from 1 10000000:00010000:2.0:1787826710.201368:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826710.201370:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787826710.201383:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000ca4c934a/0xc0fefc09a7953147 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.201386:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.201399:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000ca4c934a/0xc0fefc09a7953147 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826710.201400:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826710.201423:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826710.201426:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000ca4c934a/0xc0fefc09a7953147 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.201439:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569664:0@lo:101: 00010000:00010000:2.0:1787826710.201441:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.201449:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826710.201464:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826710.201470:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.201476:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 00000000dc123c48/0xc0fefc09a7953139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a7953140 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.201492:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aef3b43a going to sleep for 11 seconds 00010000:00010000:2.0:1787826710.201493:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826710.201497:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787826710.201508:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826710.201511:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000210f1898 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143569792:0@lo:103: 00010000:00010000:2.0:1787826710.201513:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826710.201524:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569664 00000100:00100000:1.0:1787826710.201533:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569664 00000100:00100000:0.0:1787826710.201545:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.201568:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787826710.201575:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dcb88a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:7415:x1874672143569664:12345-0@lo:101: 00010000:00010000:1.0:1787826710.201581:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826710.201589:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d9987f4/0xc0fefc09a795314e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953147 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826710.201594:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569792 00000100:00100000:2.0:1787826710.201598:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569792 00010000:00010000:1.0:1787826710.201601:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d9987f4/0xc0fefc09a795314e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953147 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.201610:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d9987f4/0xc0fefc09a795314e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953147 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.201616:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d9987f4, rc 0) 00000100:00100000:2.0:1787826710.201625:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826710.201631:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004620ca69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:3619:x1874672143569792:12345-0@lo:103: 00010000:00010000:2.0:1787826710.201638:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826710.201647:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003676197c/0xc0fefc09a7953140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953139 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.201657:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dcb88a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143569664:12345-0@lo:101: Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.201668:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787826710.201673:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826710.201717:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004620ca69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:3619:x1874672143569792:12345-0@lo:103: Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.201724:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826710.201744:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000210f1898 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143569792:0@lo:103: 00000100:00100000:3.0:1787826710.201747:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b675cdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569664:0@lo:101: 00010000:00010000:3.0:1787826710.201761:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000ca4c934a/0xc0fefc09a7953147 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795314e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.201768:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000ca4c934a/0xc0fefc09a7953147 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795314e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826710.201781:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787826710.201794:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000ca4c934a/0xc0fefc09a7953147 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795314e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.201815:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 00000000ca4c934a/0xc0fefc09a7953147 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795314e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826710.201823:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d54789ce800 10000000:01000000:3.0:1787826710.201826:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787826710.201829:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d54789ce800 from 1 10000000:01000000:3.0:1787826710.201831:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787826710.201842:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000d2648ab3/0xc0fefc09a7953155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.201847:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000d2648ab3/0xc0fefc09a7953155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.201852:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000d2648ab3/0xc0fefc09a7953155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.201862:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569920:0@lo:101: 00000100:00100000:3.0:1787826710.201883:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.201897:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43f8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.201913:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143569920 00000100:00100000:2.0:1787826710.201918:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143569920 00000100:00100000:2.0:1787826710.201942:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826710.201954:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000764804df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+10:7415:x1874672143569920:12345-0@lo:101: 00010000:00010000:2.0:1787826710.201962:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826710.201969:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078f2ed58/0xc0fefc09a795315c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953155 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.201980:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078f2ed58/0xc0fefc09a795315c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953155 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.201985:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078f2ed58/0xc0fefc09a795315c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953155 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.201989:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078f2ed58, rc 0) 00000100:00100000:2.0:1787826710.202018:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000764804df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:7415:x1874672143569920:12345-0@lo:101: Request processed in 66us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.202021:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787826710.202042:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143569920:0@lo:101: 00010000:00010000:3.0:1787826710.202051:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000d2648ab3/0xc0fefc09a7953155 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795315c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.202058:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000d2648ab3/0xc0fefc09a7953155 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795315c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826710.202068:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787826710.202076:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000d2648ab3/0xc0fefc09a7953155 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795315c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.202087:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 00000000d2648ab3/0xc0fefc09a7953155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795315c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826710.202093:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787826710.202096:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826710.202099:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d54789ce800 10000000:01000000:3.0:1787826710.202101:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787826710.202111:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787826710.202112:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787826710.202123:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 000000005244ad61/0xc0fefc09a7953163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.202128:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 000000005244ad61/0xc0fefc09a7953163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.202134:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 000000005244ad61/0xc0fefc09a7953163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.202142:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570048:0@lo:101: 00000100:00100000:3.0:1787826710.202162:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.202181:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43f8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.202196:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570048 00000100:00100000:1.0:1787826710.202202:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570048 00000100:00100000:1.0:1787826710.202273:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787826710.202293:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e77f1f68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:7415:x1874672143570048:12345-0@lo:101: 00010000:00010000:1.0:1787826710.202301:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826710.202309:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b72b97b/0xc0fefc09a795316a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953163 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.202323:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b72b97b/0xc0fefc09a795316a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.202331:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b72b97b/0xc0fefc09a795316a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.202348:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b72b97b, rc 0) 00000100:00100000:1.0:1787826710.202380:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e77f1f68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570048:12345-0@lo:101: Request processed in 100us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.202387:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787826710.202391:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570048:0@lo:101: 00010000:00010000:3.0:1787826710.202401:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 000000005244ad61/0xc0fefc09a7953163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.202408:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 000000005244ad61/0xc0fefc09a7953163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.202468:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570176:0@lo:501: 00000100:00100000:3.0:1787826710.202489:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.202507:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43f8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.202524:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570176 00000100:00100000:2.0:1787826710.202529:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570176 00000100:00100000:2.0:1787826710.202551:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787826710.202555:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8c3bccd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570176:12345-0@lo:501: 00000100:00100000:2.0:1787826710.202618:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8c3bccd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570176:12345-0@lo:501: Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.202624:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826710.202632:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570176:0@lo:501: 00000100:00100000:3.0:1787826710.202656:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570304:0@lo:503: 00000100:00100000:3.0:1787826710.202686:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.202702:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43f8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.202718:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570304 00000100:00100000:1.0:1787826710.202722:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570304 00000100:00100000:1.0:1787826710.202742:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826710.202747:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008008e560 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570304:12345-0@lo:503: 00000100:00100000:1.0:1787826710.202806:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008008e560 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570304:12345-0@lo:503: Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.202811:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787826710.202816:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570304:0@lo:503: 00000040:00080000:3.0:1787826710.203030:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787826710.203082:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570432:0@lo:502: 00000100:00100000:3.0:1787826710.203111:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.203128:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a526a998 going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.203154:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570432 00000100:00100000:2.0:1787826710.203158:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570432 00000100:00100000:2.0:1787826710.203177:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787826710.203181:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e12b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570432:12345-0@lo:502: 00000100:00100000:2.0:1787826710.203278:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e12b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570432:12345-0@lo:502: Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826710.203298:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570432:0@lo:502: 00000100:00100000:2.0:1787826710.203310:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:3.0:1787826710.203460:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787826710.203482:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787826710.203493:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787826710.203503:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787826710.203513:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787826710.203523:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787826710.203533:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787826710.203543:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787826710.203552:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787826710.203562:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787826710.203572:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787826710.203582:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787826710.203591:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787826710.203612:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787826710.203622:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787826710.203632:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787826710.203642:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787826710.203653:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787826710.203662:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787826710.203671:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787826710.203681:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787826710.203691:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787826710.203701:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787826710.203715:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570560:0@lo:502: 00000100:00100000:3.0:1787826710.203744:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.203765:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a526a998 going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.203775:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570560 00000100:00100000:1.0:1787826710.203780:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570560 00000100:00100000:1.0:1787826710.203804:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826710.203811:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bbade90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570560:12345-0@lo:502: 00000100:00100000:1.0:1787826710.203882:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bbade90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570560:12345-0@lo:502: Request processed in 70us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826710.203891:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570560:0@lo:502: 00000100:00100000:1.0:1787826710.203903:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000040:00080000:3.0:1787826710.203923:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787826710.203931:0:7415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787826710.204306:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826710.204315:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826710.204317:0:7429:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787826710.204323:0:7429:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787826710.204326:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826710.204336:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a29ec31a) 00000020:00000080:3.0:1787826710.204350:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787826710.204355:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787826710.204427:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787826710.204433:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc0fefc09a7953178 00000020:00000080:3.0:1787826710.204613:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787826710.204617:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826710.204620:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826710.204621:0:7429:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787826710.204624:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826710.204633:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826710.204634:0:7429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787826710.204638:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826710.204645:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000bf85f79a) 00000020:00000080:3.0:1787826710.204655:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787826710.204659:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787826710.204661:0:7429:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787826710.204663:0:7429:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787826710.204669:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787826710.204719:0:7429:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000605c6fe6 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787826710.204739:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a6ff706f) 00000020:00000080:3.0:1787826710.204748:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787826710.204807:0:7429:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787826710.204812:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc0fefc09a795318d 00000020:00000080:3.0:1787826710.204894:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787826710.204900:0:7429:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787826710.204904:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc0fefc09a7953194 00080000:01000000:3.0:1787826710.204910:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787826710.204912:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc0fefc09a795319b 00080000:10000000:3.0:1787826710.205240:0:7429:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787826710.205369:0:7429:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1787826710.249439:0:7429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1787826710.249650:0:7429:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1787826710.251522:0:7429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787826710.251758:0:7429:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787826710.258317:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787826710.258329:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826710.258335:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826710.258337:0:7429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787826710.258340:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826710.258347:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826710.258348:0:7429:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787826710.258352:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787826710.258365:0:7429:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:00000080:3.0:1787826710.258389:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826710.258404:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000e2d84292) 00000020:00000080:3.0:1787826710.258423:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787826710.258429:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787826710.258497:0:7429:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787826710.258502:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787826710.258508:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc0fefc09a79531a9 00010000:00080000:3.0:1787826710.258538:0:7429:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f8a4b31e@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1787826710.259838:0:7429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787826710.260620:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787826710.260633:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787826710.260665:0:7429:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787826710.260684:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc0fefc09a79531b0 00000100:00080000:1.0:1787826710.260693:0:7429:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787826710.260698:0:7429:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000f8a4b31e using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826710.260730:0:7429:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000de8d31f7 x1874672143570688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826710.260775:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de8d31f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143570688:0@lo:38: 00000100:00080000:0.0:1787826710.260891:0:7429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787826710.260949:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826710.260954:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826710.260956:0:7429:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787826710.260959:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787826710.260962:0:7429:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787826710.260963:0:7429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826710.260965:0:7429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826710.260967:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787826710.260969:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826710.260978:0:7429:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787826710.260981:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826710.260986:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826710.260988:0:7429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787826710.260992:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787826710.261033:0:7429:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787826710.261054:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826710.261057:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826710.261058:0:7429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787826710.261061:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826710.261064:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826710.261065:0:7429:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787826710.261069:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787826710.261071:0:7429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787826710.261094:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826710.261097:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826710.261099:0:7429:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787826710.261102:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1787826710.261276:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143570816:0@lo:400: 00000100:00100000:0.0:1787826710.261331:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787826710.261363:0:7415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1787826710.261396:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787826710.261411:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 000000005244ad61/0xc0fefc09a7953163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826710.261421:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570816 00010000:00010000:3.0:1787826710.261422:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 000000005244ad61/0xc0fefc09a7953163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826710.261430:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570816 10000000:01000000:3.0:1787826710.261434:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 1 10000000:01000000:3.0:1787826710.261438:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826710.261468:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.261475:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826710.261478:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826710.261490:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000403a5d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143570816:12345-0@lo:400: 00010000:00010000:3.0:1787826710.261490:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.261511:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570944:0@lo:101: 00000100:00100000:0.0:1787826710.261550:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000403a5d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143570816:12345-0@lo:400: Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826710.261558:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787826710.261572:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787826710.261596:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009d462258 x1874672143570816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826710.261609:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143570816:0@lo:400: 00000100:00100000:3.0:1787826710.261684:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8f38f3d going to sleep for 11 seconds 00000100:00100000:0.0:1787826710.261700:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570944 00000100:00100000:0.0:1787826710.261706:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570944 00000100:00100000:0.0:1787826710.261738:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826710.261746:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fd1c628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:7415:x1874672143570944:12345-0@lo:101: 00010000:00010000:0.0:1787826710.261754:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826710.261766:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79531b7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.261788:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.261798:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.261806:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000741a8e62, rc 0) 00000100:00100000:0.0:1787826710.261849:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fd1c628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:7415:x1874672143570944:12345-0@lo:101: Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826710.261856:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787826710.261882:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143570944:0@lo:101: 00010000:00010000:3.0:1787826710.261906:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.261915:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.262043:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826710.262089:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143570688 00000100:00100000:0.0:1787826710.262094:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143570688 00000100:00100000:0.0:1787826710.262122:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826710.262128:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d610f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1874672143570688:12345-0@lo:38: 00010000:00080000:0.0:1787826710.262147:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 85 last 0 00000020:00000080:0.0:1787826710.262178:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc0fefc09a79531c5 00000004:00100000:0.0:1787826710.262192:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787826710.262198:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787826710.262483:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571072:0@lo:256: 00000100:00100000:3.0:1787826710.262516:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.262541:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8f38f3d going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.262582:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571072 00000100:00100000:1.0:1787826710.262587:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571072 00000100:00100000:1.0:1787826710.262623:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826710.262631:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000792711e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:7415:x1874672143571072:12345-0@lo:256: 20000000:01000000:1.0:1787826710.262644:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787826710.262658:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787826710.262661:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787826710.262812:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000792711e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:7415:x1874672143571072:12345-0@lo:256: Request processed in 182us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.262820:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787826710.262835:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571072:0@lo:256: 10000000:01000000:0.0:1787826710.263416:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826710.264015:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826710.264024:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826710.264050:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d54789ce800 from 1 10000000:01000000:1.0:1787826710.264053:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826710.264078:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.264085:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.264090:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.264104:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006476399b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571200:0@lo:101: 00000100:00100000:1.0:1787826710.264142:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.264175:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006401421 going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.264184:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571200 00000100:00100000:2.0:1787826710.264191:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571200 00000100:00100000:2.0:1787826710.264256:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826710.264268:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003557fdec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:7415:x1874672143571200:12345-0@lo:101: 00010000:00010000:2.0:1787826710.264291:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826710.264304:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79531cc expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.264325:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.264336:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.264345:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d641aec, rc 0) 00000100:00100000:2.0:1787826710.264403:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003557fdec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:7415:x1874672143571200:12345-0@lo:101: Request processed in 139us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.264410:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787826710.264446:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006476399b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571200:0@lo:101: 00010000:00010000:1.0:1787826710.264462:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.264478:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.264572:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006476399b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571328:0@lo:501: 00000100:00100000:1.0:1787826710.264616:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826710.264657:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571328 00000100:00100000:1.0:1787826710.264659:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006401421 going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.264663:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571328 00000100:00100000:2.0:1787826710.264693:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826710.264702:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092c19895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:7415:x1874672143571328:12345-0@lo:501: 00000100:00100000:2.0:1787826710.264802:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092c19895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:7415:x1874672143571328:12345-0@lo:501: Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.264810:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787826710.264830:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006476399b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571328:0@lo:501: 00000100:00100000:1.0:1787826710.264864:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006476399b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571456:0@lo:503: 00000100:00100000:1.0:1787826710.264906:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.264922:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006401421 going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.264952:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571456 00000100:00100000:2.0:1787826710.264958:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571456 00000100:00100000:2.0:1787826710.264993:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826710.265000:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042b7ebe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:7415:x1874672143571456:12345-0@lo:503: 00000040:00080000:2.0:1787826710.265032:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826710.265078:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042b7ebe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:7415:x1874672143571456:12345-0@lo:503: Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.265086:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787826710.265127:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006476399b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571456:0@lo:503: 00000040:00080000:1.0:1787826710.265417:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826710.265474:0:7415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1787826710.265558:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787826710.265771:0:6490:0:(import.c:65:import_set_state_nolock()) 00000000991714b9 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826710.265817:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d610f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1874672143570688:12345-0@lo:38: Request processed in 3688us (3773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.265828:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826710.265845:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826710.265855:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787826710.265862:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787826710.265867:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787826710.265869:0:3615:0:(import.c:65:import_set_state_nolock()) 00000000f8a4b31e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787826710.265884:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de8d31f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143570688:0@lo:38: 00000040:00080000:0.0:1787826710.266456:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787826710.266523:0:7415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787826710.266553:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826710.266570:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.266580:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826710.266628:0:7415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787826710.266631:0:7415:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d54789ce800 10000000:01000000:3.0:1787826710.266634:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d54789ce800 10000000:01000000:3.0:1787826710.266638:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826710.266642:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d54789ce800 from 1 10000000:01000000:3.0:1787826710.266645:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787826710.266664:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000de9e0198/0xc0fefc09a79531da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.266667:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f790c2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143571584:0@lo:41: 00010000:00010000:3.0:1787826710.266690:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000de9e0198/0xc0fefc09a79531da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.266698:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000de9e0198/0xc0fefc09a79531da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.266711:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571712:0@lo:101: 00000100:00100000:1.0:1787826710.266718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.266747:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826710.266766:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571584 00000100:00100000:3.0:1787826710.266771:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b92f4ca going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.266773:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571584 00000100:00100000:2.0:1787826710.266818:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826710.266824:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787826710.266825:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de8d31f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143571584:12345-0@lo:41: 00000100:00100000:3.0:1787826710.266834:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:2.0:1787826710.266846:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787826710.266885:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de8d31f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143571584:12345-0@lo:41: Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.266891:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826710.266915:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571712 00000100:00100000:2.0:1787826710.266919:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571712 00000100:00100000:3.0:1787826710.266929:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f790c2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143571584:0@lo:41: 00000100:00100000:2.0:1787826710.266967:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787826710.266976:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000327692fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:7415:x1874672143571712:12345-0@lo:101: 00010000:00010000:2.0:1787826710.266984:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826710.266995:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009733c047/0xc0fefc09a79531e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79531da expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.267018:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009733c047/0xc0fefc09a79531e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79531da expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.267042:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009733c047/0xc0fefc09a79531e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79531da expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.267049:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009733c047, rc 0) 00000100:00100000:2.0:1787826710.267080:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000327692fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143571712:12345-0@lo:101: Request processed in 107us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.267086:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787826710.267115:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571712:0@lo:101: 00010000:00010000:3.0:1787826710.267126:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000de9e0198/0xc0fefc09a79531da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826710.267133:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000de9e0198/0xc0fefc09a79531da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.267227:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571840:0@lo:501: 00000100:00100000:3.0:1787826710.267268:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826710.267300:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571840 00000100:00100000:3.0:1787826710.267303:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b92f4ca going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.267305:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571840 00000100:00100000:2.0:1787826710.267339:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826710.267345:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a3adb78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143571840:12345-0@lo:501: 00000100:00100000:2.0:1787826710.267418:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a3adb78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143571840:12345-0@lo:501: Request processed in 73us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.267425:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787826710.267439:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571840:0@lo:501: 00000100:00100000:3.0:1787826710.267459:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571968:0@lo:503: 00000100:00100000:3.0:1787826710.267484:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.267495:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b92f4ca going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.267500:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143571968 00000100:00100000:2.0:1787826710.267505:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143571968 00000100:00100000:2.0:1787826710.267527:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787826710.267533:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b5d260e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143571968:12345-0@lo:503: 00000100:00100000:2.0:1787826710.267608:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b5d260e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143571968:12345-0@lo:503: Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.267614:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787826710.267636:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143571968:0@lo:503: 00000040:00080000:3.0:1787826710.267775:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787826710.267814:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143572096:0@lo:502: 00000100:00100000:3.0:1787826710.267846:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.267862:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b92f4ca going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.267872:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572096 00000100:00100000:2.0:1787826710.267876:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572096 00000100:00100000:2.0:1787826710.267896:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787826710.267901:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8358fe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143572096:12345-0@lo:502: 00000100:00100000:2.0:1787826710.267968:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8358fe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143572096:12345-0@lo:502: Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826710.267980:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143572096:0@lo:502: 00000100:00100000:2.0:1787826710.267981:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:3.0:1787826710.268110:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787826710.268131:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787826710.268144:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787826710.268156:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787826710.268170:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787826710.268183:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787826710.268192:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787826710.268199:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787826710.268205:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787826710.268211:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787826710.268255:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787826710.268271:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787826710.268302:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787826710.268318:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787826710.268341:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787826710.268352:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787826710.268362:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787826710.268373:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787826710.268383:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787826710.268392:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787826710.268403:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787826710.268413:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787826710.268423:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787826710.268434:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787826710.268452:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787826710.268463:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787826710.268473:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787826710.268483:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787826710.268499:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143572224:0@lo:502: 00000100:00100000:3.0:1787826710.268526:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.268543:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b92f4ca going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.268565:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572224 00000100:00100000:2.0:1787826710.268570:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572224 00000100:00100000:2.0:1787826710.268597:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787826710.268603:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e327796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143572224:12345-0@lo:502: 00000100:00100000:2.0:1787826710.268673:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e327796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143572224:12345-0@lo:502: Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826710.268681:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143572224:0@lo:502: 00000100:00100000:2.0:1787826710.268683:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000040:00080000:3.0:1787826710.268712:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787826710.268718:0:7415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787826710.268924:0:7436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787826710.268938:0:7436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000005de357f8) 00000020:00000080:3.0:1787826710.268953:0:7436:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787826710.269008:0:7436:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000605c6fe6 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787826710.269011:0:7436:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000605c6fe6 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787826710.269013:0:7436:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000605c6fe6 3 00010000:00080000:3.0:1787826710.269031:0:7436:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000006d1a84@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1787826710.270245:0:7436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787826710.270402:0:7436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787826710.270420:0:7436:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826710.270427:0:7436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc0fefc09a79531ef 00000100:00080000:3.0:1787826710.270432:0:7436:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826710.270435:0:7436:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000006d1a84 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826710.270452:0:7436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ded7a56f x1874672143572352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826710.270468:0:7436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787826710.270496:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1874672143572352:0@lo:38: 00000100:00100000:1.0:1787826710.270546:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826710.270601:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572352 00000100:00100000:3.0:1787826710.270607:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572352 00000040:00080000:2.0:1787826710.270628:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1787826710.270637:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787826710.270649:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006476399b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1874672143572352:12345-0@lo:38: 00010000:00080000:3.0:1787826710.270668:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 85 last 0 00000020:01000000:1.0:1787826710.270678:0:7415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000020:00000080:3.0:1787826710.270695:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc0fefc09a79531f6 10000000:01000000:1.0:1787826710.270709:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00000004:00100000:3.0:1787826710.270712:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:1.0:1787826710.270724:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 00000000de9e0198/0xc0fefc09a79531da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.270733:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 00000000de9e0198/0xc0fefc09a79531da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826710.270748:0:6485:0:(import.c:65:import_set_state_nolock()) 000000005aa9c669 : changing import state from RECOVER to FULL 00000020:01000004:1.0:1787826710.270793:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787826710.270796:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826710.270798:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826710.270800:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:3.0:1787826710.270801:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006476399b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1874672143572352:12345-0@lo:38: Request processed in 150us (253us total) trans 0 rc 0/0 00000020:01000004:1.0:1787826710.270802:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826710.270805:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826710.270807:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826710.270811:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787826710.270812:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:3.0:1787826710.270814:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:1.0:1787826710.270815:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826710.270818:0:7415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826710.270822:0:7415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787826710.270825:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826710.270827:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826710.270828:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826710.270830:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826710.270831:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826710.270832:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826710.270833:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826710.270835:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00010000:00080000:2.0:1787826710.270837:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ded7a56f x1874672143572352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1787826710.270838:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787826710.270840:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826710.270842:0:7415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826710.270851:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826710.270858:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 10000000:01000000:1.0:1787826710.270860:0:7415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00080000:2.0:1787826710.270863:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787826710.270868:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:1.0:1787826710.270871:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4360234 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143572480:0@lo:253: 00000100:00080000:2.0:1787826710.270872:0:3615:0:(import.c:65:import_set_state_nolock()) 00000000006d1a84 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 40000000:00080000:3.0:1787826710.270877:0:7437:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1787826710.270882:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ded7a56f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1874672143572352:0@lo:38: 00000100:00100000:1.0:1787826710.270914:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.270935:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba218d5c going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.270944:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572480 00000100:00100000:2.0:1787826710.270949:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572480 00000100:00100000:2.0:1787826710.270980:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787826710.270989:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030ba0b55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143572480:12345-0@lo:253: 20000000:01000000:2.0:1787826710.271008:0:6479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787826710.271021:0:6479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787826710.271883:0:6464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787826710.271917:0:6479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826710.271931:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787826710.271957:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826710.271968:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826710.271983:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.271996:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795310f expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272001:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272005:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272026:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272037:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 15 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.272046:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011ac57d8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143572608:0@lo:104: 00000100:00100000:1.0:1787826710.272078:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826710.272116:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795310f expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826710.272122:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030ba0b55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:7415:x1874672143572480:12345-0@lo:253: Request processed in 1134us (1207us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826710.272127:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795310f expref: 15 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826710.272140:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787826710.272145:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc58c065 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143572736:0@lo:104: 00000100:00100000:1.0:1787826710.272175:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.272193:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c0d3e2b going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.272200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572608 00000100:00100000:2.0:1787826710.272204:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572608 00000100:00100000:1.0:1787826710.272210:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572736 00000100:00100000:2.0:1787826710.272268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787826710.272270:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572736 00000100:00100000:2.0:1787826710.272278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adc3671f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143572608:12345-0@lo:104: 00010000:00010000:2.0:1787826710.272301:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.272319:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787826710.272328:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b675cdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143572736:12345-0@lo:104: 00010000:00010000:1.0:1787826710.272336:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272349:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826710.272356:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adc3671f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143572608:12345-0@lo:104: Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.272363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787826710.272372:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4360234 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:7415:1874672143572480:0@lo:253: 00010000:00010000:2.0:1787826710.272384:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1787826710.272385:0:7415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787826710.272389:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826710.272391:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00010000:00010000:1.0:1787826710.272392:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:01000004:0.0:1787826710.272393:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:2.0:1787826710.272394:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826710.272397:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826710.272401:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1787826710.272403:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b675cdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143572736:12345-0@lo:104: Request processed in 76us (226us total) trans 0 rc 0/0 00000020:01000004:0.0:1787826710.272404:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826710.272407:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826710.272410:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787826710.272412:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787826710.272415:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:1.0:1787826710.272416:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1787826710.272417:0:7415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1787826710.272417:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000056f05267 already unused, calling callback (000000000e52dd1f) 10000000:00010000:2.0:1787826710.272425:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272433:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272440:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1787826710.272440:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1787826710.272442:0:7415:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787826710.272446:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826710.272457:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826710.272460:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9974394 already unused, calling callback (000000000e52dd1f) 10000000:00010000:1.0:1787826710.272463:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272469:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826710.272475:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826710.272480:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826710.272492:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272498:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272506:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826710.272513:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826710.272526:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272539:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 00000000d9974394/0xc0fefc09a795310f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953116 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272542:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826710.272545:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009ad83251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143572864:0@lo:103: 00010000:00010000:1.0:1787826710.272553:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826710.272556:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826710.272558:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 0000000056f05267/0xc0fefc09a79531b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531be expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.272560:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826710.272573:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826710.272575:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143572992:0@lo:103: 00010000:00010000:2.0:1787826710.272576:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826710.272579:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826710.272584:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826710.272606:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572864 00000100:00100000:2.0:1787826710.272610:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572864 00000100:00100000:1.0:1787826710.272622:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826710.272633:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 15 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826710.272664:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143572992 00000100:00100000:2.0:1787826710.272668:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143572992 00000100:00100000:1.0:1787826710.272675:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011ac57d8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143572608:0@lo:104: 00010000:00010000:2.0:1787826710.272682:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795310f expref: 16 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826710.272687:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc58c065 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143572736:0@lo:104: 00010000:00010000:1.0:1787826710.272713:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826710.272716:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787826710.272729:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1988c67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3618:x1874672143572864:12345-0@lo:103: 00010000:00010000:2.0:1787826710.272746:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826710.272750:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 16 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272757:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 16 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272766:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000741a8e62/0xc0fefc09a79531be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79531b7 expref: 16 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272780:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826710.272811:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1988c67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3618:x1874672143572864:12345-0@lo:103: Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.272817:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787826710.272837:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787826710.272842:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009ad83251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143572864:0@lo:103: 00000100:00100000:2.0:1787826710.272847:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc39e853 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3617:x1874672143572992:12345-0@lo:103: 00010000:00010000:2.0:1787826710.272857:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826710.272860:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795310f expref: 14 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272868:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795310f expref: 14 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272878:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006141ed5a/0xc0fefc09a7953116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795310f expref: 14 pid: 6479 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272887:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272894:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826710.272905:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000937604s 00010000:00010000:2.0:1787826710.272908:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272913:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272927:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272932:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272938:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005fc0249e already unused, calling callback (00000000110c4810) 00010000:00010000:2.0:1787826710.272940:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272946:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272968:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826710.272978:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826710.273004:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc39e853 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:3617:x1874672143572992:12345-0@lo:103: Request processed in 162us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826710.273010:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787826710.273092:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143572992:0@lo:103: 00010000:00010000:1.0:1787826710.273112:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.273119:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826710.273124:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005fc0249e/0xc0fefc09a79531fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787826710.276551:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1787826710.276738:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787826710.276927:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787826710.277108:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787826710.277559:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787826710.277792:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787826710.278513:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787826710.278734:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787826710.278870:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787826710.279005:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787826710.279175:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1787826710.279392:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000020:00080000:0.0:1787826710.280240:0:7441:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787826710.280245:0:7441:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787826710.280253:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787826710.280566:0:7442:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787826710.280568:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787826710.280645:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000874e5e17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7442:1874672143573120:0@lo:700: 00000100:00100000:3.0:1787826710.280744:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826710.280807:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143573120 00000100:00100000:3.0:1787826710.280809:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f43ca363 going to sleep for 11 seconds 00000100:00100000:2.0:1787826710.280821:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143573120 00000100:00100000:2.0:1787826710.280858:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826710.280866:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e0dc60f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7442:x1874672143573120:12345-0@lo:700: 00000100:00100000:0.0:1787826710.281066:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573248:0@lo:1000: 00000100:00100000:0.0:1787826710.281144:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.281195:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143573248 00000040:01000000:2.0:1787826710.281196:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1787826710.281197:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be32df0b going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.281205:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143573248 00000100:00100000:1.0:1787826710.281400:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826710.281411:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000900d12b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573248:12345-0@lo:1000: 00000040:00080000:2.0:1787826710.281440:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826710.281523:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000900d12b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573248:12345-0@lo:1000: Request processed in 114us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.281533:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826710.281572:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573248:0@lo:1000: 00000040:01000000:0.0:1787826710.281610:0:7443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787826710.281633:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573376:0@lo:700: 00000100:00100000:0.0:1787826710.281663:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826710.281689:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e00f7de3 going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.281762:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143573376 00000100:00100000:1.0:1787826710.281767:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143573376 00000100:00100000:1.0:1787826710.281805:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826710.281813:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081417c1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573376:12345-0@lo:700: 00000100:00100000:1.0:1787826710.281875:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081417c1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573376:12345-0@lo:700: Request processed in 63us (211us total) trans 0 rc 0/0 00000004:00000080:2.0:1787826710.281882:0:7415:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:1.0:1787826710.281888:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826710.281895:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573376:0@lo:700: 00000040:01000000:2.0:1787826710.281898:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1787826710.281933:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7443:1874672143573504:0@lo:900: 00000100:00100000:0.0:1787826710.281973:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826710.281996:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e00f7de3 going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.282030:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143573504 00000100:00100000:1.0:1787826710.282036:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143573504 00000040:00080000:2.0:1787826710.282078:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826710.282083:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826710.282094:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab2b0e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7443:x1874672143573504:12345-0@lo:900: 00000100:00100000:1.0:1787826710.282143:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab2b0e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7443:x1874672143573504:12345-0@lo:900: Request processed in 53us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.282151:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787826710.282193:0:7443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009d462258 x1874672143573504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787826726 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826710.282205:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d462258 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7443:1874672143573504:0@lo:900: 00000100:00100000:1.0:1787826710.282366:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573632:0@lo:1000: 00000100:00100000:1.0:1787826710.282411:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.282446:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143573632 00000100:00100000:1.0:1787826710.282449:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143573632 00000100:00100000:1.0:1787826710.282481:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826710.282488:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc58c065 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573632:12345-0@lo:1000: 00000100:00100000:1.0:1787826710.282540:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc58c065 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573632:12345-0@lo:1000: Request processed in 53us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826710.282546:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826710.282563:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024859119 going to sleep for 11 seconds 00000100:00100000:1.0:1787826710.282579:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573632:0@lo:1000: 00000004:00080000:1.0:1787826710.282626:0:7443:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001c80bd7f with version 0 00000020:00100000:1.0:1787826710.282642:0:7443:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826710.282647:0:7443:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000025d0583f x1874672143573888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826710.282660:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573888:0@lo:1000: 00000100:00100000:1.0:1787826710.282689:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826710.282714:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f9c9b79 going to sleep for 11 seconds 00000100:00100000:0.0:1787826710.282746:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143573888 00000100:00100000:0.0:1787826710.282753:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143573888 00000100:00100000:0.0:1787826710.282813:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787826710.282828:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011ac57d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573888:12345-0@lo:1000: 40000000:02000000:3.0:1787826710.282867:0:6492:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:2.0:1787826710.282953:0:7415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787826710.283463:0:7415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787826710.283483:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787826710.283583:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787826710.283737:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787826710.284261:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787826710.284415:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787826710.284511:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787826710.284630:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787826710.284781:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787826710.284967:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787826710.285060:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787826710.285178:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787826710.285354:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787826710.285470:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787826710.285597:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787826710.285707:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787826710.285852:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787826710.285985:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787826710.286119:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787826710.286316:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000001:00080000:1.0:1787826710.286538:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:2.0:1787826710.286573:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:0.0:1787826710.286664:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011ac57d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143573888:12345-0@lo:1000: Request processed in 3840us (3971us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787826710.286673:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1787826710.286684:0:7443:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787826710.286690:0:7443:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787826710.286706:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143573888:0@lo:1000: 00100000:10000000:2.0:1787826710.286713:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:1.0:1787826710.286796:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143574016:0@lo:1000: 00000100:00100000:1.0:1787826710.286832:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1787826710.286844:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000100:00100000:0.0:1787826710.286867:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143574016 00000100:00100000:1.0:1787826710.286871:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e0fea82 going to sleep for 11 seconds 00000100:00100000:0.0:1787826710.286873:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143574016 00000100:00100000:0.0:1787826710.286910:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787826710.286928:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d999ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143574016:12345-0@lo:1000: 00100000:10000000:2.0:1787826710.286994:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000100:00100000:0.0:1787826710.286998:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d999ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7443:x1874672143574016:12345-0@lo:1000: Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826710.287005:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787826710.287012:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025d0583f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1874672143574016:0@lo:1000: 00000040:00080000:1.0:1787826710.287036:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787826710.287058:0:7443:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001c80bd7f with version 1 00000004:00080000:0.0:1787826710.287087:0:7431:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000482002d7 version 1 rpc_version 1 00000020:00100000:0.0:1787826710.287106:0:7431:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826710.287114:0:7431:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ef9cfb76 x1874672143574272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00100000:10000000:2.0:1787826710.287114:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:0.0:1787826710.287131:0:7431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef9cfb76 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7431:1874672143574272:0@lo:1000: 00000100:00100000:0.0:1787826710.287169:0:7431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826710.287197:0:7431:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be32df0b going to sleep for 11 seconds 00000100:00100000:0.0:1787826710.287239:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143574272 00000100:00100000:0.0:1787826710.287243:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143574272 00000100:00100000:3.0:1787826710.287250:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e0dc60f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7442:x1874672143573120:12345-0@lo:700: Request processed in 6383us (6507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826710.287265:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826710.287278:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826710.287296:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d462258 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7431:x1874672143574272:12345-0@lo:1000: 00100000:10000000:2.0:1787826710.287326:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787826710.287475:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00010000:00080000:3.0:1787826710.287475:0:7442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000874e5e17 x1874672143573120/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787826726 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826710.287487:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000874e5e17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7442:1874672143573120:0@lo:700: 40000000:02000000:3.0:1787826710.287494:0:7442:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1787826710.287614:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787826710.287758:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787826710.287838:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787826710.287922:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787826710.288080:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787826710.288231:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787826710.288389:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787826710.288517:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787826710.288644:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000040:00080000:1.0:1787826710.288796:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000001:00000004:2.0:1787826710.288805:0:7415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:1.0:1787826710.288851:0:7443:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1787826710.289611:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1787826710.289695:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d462258 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7431:x1874672143574272:12345-0@lo:1000: Request processed in 2399us (2525us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787826710.289703:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787826710.289705:0:7431:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787826710.289708:0:7431:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787826710.289719:0:7431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef9cfb76 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7431:1874672143574272:0@lo:1000: 00000001:00080000:2.0:1787826710.291226:0:7415:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787826710.291250:0:7415:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d6a41c37988 00100000:10000000:2.0:1787826710.291257:0:7415:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787826710.291537:0:7415:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826710.291571:0:7415:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826710.291595:0:7415:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787826710.291612:0:7415:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787826710.292394:0:7415:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826710.292593:0:7415:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1787826710.305499:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826710.310743:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787826710.310813:0:7442:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787826710.310818:0:7442:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1787826710.737400:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826711.675661:0:7687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787826711.761515:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826712.016134:0:7739:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826712.016347:0:7739:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787826712.785478:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787826713.653158:0:7840:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826713.653416:0:7840:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826713.809333:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787826714.025439:0:7889:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb34d8490 20000000:00000080:1.0:1787826714.025455:0:7889:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d547570a400 uarg=0000000000000000 20000000:01000000:1.0:1787826714.025487:0:7889:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787826714.025492:0:7889:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787826714.025496:0:7889:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787826714.025554:0:7889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787826714.025564:0:7889:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787826714.030130:0:7889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826714.030400:0:7889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787826714.030431:0:7889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787826714.030449:0:7889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787826714.030466:0:7889:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787826714.030481:0:7889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.030498:0:7889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79530de expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.030514:0:7889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.030521:0:7889:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.030554:0:7889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.030567:0:7889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 12 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826714.030580:0:7889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e44897dc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7889:1874672143574400:0@lo:104: 00000100:00100000:1.0:1787826714.030636:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826714.030686:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787826714.030699:0:7889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79530de expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.030709:0:7889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79530de expref: 12 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826714.030718:0:7889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4360234 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7889:1874672143574528:0@lo:104: 00000100:00100000:0.0:1787826714.030722:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143574400 00000100:00100000:0.0:1787826714.030728:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143574400 00000100:00100000:1.0:1787826714.030752:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826714.030777:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143574528 00000100:00100000:0.0:1787826714.030781:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143574528 00000100:00100000:1.0:1787826714.030789:0:7889:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1dbf50f going to sleep for 11 seconds 00000100:00100000:2.0:1787826714.030796:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787826714.030810:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da658a9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:7889:x1874672143574400:12345-0@lo:104: 00000100:00100000:0.0:1787826714.030816:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787826714.030821:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826714.030827:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fcbabcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:7889:x1874672143574528:12345-0@lo:104: 00010000:00010000:0.0:1787826714.030836:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826714.030900:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787826714.030906:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da658a9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:7889:x1874672143574400:12345-0@lo:104: Request processed in 102us (270us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826714.030909:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787826714.030916:0:7889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e44897dc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7889:1874672143574400:0@lo:104: 00000100:00100000:0.0:1787826714.030922:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fcbabcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:7889:x1874672143574528:12345-0@lo:104: Request processed in 94us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826714.030922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787826714.030934:0:7889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4360234 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7889:1874672143574528:0@lo:104: 00010000:00010000:3.0:1787826714.030945:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787826714.030950:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787826714.030953:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826714.030964:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b87715c already unused, calling callback (000000000e52dd1f) 00010000:00010000:1.0:1787826714.030968:0:7889:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826714.030968:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.030976:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826714.030982:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826714.030996:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031004:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008bed8dba already unused, calling callback (000000000e52dd1f) 10000000:00010000:0.0:1787826714.031008:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826714.031008:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826714.031014:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787826714.031027:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826714.031033:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826714.031039:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787826714.031049:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826714.031057:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826714.031063:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031071:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826714.031081:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826714.031084:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e85b4f44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143574656:0@lo:103: 00010000:00010000:0.0:1787826714.031088:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826714.031099:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 000000003b87715c/0xc0fefc09a79531cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531d3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031103:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: 000000008bed8dba/0xc0fefc09a79530de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79530e5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826714.031119:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826714.031123:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826714.031124:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826714.031125:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826714.031127:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826714.031129:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826714.031135:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826714.031143:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000743dda74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143574784:0@lo:103: 00000100:00100000:3.0:1787826714.031162:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143574656 00000100:00100000:3.0:1787826714.031167:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143574656 00000100:00100000:2.0:1787826714.031176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826714.031188:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826714.031231:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143574784 00000100:00100000:0.0:1787826714.031237:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143574784 00000100:00100000:3.0:1787826714.031241:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826714.031250:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000874c9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3619:x1874672143574656:12345-0@lo:103: 00010000:00010000:0.0:1787826714.031266:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79530de expref: 14 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826714.031273:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826714.031279:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 14 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826714.031293:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 14 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826714.031300:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787826714.031310:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d641aec/0xc0fefc09a79531d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79531cc expref: 14 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826714.031311:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1324303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3616:x1874672143574784:12345-0@lo:103: 00010000:00010000:0.0:1787826714.031324:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826714.031328:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826714.031329:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79530de expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031343:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79530de expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031353:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a473459/0xc0fefc09a79530e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79530de expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826714.031366:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000874c9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:3619:x1874672143574656:12345-0@lo:103: Request processed in 118us (245us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826714.031370:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826714.031375:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787826714.031381:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e85b4f44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143574656:0@lo:103: 00010000:00010000:0.0:1787826714.031385:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031398:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031409:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031415:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031421:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031426:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c67df98b already unused, calling callback (00000000110c4810) 00010000:00010000:0.0:1787826714.031428:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031434:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031457:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826714.031465:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826714.031479:0:7889:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.031488:0:7889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826714.031493:0:7889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c67df98b/0xc0fefc09a7953204 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826714.031501:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1324303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:3616:x1874672143574784:12345-0@lo:103: Request processed in 194us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826714.031508:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826714.031539:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000743dda74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143574784:0@lo:103: 00010000:00010000:1.0:1787826714.833361:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826715.729353:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3e0026e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143574912:0@lo:41: 00000100:00100000:2.0:1787826715.729353:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000677f117d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143575296:0@lo:400: 00000100:00100000:3.0:1787826715.729372:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143575040:0@lo:400: 00000100:00100000:1.0:1787826715.729442:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826715.729442:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826715.729450:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092f0ef2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143575168:0@lo:400: 00000100:00100000:1.0:1787826715.729496:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000197d90b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143575424:0@lo:400: 00000100:00100000:2.0:1787826715.729504:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826715.729535:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575040 00000100:00100000:1.0:1787826715.729540:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143574912 00000100:00100000:3.0:1787826715.729543:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575040 00000100:00100000:1.0:1787826715.729545:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143574912 00000100:00100000:2.0:1787826715.729569:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575168 00000100:00100000:2.0:1787826715.729575:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575168 00000100:00100000:3.0:1787826715.729593:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787826715.729597:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787826715.729605:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e7dca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:3618:x1874672143575040:12345-0@lo:400: 00000100:00100000:1.0:1787826715.729610:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d058f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143574912:12345-0@lo:41: 00000100:00100000:2.0:1787826715.729616:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826715.729625:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a5aa5e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143575168:12345-0@lo:400: 00000004:00000024:1.0:1787826715.729640:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787826715.729658:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e7dca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:3618:x1874672143575040:12345-0@lo:400: Request processed in 56us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826715.729673:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a5aa5e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143575168:12345-0@lo:400: Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826715.729676:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787826715.729684:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787826715.729688:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d058f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143574912:12345-0@lo:41: Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826715.729696:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787826715.729735:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087df7717 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143575040:0@lo:400: 00010000:00080000:2.0:1787826715.729739:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000092f0ef2d x1874672143575168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826715.729740:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826715.729756:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092f0ef2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143575168:0@lo:400: 00000100:00100000:3.0:1787826715.729776:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575296 00000100:00100000:3.0:1787826715.729779:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575296 00000100:00100000:1.0:1787826715.729786:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826715.729803:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826715.729811:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4250c1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143575296:12345-0@lo:400: 00000100:00100000:2.0:1787826715.729828:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575424 00000100:00100000:2.0:1787826715.729833:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575424 00000100:00100000:1.0:1787826715.729839:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3e0026e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143574912:0@lo:41: 00000100:00100000:3.0:1787826715.729853:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4250c1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143575296:12345-0@lo:400: Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826715.729862:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826715.729871:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826715.729880:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e52ec40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143575424:12345-0@lo:400: 00000100:00100000:1.0:1787826715.729883:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000677f117d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143575296:0@lo:400: 00000100:00100000:2.0:1787826715.729927:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e52ec40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143575424:12345-0@lo:400: Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826715.729935:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787826715.729939:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000197d90b1 x1874672143575424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826715.729949:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000197d90b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143575424:0@lo:400: 00010000:00010000:2.0:1787826715.857420:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787826716.561276:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787826716.561282:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 4 10000000:01000000:1.0:1787826716.561286:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787826716.561324:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 000000004fb0e51e/0xc0fefc09a795320b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.561340:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 000000004fb0e51e/0xc0fefc09a795320b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.561347:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 000000004fb0e51e/0xc0fefc09a795320b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826716.561364:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575552:0@lo:101: 00000100:00100000:1.0:1787826716.561424:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.561484:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575552 00000100:00100000:1.0:1787826716.561490:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022e0729e going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.561492:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575552 00000100:00100000:2.0:1787826716.561542:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787826716.561548:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000094aad7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+11:6482:x1874672143575552:12345-0@lo:101: 00010000:00010000:2.0:1787826716.561557:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826716.561566:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ec29ab7/0xc0fefc09a7953212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795320b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.561582:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ec29ab7/0xc0fefc09a7953212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795320b expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.561588:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ec29ab7/0xc0fefc09a7953212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795320b expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.561593:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ec29ab7, rc 0) 00000100:00100000:2.0:1787826716.561625:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000094aad7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143575552:12345-0@lo:101: Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.561631:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787826716.561665:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575552:0@lo:101: 00010000:00010000:1.0:1787826716.561679:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 000000004fb0e51e/0xc0fefc09a795320b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.561687:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 000000004fb0e51e/0xc0fefc09a795320b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826716.561729:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575680:0@lo:256: 00000100:00100000:1.0:1787826716.561760:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.561782:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022e0729e going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.561808:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575680 00000100:00100000:2.0:1787826716.561812:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575680 00000100:00100000:2.0:1787826716.561833:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787826716.561842:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000067241c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143575680:12345-0@lo:256: 20000000:01000000:2.0:1787826716.561853:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826716.561863:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826716.561865:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787826716.561927:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000067241c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143575680:12345-0@lo:256: Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.561937:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575680:0@lo:256: 00000100:00100000:2.0:1787826716.561938:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 10000000:01000000:1.0:1787826716.561987:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826716.561993:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: 000000004fb0e51e/0xc0fefc09a795320b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.562001:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: 000000004fb0e51e/0xc0fefc09a795320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826716.562008:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787826716.562010:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d54789ce800 from 1 10000000:01000000:1.0:1787826716.562012:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826716.562025:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: 00000000c67df98b/0xc0fefc09a7953219 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.562031:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: 00000000c67df98b/0xc0fefc09a7953219 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.562037:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: 00000000c67df98b/0xc0fefc09a7953219 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826716.562055:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575808:0@lo:101: 00000100:00100000:1.0:1787826716.562089:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.562106:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022e0729e going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.562133:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575808 00000100:00100000:2.0:1787826716.562138:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575808 00000100:00100000:2.0:1787826716.562164:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826716.562170:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021868f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+12:6482:x1874672143575808:12345-0@lo:101: 00010000:00010000:2.0:1787826716.562176:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826716.562184:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d641aec/0xc0fefc09a7953220 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953219 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.562206:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d641aec/0xc0fefc09a7953220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.562246:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d641aec/0xc0fefc09a7953220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.562253:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d641aec, rc 0) 00000100:00100000:2.0:1787826716.562282:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021868f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:6482:x1874672143575808:12345-0@lo:101: Request processed in 113us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.562288:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787826716.562327:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575808:0@lo:101: 00010000:00010000:1.0:1787826716.562337:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: 00000000c67df98b/0xc0fefc09a7953219 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.562353:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: 00000000c67df98b/0xc0fefc09a7953219 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826716.562407:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575936:0@lo:501: 00000100:00100000:1.0:1787826716.562430:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.562451:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022e0729e going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.562472:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143575936 00000100:00100000:2.0:1787826716.562477:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143575936 00000100:00100000:2.0:1787826716.562502:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826716.562505:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe764ff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:6482:x1874672143575936:12345-0@lo:501: 00000100:00100000:2.0:1787826716.562601:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe764ff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:6482:x1874672143575936:12345-0@lo:501: Request processed in 95us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.562608:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787826716.562633:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143575936:0@lo:501: 00000100:00100000:1.0:1787826716.562660:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576064:0@lo:503: 00000100:00100000:1.0:1787826716.562698:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.562715:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022e0729e going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.562749:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576064 00000100:00100000:2.0:1787826716.562754:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576064 00000100:00100000:2.0:1787826716.562783:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787826716.562789:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b055a60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:6482:x1874672143576064:12345-0@lo:503: 00000100:00100000:2.0:1787826716.562865:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b055a60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:6482:x1874672143576064:12345-0@lo:503: Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.562872:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787826716.562906:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000363654e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576064:0@lo:503: 00000100:00100000:2.0:1787826716.563173:0:8258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009ad83251 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8258:1874672143576192:0@lo:502: 00000100:00100000:2.0:1787826716.563206:0:8258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.563251:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576192 00000100:00100000:1.0:1787826716.563256:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576192 00000100:00100000:2.0:1787826716.563262:0:8258:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b678c1f going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.563287:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787826716.563294:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001792ecee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:8258:x1874672143576192:12345-0@lo:502: 00000100:00100000:1.0:1787826716.563368:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001792ecee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:8258:x1874672143576192:12345-0@lo:502: Request processed in 73us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.563375:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787826716.563396:0:8258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009ad83251 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8258:1874672143576192:0@lo:502: 00000020:01000000:2.0:1787826716.563421:0:8258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826716.563429:0:8258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826716.563432:0:8258:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787826716.563439:0:8258:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d54789ce800 00000020:00000080:2.0:1787826716.563441:0:8258:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787826716.563476:0:8258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8258:1874672143576320:0@lo:502: 00000100:00100000:2.0:1787826716.563516:0:8258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.563535:0:8258:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.563566:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576320 00000100:00100000:0.0:1787826716.563572:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576320 00000100:00100000:0.0:1787826716.563602:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787826716.563610:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:8258:x1874672143576320:12345-0@lo:502: 00000100:00100000:0.0:1787826716.563685:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:8258:x1874672143576320:12345-0@lo:502: Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.563697:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826716.563704:0:8258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8258:1874672143576320:0@lo:502: 00000020:01000000:2.0:1787826716.563724:0:8258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826716.563729:0:8258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826716.563731:0:8258:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787826716.563734:0:8258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787826716.563806:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787826716.563828:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826716.563835:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.563843:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826716.563856:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787826716.563858:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5448400800 from 21 10000000:01000000:1.0:1787826716.563859:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826716.563874:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.563879:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.563884:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826716.563891:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576448:0@lo:101: 00000100:00100000:1.0:1787826716.563908:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.563921:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.563930:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576448 00000100:00100000:2.0:1787826716.563936:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576448 00000100:00100000:2.0:1787826716.563964:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787826716.563971:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:6482:x1874672143576448:12345-0@lo:101: 00010000:00010000:2.0:1787826716.563977:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826716.563986:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953227 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.564002:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.564010:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.564016:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5482177a00, rc 0) 00000100:00100000:2.0:1787826716.564045:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143576448:12345-0@lo:101: Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.564051:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787826716.564074:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576448:0@lo:101: 00010000:00010000:1.0:1787826716.564085:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.564092:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826716.564125:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576576:0@lo:501: 00000100:00100000:1.0:1787826716.564147:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.564162:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.564190:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576576 00000100:00100000:0.0:1787826716.564194:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576576 00000100:00100000:0.0:1787826716.564252:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787826716.564262:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143576576:12345-0@lo:501: 00000100:00100000:0.0:1787826716.564346:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143576576:12345-0@lo:501: Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.564353:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826716.564374:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576576:0@lo:501: 00000100:00100000:1.0:1787826716.564401:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576704:0@lo:503: 00000100:00100000:1.0:1787826716.564438:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.564460:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.564464:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576704 00000100:00100000:2.0:1787826716.564468:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576704 00000100:00100000:2.0:1787826716.564499:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787826716.564505:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143576704:12345-0@lo:503: 00000100:00100000:2.0:1787826716.564581:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143576704:12345-0@lo:503: Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.564587:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787826716.564606:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143576704:0@lo:503: 00000100:00100000:1.0:1787826716.564802:0:8259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8259:1874672143576832:0@lo:502: 00000100:00100000:1.0:1787826716.564833:0:8259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.564848:0:8259:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.564882:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576832 00000100:00100000:0.0:1787826716.564887:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576832 00000100:00100000:0.0:1787826716.564910:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826716.564917:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8259:x1874672143576832:12345-0@lo:502: 00000100:00100000:0.0:1787826716.564995:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8259:x1874672143576832:12345-0@lo:502: Request processed in 77us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.565012:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787826716.565015:0:8259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8259:1874672143576832:0@lo:502: 00000100:00100000:1.0:1787826716.565058:0:8259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8259:1874672143576960:0@lo:502: 00000100:00100000:1.0:1787826716.565087:0:8259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.565099:0:8259:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.565108:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143576960 00000100:00100000:2.0:1787826716.565113:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143576960 00000100:00100000:2.0:1787826716.565139:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787826716.565146:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8259:x1874672143576960:12345-0@lo:502: 00000100:00100000:1.0:1787826716.565251:0:8259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8259:1874672143576960:0@lo:502: 00000100:00100000:2.0:1787826716.565266:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8259:x1874672143576960:12345-0@lo:502: Request processed in 119us (176us total) trans 0 rc 0/0 00000040:00080000:1.0:1787826716.565268:0:8259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000100:00100000:2.0:1787826716.565279:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:01000000:3.0:1787826716.565345:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787826716.565362:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787826716.565368:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826716.565376:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826716.565383:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826716.565385:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 4 10000000:01000000:3.0:1787826716.565387:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826716.565403:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826716.565410:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826716.565416:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826716.565437:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577088:0@lo:101: 00000100:00100000:3.0:1787826716.565462:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.565484:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.565510:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577088 00000100:00100000:0.0:1787826716.565515:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577088 00000100:00100000:0.0:1787826716.565540:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826716.565544:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143577088:12345-0@lo:101: 00010000:00010000:0.0:1787826716.565550:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826716.565557:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953235 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.565569:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.565577:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.565584:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c81600, rc 0) 00000100:00100000:0.0:1787826716.565622:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143577088:12345-0@lo:101: Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.565627:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787826716.565657:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577088:0@lo:101: 00010000:00010000:2.0:1787826716.565669:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.565678:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826716.565717:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577216:0@lo:256: 00000100:00100000:2.0:1787826716.565738:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.565752:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.565775:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577216 00000100:00100000:1.0:1787826716.565781:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577216 00000100:00100000:1.0:1787826716.565808:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787826716.565814:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143577216:12345-0@lo:256: 20000000:01000000:1.0:1787826716.565826:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826716.565839:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826716.565842:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787826716.565930:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143577216:12345-0@lo:256: Request processed in 113us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.565938:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787826716.565944:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577216:0@lo:256: 10000000:01000000:2.0:1787826716.565984:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826716.565990:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.565998:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826716.566005:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787826716.566007:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787826716.566008:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787826716.566020:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.566024:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.566035:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826716.566046:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577344:0@lo:101: 00000100:00100000:2.0:1787826716.566072:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.566088:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.566117:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577344 00000100:00100000:0.0:1787826716.566122:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577344 00000100:00100000:0.0:1787826716.566149:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787826716.566156:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143577344:12345-0@lo:101: 00010000:00010000:0.0:1787826716.566163:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826716.566172:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953243 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.566187:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.566201:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.566208:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80000, rc 0) 00000100:00100000:0.0:1787826716.566269:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143577344:12345-0@lo:101: Request processed in 113us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.566276:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787826716.566283:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577344:0@lo:101: 00010000:00010000:2.0:1787826716.566297:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.566304:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826716.566344:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577472:0@lo:501: 00000100:00100000:2.0:1787826716.566365:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.566400:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.566410:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577472 00000100:00100000:1.0:1787826716.566415:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577472 00000100:00100000:1.0:1787826716.566442:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787826716.566448:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143577472:12345-0@lo:501: 00000100:00100000:1.0:1787826716.566552:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143577472:12345-0@lo:501: Request processed in 103us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.566559:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787826716.566587:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577472:0@lo:501: 00000100:00100000:2.0:1787826716.566613:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577600:0@lo:503: 00000100:00100000:2.0:1787826716.566644:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.566666:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.566687:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577600 00000100:00100000:0.0:1787826716.566692:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577600 00000100:00100000:0.0:1787826716.566718:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787826716.566724:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143577600:12345-0@lo:503: 00000100:00100000:0.0:1787826716.566791:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143577600:12345-0@lo:503: Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.566798:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787826716.566806:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143577600:0@lo:503: 00000100:00100000:2.0:1787826716.567085:0:8260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8260:1874672143577728:0@lo:502: 00000100:00100000:2.0:1787826716.567118:0:8260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.567135:0:8260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.567153:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577728 00000100:00100000:1.0:1787826716.567158:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577728 00000100:00100000:1.0:1787826716.567183:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787826716.567189:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8260:x1874672143577728:12345-0@lo:502: 00000100:00100000:1.0:1787826716.567290:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8260:x1874672143577728:12345-0@lo:502: Request processed in 100us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.567298:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787826716.567304:0:8260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8260:1874672143577728:0@lo:502: 00000020:01000000:2.0:1787826716.567333:0:8260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826716.567342:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826716.567344:0:8260:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787826716.567349:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826716.567353:0:8260:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:00000080:2.0:1787826716.567373:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826716.567386:0:8260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d54604419b8) 00000020:00000080:2.0:1787826716.567404:0:8260:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1787826716.567410:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826716.567493:0:8260:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787826716.567499:0:8260:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787826716.567505:0:8260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a7953258 00010000:00080000:2.0:1787826716.567530:0:8260:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5476376000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826716.569119:0:8260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1787826716.569747:0:8260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826716.569759:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787826716.569791:0:8260:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787826716.569813:0:8260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0fefc09a795325f 00000100:00080000:0.0:1787826716.569821:0:8260:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826716.569828:0:8260:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d5476376000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826716.569859:0:8260:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d545aa7c000 x1874672143577856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826716.569883:0:8260:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787826716.569910:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143577856:0@lo:38: 00000040:01000000:0.0:1787826716.569925:0:8260:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787826716.569980:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.569996:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143577984:0@lo:400: 00000100:00100000:0.0:1787826716.570012:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143578240:0@lo:400: 00000100:00100000:3.0:1787826716.570021:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143578112:0@lo:400: 00000100:00100000:1.0:1787826716.570036:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826716.570062:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.570064:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577984 00000100:00100000:2.0:1787826716.570072:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577984 00000100:00100000:3.0:1787826716.570072:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826716.570093:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143577856 00000100:00100000:1.0:1787826716.570098:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143577856 00000100:00100000:2.0:1787826716.570113:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143578240 00000100:00100000:2.0:1787826716.570118:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143578240 00000100:00100000:1.0:1787826716.570127:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143578112 00000100:00100000:0.0:1787826716.570128:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826716.570133:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143578112 00000100:00100000:3.0:1787826716.570134:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826716.570143:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143577984:12345-0@lo:400: 00000100:00100000:3.0:1787826716.570145:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1874672143577856:12345-0@lo:38: 00000100:00100000:2.0:1787826716.570154:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787826716.570158:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826716.570170:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143578112:12345-0@lo:400: 00000100:00100000:2.0:1787826716.570171:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143578240:12345-0@lo:400: 00010000:00080000:3.0:1787826716.570172:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 91 last 0 00000100:00100000:0.0:1787826716.570204:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143577984:12345-0@lo:400: Request processed in 65us (168us total) trans 0 rc 0/0 00000020:00000080:3.0:1787826716.570247:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0fefc09a7953266 00000100:00100000:1.0:1787826716.570251:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143578112:12345-0@lo:400: Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.570260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826716.570262:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00100000:3.0:1787826716.570262:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787826716.570269:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143578240:12345-0@lo:400: Request processed in 104us (208us total) trans 0 rc 0/0 00000001:00000004:3.0:1787826716.570270:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787826716.570281:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787826716.570314:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d545326a1c0 x1874672143577984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826716.570327:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d545326ad00 x1874672143578240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826716.570329:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143577984:0@lo:400: 00000100:00100000:2.0:1787826716.570345:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143578240:0@lo:400: 00000100:00100000:3.0:1787826716.570359:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143578112:0@lo:400: 00000020:01000000:0.0:1787826716.570538:0:8260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826716.570543:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826716.570545:0:8260:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787826716.570548:0:8260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826716.570553:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826716.570556:0:8260:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000100:00080000:3.0:1787826716.570557:0:8263:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8d545326a580 x1874672143578368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1787826716.570559:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787826716.570563:0:8260:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787826716.570571:0:8263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb600 going to sleep for 0 seconds 00000100:00100000:0.0:1787826716.570593:0:8260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8260:1874672143578496:0@lo:502: 00000100:00100000:0.0:1787826716.570630:0:8260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826716.570657:0:8260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1ccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.570721:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143578496 00000100:00100000:2.0:1787826716.570726:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143578496 00000100:00100000:2.0:1787826716.570757:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787826716.570762:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8260:x1874672143578496:12345-0@lo:502: 00000100:00100000:2.0:1787826716.570846:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8260:x1874672143578496:12345-0@lo:502: Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.570853:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787826716.570879:0:8260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8260:1874672143578496:0@lo:502: 00000020:01000000:0.0:1787826716.570898:0:8260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826716.570901:0:8260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826716.570902:0:8260:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787826716.570904:0:8260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787826716.570977:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787826716.571004:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787826716.571013:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826716.571023:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826716.571033:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787826716.571035:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5448400800 from 1 10000000:01000000:3.0:1787826716.571043:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826716.571066:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826716.571071:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826716.571077:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826716.571086:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143578624:0@lo:101: 00000100:00100000:3.0:1787826716.571114:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.571136:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.571167:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143578624 00000100:00100000:1.0:1787826716.571173:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143578624 00000100:00100000:1.0:1787826716.571205:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787826716.571249:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143578624:12345-0@lo:101: 00010000:00010000:1.0:1787826716.571259:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826716.571271:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795326d expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.571293:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795326d expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.571304:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795326d expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826716.571313:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544167da00, rc 0) 00000100:00100000:1.0:1787826716.571348:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143578624:12345-0@lo:101: Request processed in 135us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.571355:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787826716.571379:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143578624:0@lo:101: 00010000:00010000:3.0:1787826716.571392:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826716.571402:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826716.571451:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143578752:0@lo:501: 00000100:00100000:3.0:1787826716.571475:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.571495:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.571516:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143578752 00000100:00100000:2.0:1787826716.571520:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143578752 00000100:00100000:2.0:1787826716.571547:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787826716.571555:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143578752:12345-0@lo:501: 00000100:00100000:2.0:1787826716.571648:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143578752:12345-0@lo:501: Request processed in 94us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.571655:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787826716.571665:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143578752:0@lo:501: 00000100:00100000:3.0:1787826716.571697:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143578880:0@lo:503: 00000100:00100000:3.0:1787826716.571728:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.571746:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.571769:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143578880 00000100:00100000:1.0:1787826716.571774:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143578880 00000100:00100000:1.0:1787826716.571797:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787826716.571803:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143578880:12345-0@lo:503: 00000100:00100000:1.0:1787826716.571875:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143578880:12345-0@lo:503: Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.571883:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787826716.571889:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143578880:0@lo:503: 00000100:00100000:3.0:1787826716.572102:0:8264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8264:1874672143579008:0@lo:502: 00000100:00100000:3.0:1787826716.572134:0:8264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.572148:0:8264:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826716.572165:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579008 00000100:00100000:2.0:1787826716.572170:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579008 00000100:00100000:2.0:1787826716.572193:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787826716.572200:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:8264:x1874672143579008:12345-0@lo:502: 00000100:00100000:2.0:1787826716.572301:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:8264:x1874672143579008:12345-0@lo:502: Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.572309:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787826716.572328:0:8264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8264:1874672143579008:0@lo:502: 00000020:01000000:3.0:1787826716.572344:0:8264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826716.572349:0:8264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826716.572350:0:8264:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787826716.572354:0:8264:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5448400800 00000020:00000080:3.0:1787826716.572356:0:8264:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787826716.572369:0:8264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8264:1874672143579136:0@lo:502: 00000100:00100000:3.0:1787826716.572391:0:8264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.572406:0:8264:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.572424:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579136 00000100:00100000:1.0:1787826716.572429:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579136 00000100:00100000:1.0:1787826716.572468:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787826716.572477:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:8264:x1874672143579136:12345-0@lo:502: 00000100:00100000:1.0:1787826716.572536:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:8264:x1874672143579136:12345-0@lo:502: Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826716.572541:0:8264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54532692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8264:1874672143579136:0@lo:502: 00000100:00100000:1.0:1787826716.572554:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000000:3.0:1787826716.572560:0:8264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826716.572564:0:8264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826716.572565:0:8264:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787826716.572567:0:8264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787826716.572616:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787826716.572633:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826716.572639:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.572648:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826716.572665:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787826716.572667:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d5450ee99b8 from 1 10000000:01000000:2.0:1787826716.572670:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787826716.572687:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.572694:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.572700:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826716.572708:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143579264:0@lo:101: 00000100:00100000:2.0:1787826716.572726:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.572739:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.572760:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579264 00000100:00100000:0.0:1787826716.572766:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579264 00000100:00100000:0.0:1787826716.572805:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787826716.572813:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143579264:12345-0@lo:101: 00010000:00010000:0.0:1787826716.572821:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826716.572830:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795327b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.572859:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795327b expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.572876:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795327b expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826716.572883:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c81a00, rc 0) 00000100:00100000:0.0:1787826716.572920:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143579264:12345-0@lo:101: Request processed in 109us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.572924:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787826716.572949:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143579264:0@lo:101: 00010000:00010000:2.0:1787826716.572970:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.572978:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826716.573015:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143579392:0@lo:501: 00000100:00100000:2.0:1787826716.573033:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.573050:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.573091:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579392 00000100:00100000:1.0:1787826716.573095:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579392 00000100:00100000:1.0:1787826716.573116:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787826716.573120:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143579392:12345-0@lo:501: 00000100:00100000:1.0:1787826716.573161:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143579392:12345-0@lo:501: Request processed in 41us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826716.573166:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787826716.573185:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143579392:0@lo:501: 10000000:01000000:2.0:1787826716.573203:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787826716.573247:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826716.573256:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826716.575067:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8d547d130800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826716.575143:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1874672143577856:12345-0@lo:38: Request processed in 4998us (5163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826716.575154:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787826716.575170:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826716.575177:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787826716.575183:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787826716.575187:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787826716.575189:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5476376000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787826716.575210:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000068232bbb): req@ffff8d545326a580 x1874672143578368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826716.575275:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143577856:0@lo:38: 00000100:00100000:0.0:1787826716.575304:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143579520:0@lo:41: 00000100:00100000:3.0:1787826716.575325:0:8263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826716.575354:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.575369:0:8263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.575375:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143578368 00000100:00100000:1.0:1787826716.575382:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143578368 00000100:00100000:2.0:1787826716.575393:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579520 00000100:00100000:2.0:1787826716.575399:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579520 00000100:00100000:1.0:1787826716.575419:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787826716.575427:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826716.575431:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54532692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8263:x1874672143578368:12345-0@lo:1000: 00000100:00100000:3.0:1787826716.575441:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3617:x1874672143579520:12345-0@lo:41: 00000004:00000024:3.0:1787826716.575465:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787826716.575512:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54532692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8263:x1874672143578368:12345-0@lo:1000: Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826716.575517:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787826716.575562:0:8263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143578368:0@lo:1000: 00000100:00100000:3.0:1787826716.575581:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143579520:12345-0@lo:41: Request processed in 143us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826716.575596:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000040:01000000:2.0:1787826716.575603:0:8263:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787826716.575618:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143579520:0@lo:41: 00000100:00100000:2.0:1787826716.575635:0:8263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143579648:0@lo:1000: 00000100:00100000:2.0:1787826716.575667:0:8263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.575689:0:8263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826716.575703:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579648 00000100:00100000:3.0:1787826716.575707:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579648 00000100:00100000:3.0:1787826716.575734:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787826716.575743:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8263:x1874672143579648:12345-0@lo:1000: 00000100:00100000:3.0:1787826716.575844:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8263:x1874672143579648:12345-0@lo:1000: Request processed in 103us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826716.575852:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787826716.575855:0:8263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143579648:0@lo:1000: 00000100:00100000:2.0:1787826716.575896:0:8263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143579776:0@lo:700: 00000100:00100000:2.0:1787826716.575918:0:8263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.575936:0:8263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826716.575959:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579776 00000100:00100000:0.0:1787826716.575964:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579776 00000100:00100000:0.0:1787826716.575994:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787826716.576001:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8263:x1874672143579776:12345-0@lo:700: 00000100:00100000:0.0:1787826716.576046:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8263:x1874672143579776:12345-0@lo:700: Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826716.576053:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826716.576059:0:8263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143579776:0@lo:700: 00000100:00100000:2.0:1787826716.576177:0:8263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143579904:0@lo:1000: 00000100:00100000:2.0:1787826716.576199:0:8263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.576257:0:8263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54604d9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826716.576321:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143579904 00000100:00100000:3.0:1787826716.576326:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143579904 00000100:00100000:3.0:1787826716.576353:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826716.576360:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8263:x1874672143579904:12345-0@lo:1000: 00000100:00100000:3.0:1787826716.576462:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8263:x1874672143579904:12345-0@lo:1000: Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826716.576468:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787826716.576496:0:8263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143579904:0@lo:1000: 00000004:00080000:2.0:1787826716.576542:0:8263:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8d54757d7240 with version 0 00000020:00100000:2.0:1787826716.576556:0:8263:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826716.576562:0:8263:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d54533352c0 x1874672143580160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826716.576575:0:8263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143580160:0@lo:1000: 00000100:00100000:2.0:1787826716.576598:0:8263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.576616:0:8263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54604d9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826716.576630:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143580160 00000100:00100000:3.0:1787826716.576646:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143580160 00000100:00100000:1.0:1787826716.576700:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826716.576710:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8263:x1874672143580160:12345-0@lo:1000: 00000001:00080000:2.0:1787826716.580744:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1787826716.580758:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787826716.580912:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8263:x1874672143580160:12345-0@lo:1000: Request processed in 4200us (4308us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787826716.580925:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1787826716.580936:0:8263:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787826716.580942:0:8263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787826716.580970:0:8263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143580160:0@lo:1000: 00000100:00100000:2.0:1787826716.581050:0:8263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143580288:0@lo:1000: 00000100:00100000:2.0:1787826716.581100:0:8263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826716.581136:0:8263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54604d9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826716.581140:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143580288 00000100:00100000:3.0:1787826716.581148:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143580288 00000100:00100000:3.0:1787826716.581198:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787826716.581209:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8263:x1874672143580288:12345-0@lo:1000: 00000100:00100000:3.0:1787826716.581316:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8263:x1874672143580288:12345-0@lo:1000: Request processed in 110us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826716.581328:0:8263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8263:1874672143580288:0@lo:1000: 00000100:00100000:3.0:1787826716.581334:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000040:00080000:2.0:1787826716.581348:0:8263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787826716.581386:0:8263:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8d54604d9000 with version 1 00000004:00080000:3.0:1787826716.581413:0:8261:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8d54757d7300 version 1 rpc_version 1 00000020:00100000:3.0:1787826716.581429:0:8261:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826716.581443:0:8261:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d545326b480 x1874672143580544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826716.581465:0:8261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8261:1874672143580544:0@lo:1000: 00000100:00100000:3.0:1787826716.581496:0:8261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826716.581516:0:8261:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826716.581580:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143580544 00000100:00100000:1.0:1787826716.581585:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143580544 00000100:00100000:1.0:1787826716.581616:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787826716.581634:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8261:x1874672143580544:12345-0@lo:1000: 00000001:00080000:3.0:1787826716.582516:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787826716.582590:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8261:x1874672143580544:12345-0@lo:1000: Request processed in 965us (1091us total) trans 4294967298 rc 0/0 00000004:00080000:3.0:1787826716.582605:0:8261:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787826716.582608:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787826716.582611:0:8261:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787826716.582625:0:8261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8261:1874672143580544:0@lo:1000: 00000040:00080000:2.0:1787826716.583420:0:8263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787826716.583464:0:8263:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787826716.583469:0:8263:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787826716.881350:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787826717.397925:0:8393:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787826717.397929:0:8393:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787826717.397930:0:8393:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787826717.398069:0:8393:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d547d072000 00000020:01000004:1.0:1787826717.398084:0:8393:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787826717.398094:0:8393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787826717.398106:0:8393:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d5450eecd28) 00000020:00000080:1.0:1787826717.398121:0:8393:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787826717.416936:0:8393:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787826717.416996:0:8393:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787826717.428923:0:8393:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787826717.429180:0:8393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787826717.429188:0:8393:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787826717.429200:0:8393:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953290 00000020:01000004:2.0:1787826717.429206:0:8393:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787826717.429259:0:8393:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787826717.429261:0:8393:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787826717.429268:0:8393:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787826717.429272:0:8393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787826717.429283:0:8393:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d5460444d28) 00000020:00000080:2.0:1787826717.429296:0:8393:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787826717.430507:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787826717.430737:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787826717.430744:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787826717.431660:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787826717.431668:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787826717.431963:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787826717.431970:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787826717.433466:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787826717.433645:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787826717.433651:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787826717.434356:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787826717.434364:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787826717.447357:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787826717.447538:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787826717.447543:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787826717.448297:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787826717.448306:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787826717.449865:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787826717.449874:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787826717.451738:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787826717.451872:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787826717.451877:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787826717.452205:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787826717.452213:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787826717.553071:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787826717.553309:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787826717.553316:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787826717.554063:0:8393:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787826717.554070:0:8393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787826717.554355:0:8393:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787826717.554382:0:8393:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787826717.554390:0:8393:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787826717.567462:0:8393:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787826717.567508:0:8393:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787826717.567512:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787826717.567513:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826717.567515:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826717.567516:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826717.567517:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826717.567519:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826717.567520:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826717.567521:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787826717.567527:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787826717.567528:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826717.567530:0:8393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787826717.567533:0:8393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787826717.567535:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787826717.567536:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826717.567537:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826717.567538:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826717.567539:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826717.567540:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826717.567541:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826717.567542:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787826717.567543:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787826717.567544:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826717.567545:0:8393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787826717.567567:0:8393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787826717.567585:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143580672:0@lo:253: 00000100:00100000:3.0:1787826717.567651:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.567695:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.567782:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143580672 00000100:00100000:0.0:1787826717.567789:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143580672 00000100:00100000:0.0:1787826717.567841:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787826717.567850:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:8393:x1874672143580672:12345-0@lo:253: 20000000:01000000:0.0:1787826717.567878:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787826717.567882:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787826717.567887:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787826717.567890:0:6479:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787826717.568065:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826717.568168:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787826717.568180:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787826717.568196:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787826717.568201:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787826717.568268:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787826717.568293:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787826717.568376:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787826717.568390:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.106@tcp 20000000:01000000:0.0:1787826717.568392:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787826717.568407:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787826717.568413:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787826717.568427:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787826717.568432:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:0.0:1787826717.568443:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787826717.568450:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787826717.568461:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787826717.568473:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787826717.568535:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1787826717.568546:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.106@tcp 20000000:01000000:0.0:1787826717.568548:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787826717.568561:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1787826717.568567:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787826717.568579:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1787826717.568584:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:0.0:1787826717.568596:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1787826717.568601:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787826717.568628:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1787826717.568647:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1787826717.569028:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1787826717.569040:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.106@tcp 20000000:01000000:0.0:1787826717.569048:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:0.0:1787826717.569066:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1787826717.569072:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787826717.569087:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1787826717.569092:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:0.0:1787826717.569106:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1787826717.569113:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787826717.569127:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1787826717.569144:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1787826717.569157:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787826717.569160:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787826717.569163:0:6479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787826717.569203:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787826717.569206:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787826717.570170:0:8412:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787826717.570200:0:8412:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787826717.570265:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787826717.570405:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787826717.570420:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787826717.570428:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787826717.570441:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787826717.570443:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787826717.570834:0:8413:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1787826717.570854:0:8413:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1787826717.570870:0:8413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787826717.570985:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787826717.571006:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787826717.571022:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787826717.571033:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787826717.571036:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787826717.571253:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787826717.571268:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787826717.571277:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787826717.571363:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787826717.571382:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787826717.571394:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1787826717.571403:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787826717.571405:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787826717.571590:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787826717.571670:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787826717.571690:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787826717.571704:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1787826717.571715:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787826717.571731:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571747:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d544167ce00/0xc0fefc09a795316a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571762:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5482177400/0xc0fefc09a79531e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79531da expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571769:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571776:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571784:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795327b expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571791:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571827:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795327b expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571840:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795327b expref: 18 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.571860:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143580800:0@lo:104: 00000100:00100000:0.0:1787826717.571918:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826717.571969:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.571978:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 18 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.571986:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7e580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143580928:0@lo:104: 00000100:00100000:3.0:1787826717.572004:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143580800 00000100:00100000:3.0:1787826717.572011:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143580800 00000100:00100000:0.0:1787826717.572016:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826717.572050:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572054:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143580928 00000100:00100000:3.0:1787826717.572061:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143580928 00010000:00010000:0.0:1787826717.572064:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 18 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572076:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143581056:0@lo:104: 00000100:00100000:1.0:1787826717.572082:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826717.572093:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787826717.572098:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143580800:12345-0@lo:104: 00000100:00100000:2.0:1787826717.572107:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143580928:12345-0@lo:104: 00010000:00010000:1.0:1787826717.572112:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572117:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826717.572120:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572145:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1787826717.572153:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1787826717.572154:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5482177400/0xc0fefc09a79531e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79531da expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.572166:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5482177400/0xc0fefc09a79531e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79531da expref: 18 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572177:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143581184:0@lo:104: 00010000:00010000:2.0:1787826717.572195:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787826717.572205:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143580928:12345-0@lo:104: Request processed in 102us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826717.572206:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787826717.572244:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826717.572249:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.572254:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143580800:12345-0@lo:104: Request processed in 161us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826717.572263:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581056 00000100:00100000:1.0:1787826717.572264:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826717.572269:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581056 00000100:00100000:1.0:1787826717.572289:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581184 00000100:00100000:1.0:1787826717.572294:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581184 00010000:00010000:0.0:1787826717.572295:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d544167ce00/0xc0fefc09a795316a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572295:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787826717.572307:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143581056:12345-0@lo:104: 00010000:00010000:0.0:1787826717.572309:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d544167ce00/0xc0fefc09a795316a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 18 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.572314:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572323:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143581312:0@lo:104: 00000100:00100000:1.0:1787826717.572331:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787826717.572341:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143581184:12345-0@lo:104: 00010000:00010000:1.0:1787826717.572350:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572361:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826717.572366:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787826717.572374:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143581056:12345-0@lo:104: Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826717.572382:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787826717.572385:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787826717.572394:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6479:x1874672143581184:12345-0@lo:104: Request processed in 54us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.572401:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547575e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826717.572402:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787826717.572404:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581312 00010000:00010000:2.0:1787826717.572407:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1787826717.572408:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581312 00010000:00010000:2.0:1787826717.572415:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572425:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143580800:0@lo:104: 00010000:00010000:2.0:1787826717.572430:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177200 already unused, calling callback (ffffffffc13fec20) 00000100:00100000:3.0:1787826717.572432:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:2.0:1787826717.572436:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572442:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7e580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143580928:0@lo:104: 00000100:00100000:3.0:1787826717.572445:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6479:x1874672143581312:12345-0@lo:104: 00010000:00010000:1.0:1787826717.572446:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826717.572453:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572455:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.572458:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572461:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143581056:0@lo:104: 00010000:00010000:1.0:1787826717.572474:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482176200 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826717.572481:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826717.572484:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572490:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143581184:0@lo:104: 00010000:00010000:1.0:1787826717.572496:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826717.572502:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1787826717.572511:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572513:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6479:1874672143581312:0@lo:104: 00010000:00010000:3.0:1787826717.572513:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787826717.572525:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6479:x1874672143581312:12345-0@lo:104: Request processed in 84us (162us total) trans 0 rc 0/0 10000000:01000000:1.0:1787826717.572527:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826717.572531:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572540:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787826717.572542:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826717.572554:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.572555:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572561:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572579:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5482177200/0xc0fefc09a7953243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795324a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572587:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826717.572597:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826717.572599:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572601:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572618:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5482176200/0xc0fefc09a795327b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953282 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572625:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167d000 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826717.572629:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572643:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572646:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826717.572656:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826717.572656:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572660:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143581568:0@lo:103: 10000000:01000000:2.0:1787826717.572674:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826717.572684:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148ee00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826717.572688:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572697:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826717.572701:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572710:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572711:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1787826717.572720:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572728:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581568 10000000:01000000:1.0:1787826717.572728:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826717.572729:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572731:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826717.572735:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581568 00010000:00010000:2.0:1787826717.572744:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a7953227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795322e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572747:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143581440:0@lo:103: 00010000:00010000:0.0:1787826717.572759:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795327b expref: 19 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572760:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572760:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826717.572766:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.572776:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826717.572782:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826717.572784:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148e000 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826717.572789:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572793:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572798:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572802:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148ee00/0xc0fefc09a79531da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79531e1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572806:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581440 00000100:00100000:0.0:1787826717.572812:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581440 10000000:00010000:2.0:1787826717.572813:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826717.572822:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826717.572826:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826717.572827:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143581696:0@lo:103: 00010000:00010000:0.0:1787826717.572828:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 20 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572830:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826717.572834:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826717.572837:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826717.572854:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787826717.572856:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787826717.572864:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787826717.572865:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.572868:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:3619:x1874672143581568:12345-0@lo:103: 00010000:00010000:2.0:1787826717.572874:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826717.572880:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:3619:x1874672143581440:12345-0@lo:103: 00010000:00010000:1.0:1787826717.572881:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826717.572885:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787826717.572892:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795327b expref: 20 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.572894:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826717.572896:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143581824:0@lo:103: 00010000:00010000:0.0:1787826717.572902:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 20 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572904:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148e000/0xc0fefc09a7953163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795316a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.572920:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795327b expref: 20 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.572933:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826717.572937:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826717.572939:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826717.572940:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826717.572953:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826717.572964:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143581952:0@lo:103: 00010000:00010000:0.0:1787826717.572966:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 20 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.572970:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826717.572988:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c81a00/0xc0fefc09a7953282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795327b expref: 20 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.572993:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c80000/0xc0fefc09a795324a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953243 expref: 20 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.573007:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826717.573008:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826717.573010:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826717.573012:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787826717.573029:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1787826717.573060:0:6471:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787826717.573061:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:3619:x1874672143581568:12345-0@lo:103: Request processed in 195us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.573065:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:3619:x1874672143581440:12345-0@lo:103: Request processed in 188us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826717.573072:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581696 00000100:00100000:1.0:1787826717.573077:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826717.573079:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581696 00000100:00100000:0.0:1787826717.573091:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787826717.573101:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581824 00010000:00010000:3.0:1787826717.573102:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 18 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826717.573105:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143581952 00000100:00100000:1.0:1787826717.573107:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581824 00000100:00100000:2.0:1787826717.573111:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143581952 00010000:00010000:1.0:1787826717.573127:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5482177400/0xc0fefc09a79531e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79531da expref: 19 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.573131:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d544167ce00/0xc0fefc09a795316a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 19 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.573154:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826717.573161:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787826717.573165:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:3616:x1874672143581696:12345-0@lo:103: 00000100:00100000:1.0:1787826717.573174:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:3616:x1874672143581824:12345-0@lo:103: 00000100:00100000:2.0:1787826717.573174:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:3.0:1787826717.573185:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826717.573188:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826717.573188:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787826717.573193:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 19 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.573196:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5482177400/0xc0fefc09a79531e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79531da expref: 19 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826717.573202:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5447d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:3619:x1874672143581952:12345-0@lo:103: 00010000:00010000:2.0:1787826717.573246:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826717.573253:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d544167ce00/0xc0fefc09a795316a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 19 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573256:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 19 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.573273:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5482177400/0xc0fefc09a79531e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79531da expref: 19 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.573288:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d544167ce00/0xc0fefc09a795316a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 19 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573303:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5482177a00/0xc0fefc09a795322e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953227 expref: 19 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.573308:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5482177400/0xc0fefc09a79531e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79531da expref: 19 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.573311:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544167ce00/0xc0fefc09a795316a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953163 expref: 19 pid: 6480 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573315:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573334:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.573343:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826717.573343:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826717.573348:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573358:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573365:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573372:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573389:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81800 already unused, calling callback (ffffffffc0e0f420) 00000100:00100000:2.0:1787826717.573391:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5447d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3619:x1874672143581952:12345-0@lo:103: Request processed in 191us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.573396:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3616:x1874672143581824:12345-0@lo:103: Request processed in 223us (457us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826717.573397:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826717.573404:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787826717.573406:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143581824:0@lo:103: 00000100:00100000:1.0:1787826717.573416:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787826717.573420:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573441:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.573453:0:6479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.573454:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826717.573458:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143581952:0@lo:103: 00010000:00010000:0.0:1787826717.573464:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.573476:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c81800/0xc0fefc09a795329e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826717.573489:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143581440:0@lo:103: 00000100:00100000:3.0:1787826717.573491:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3616:x1874672143581696:12345-0@lo:103: Request processed in 328us (627us total) trans 0 rc 0/0 20000000:01000000:0.0:1787826717.573492:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787826717.573502:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826717.573510:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143581568:0@lo:103: 00000100:00100000:0.0:1787826717.573546:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143581696:0@lo:103: 00000100:00100000:0.0:1787826717.574915:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:8393:x1874672143580672:12345-0@lo:253: Request processed in 7063us (7261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.574926:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826717.574954:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143580672:0@lo:253: 10000000:01000000:3.0:1787826717.574967:0:8393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787826717.574970:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826717.574971:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826717.574973:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826717.574975:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787826717.574976:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826717.574977:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826717.574978:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826717.574980:0:8393:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787826717.574982:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826717.574984:0:8393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787826717.575001:0:8393:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d547d072000 from lustre-OST0000 10000000:01000000:3.0:1787826717.575037:0:8393:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787826717.575041:0:8393:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787826717.575049:0:8393:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 10000000:01000000:3.0:1787826717.575053:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787826717.575092:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575103:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575112:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.575129:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582080:0@lo:101: 00000100:00100000:3.0:1787826717.575159:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.575194:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54745840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826717.575283:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582080 00000100:00100000:1.0:1787826717.575289:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582080 00000100:00100000:1.0:1787826717.575326:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826717.575336:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:8393:x1874672143582080:12345-0@lo:101: 00010000:00010000:1.0:1787826717.575348:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826717.575362:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544167d800/0xc0fefc09a79532ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79532a5 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.575383:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167d800/0xc0fefc09a79532ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79532a5 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.575394:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544167d800/0xc0fefc09a79532ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79532a5 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.575416:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544167d800, rc 0) 00000100:00100000:1.0:1787826717.575463:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582080:12345-0@lo:101: Request processed in 129us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.575470:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787826717.575490:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582080:0@lo:101: 00010000:00010000:3.0:1787826717.575504:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575514:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.575592:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582208:0@lo:501: 00000100:00100000:3.0:1787826717.575632:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.575654:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54745840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.575679:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582208 00000100:00100000:0.0:1787826717.575685:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582208 00000100:00100000:0.0:1787826717.575713:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787826717.575720:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582208:12345-0@lo:501: 00000100:00100000:0.0:1787826717.575781:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582208:12345-0@lo:501: Request processed in 60us (148us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826717.575788:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787826717.575794:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582208:0@lo:501: 10000000:01000000:3.0:1787826717.575811:0:8393:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787826717.575824:0:8393:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787826717.575828:0:8393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575834:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575850:0:8393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575862:0:8393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787826717.575878:0:8393:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d547d072000 10000000:01000000:3.0:1787826717.575881:0:8393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787826717.575884:0:8393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787826717.575887:0:8393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787826717.575888:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787826717.575890:0:8393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787826717.575894:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787826717.575896:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575905:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.575921:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.575924:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148fa00 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:3.0:1787826717.575930:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826717.575936:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.575941:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582336:0@lo:101: 00010000:00010000:1.0:1787826717.575964:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.575972:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787826717.575979:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826717.575985:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787826717.575997:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787826717.576003:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.576010:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826717.576011:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582336 00000100:00100000:2.0:1787826717.576015:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582336 00000100:00100000:2.0:1787826717.576036:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787826717.576039:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826717.576044:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582336:12345-0@lo:101: 00000100:00100000:3.0:1787826717.576044:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143582464:0@lo:103: 00010000:00010000:1.0:1787826717.576057:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a79532ac expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.576058:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826717.576069:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79532b3 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.576074:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826717.576077:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826717.576079:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826717.576087:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826717.576097:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.576108:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.576115:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031a00, rc 0) 00000100:00100000:0.0:1787826717.576124:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582464 00000100:00100000:0.0:1787826717.576129:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582464 00000100:00100000:2.0:1787826717.576148:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143582336:12345-0@lo:101: Request processed in 105us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826717.576157:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787826717.576173:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826717.576173:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582336:0@lo:101: 00000100:00100000:0.0:1787826717.576186:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3619:x1874672143582464:12345-0@lo:103: 00010000:00010000:3.0:1787826717.576189:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.576254:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.576255:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826717.576271:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544167d800/0xc0fefc09a79532ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a79532a5 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.576282:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826717.576323:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582592:0@lo:501: 00000100:00100000:0.0:1787826717.576330:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3619:x1874672143582464:12345-0@lo:103: Request processed in 137us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826717.576331:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143582464:0@lo:103: 00000100:00100000:0.0:1787826717.576345:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826717.576357:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.576377:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582592 00000100:00100000:3.0:1787826717.576381:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826717.576383:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582592 00000100:00100000:1.0:1787826717.576421:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787826717.576429:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582592:12345-0@lo:501: 00000100:00100000:1.0:1787826717.576523:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582592:12345-0@lo:501: Request processed in 94us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.576531:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787826717.576556:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582592:0@lo:501: 00000100:00100000:3.0:1787826717.576585:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582720:0@lo:503: 00000100:00100000:3.0:1787826717.576623:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.576643:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826717.576698:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582720 00000100:00100000:2.0:1787826717.576703:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582720 00000100:00100000:2.0:1787826717.576735:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826717.576741:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582720:12345-0@lo:503: 00000100:00100000:2.0:1787826717.576823:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582720:12345-0@lo:503: Request processed in 81us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826717.576845:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787826717.576850:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582720:0@lo:503: 00000040:00080000:3.0:1787826717.577062:0:8393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787826717.577120:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582848:0@lo:502: 00000100:00100000:3.0:1787826717.577159:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.577181:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826717.577204:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582848 00000100:00100000:1.0:1787826717.577209:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582848 00000100:00100000:1.0:1787826717.577294:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787826717.577301:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582848:12345-0@lo:502: 00000100:00100000:1.0:1787826717.577380:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582848:12345-0@lo:502: Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.577388:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787826717.577404:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582848:0@lo:502: 00000040:00080000:3.0:1787826717.577583:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787826717.577599:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787826717.577607:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787826717.577614:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787826717.577625:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787826717.577644:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787826717.577664:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582976:0@lo:502: 00000100:00100000:3.0:1787826717.577697:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.577725:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.577785:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143582976 00000100:00100000:0.0:1787826717.577790:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143582976 00000100:00100000:0.0:1787826717.577824:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787826717.577833:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582976:12345-0@lo:502: 00000100:00100000:0.0:1787826717.577906:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143582976:12345-0@lo:502: Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.577913:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826717.577924:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143582976:0@lo:502: 00000040:00080000:3.0:1787826717.577962:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787826717.577969:0:8393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787826717.578334:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787826717.578341:0:8418:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787826717.578345:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826717.578347:0:8418:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787826717.578352:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787826717.578366:0:8418:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5450e8cd28) 00000020:00000080:0.0:1787826717.578383:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787826717.578388:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787826717.578440:0:8418:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547d072000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787826717.578445:0:8418:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787826717.578459:0:8418:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a79532c8 00010000:00010000:0.0:1787826717.584779:0:8418:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787826717.585025:0:8418:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787826717.586987:0:8418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787826717.587292:0:8418:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787826717.590306:0:8418:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787826717.590463:0:8418:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787826717.597911:0:8418:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787826717.599262:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787826717.599273:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826717.599280:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826717.599283:0:8418:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787826717.599286:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826717.599291:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826717.599292:0:8418:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787826717.599296:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787826717.599298:0:8418:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787826717.599320:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826717.599324:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826717.599326:0:8418:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787826717.599329:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787826717.599475:0:8393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787826717.599506:0:8393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787826717.599527:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.599539:0:8393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826717.599549:0:8393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d547d072000 from 1 10000000:01000000:3.0:1787826717.599552:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826717.599585:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.599594:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.599606:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.599627:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583104:0@lo:101: 00000100:00100000:3.0:1787826717.599712:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.599761:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.599768:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143583104 00000100:00100000:0.0:1787826717.599775:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143583104 00000100:00100000:0.0:1787826717.599820:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787826717.599832:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:8393:x1874672143583104:12345-0@lo:101: 00010000:00010000:0.0:1787826717.599852:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826717.599864:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79532cf expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.599887:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.599898:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.599907:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c81800, rc 0) 00000100:00100000:0.0:1787826717.599955:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583104:12345-0@lo:101: Request processed in 127us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.599965:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787826717.600118:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583104:0@lo:101: 00010000:00010000:3.0:1787826717.600131:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.600140:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826717.600268:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583232:0@lo:501: 00000100:00100000:3.0:1787826717.600299:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.600322:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.600328:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143583232 00000100:00100000:0.0:1787826717.600335:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143583232 00000100:00100000:0.0:1787826717.600375:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787826717.600384:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583232:12345-0@lo:501: 00000100:00100000:0.0:1787826717.600552:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583232:12345-0@lo:501: Request processed in 168us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.600560:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787826717.600631:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583232:0@lo:501: 00000100:00100000:3.0:1787826717.600670:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583360:0@lo:503: 00000100:00100000:3.0:1787826717.600714:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.600744:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.600745:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143583360 00000100:00100000:0.0:1787826717.600757:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143583360 00000100:00100000:0.0:1787826717.600789:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787826717.600797:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583360:12345-0@lo:503: 00000100:00100000:0.0:1787826717.600898:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583360:12345-0@lo:503: Request processed in 102us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.600913:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787826717.600931:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583360:0@lo:503: 00000040:00080000:3.0:1787826717.601110:0:8393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787826717.601174:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583488:0@lo:502: 00000100:00100000:3.0:1787826717.601207:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826717.601264:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143583488 00000100:00100000:0.0:1787826717.601268:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143583488 00000100:00100000:3.0:1787826717.601283:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.601297:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787826717.601302:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583488:12345-0@lo:502: 00000100:00100000:0.0:1787826717.601378:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583488:12345-0@lo:502: Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.601384:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787826717.601476:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583488:0@lo:502: 00000040:00080000:3.0:1787826717.601636:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787826717.601657:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787826717.601673:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583616:0@lo:502: 00000100:00100000:3.0:1787826717.601724:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826717.601752:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.601767:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143583616 00000100:00100000:0.0:1787826717.601773:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143583616 00000100:00100000:0.0:1787826717.601814:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826717.601821:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583616:12345-0@lo:502: 00000100:00100000:0.0:1787826717.601885:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583616:12345-0@lo:502: Request processed in 65us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.601891:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787826717.601902:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583616:0@lo:502: 00000040:00080000:3.0:1787826717.601947:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787826717.601954:0:8393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787826717.602332:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826717.602340:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826717.602343:0:8422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787826717.602349:0:8422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547d072000 00000020:00000080:1.0:1787826717.602351:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787826717.602362:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826717.602365:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826717.602367:0:8422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787826717.602370:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787826717.602469:0:8393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787826717.602492:0:8393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826717.602508:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.602520:0:8393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826717.602570:0:8393:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787826717.602573:0:8393:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d547d072000 10000000:01000000:2.0:1787826717.602576:0:8393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d547d072000 10000000:01000000:2.0:1787826717.602581:0:8393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826717.602586:0:8393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d547d072000 from 1 10000000:01000000:2.0:1787826717.602588:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826717.602609:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.602628:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.602639:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826717.602674:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583744:0@lo:101: 00000100:00100000:2.0:1787826717.602706:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.602729:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.602745:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143583744 00000100:00100000:0.0:1787826717.602750:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143583744 00000100:00100000:0.0:1787826717.602801:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787826717.602808:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:8393:x1874672143583744:12345-0@lo:101: 00010000:00010000:0.0:1787826717.602816:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826717.602825:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79532dd expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.602849:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.602856:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.602862:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80000, rc 0) 00000100:00100000:0.0:1787826717.602891:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143583744:12345-0@lo:101: Request processed in 85us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.602897:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787826717.602928:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583744:0@lo:101: 00010000:00010000:2.0:1787826717.602940:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.602949:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826717.603020:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583872:0@lo:501: 00000100:00100000:2.0:1787826717.603049:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.603076:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.603142:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143583872 00000100:00100000:0.0:1787826717.603146:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143583872 00000100:00100000:0.0:1787826717.603181:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787826717.603189:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143583872:12345-0@lo:501: 00000100:00100000:0.0:1787826717.603421:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143583872:12345-0@lo:501: Request processed in 232us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.603430:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787826717.603507:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143583872:0@lo:501: 00000100:00100000:2.0:1787826717.603534:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143584000:0@lo:503: 00000100:00100000:2.0:1787826717.603565:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.603591:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.603596:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584000 00000100:00100000:0.0:1787826717.603601:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584000 00000100:00100000:0.0:1787826717.603635:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787826717.603642:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143584000:12345-0@lo:503: 00000100:00100000:0.0:1787826717.603731:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143584000:12345-0@lo:503: Request processed in 88us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.603739:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826717.603786:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143584000:0@lo:503: 00000040:00080000:2.0:1787826717.603974:0:8393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826717.604018:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143584128:0@lo:502: 00000100:00100000:2.0:1787826717.604051:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.604074:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.604096:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584128 00000100:00100000:0.0:1787826717.604102:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584128 00000100:00100000:0.0:1787826717.604133:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787826717.604147:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143584128:12345-0@lo:502: 00000100:00100000:0.0:1787826717.604272:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143584128:12345-0@lo:502: Request processed in 125us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.604281:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787826717.604296:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143584128:0@lo:502: 00000040:00080000:2.0:1787826717.604456:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787826717.604480:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787826717.604492:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787826717.604503:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787826717.604514:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787826717.604523:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787826717.604536:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787826717.604550:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787826717.604563:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787826717.604578:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787826717.604592:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787826717.604603:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787826717.604617:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787826717.604630:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787826717.604643:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787826717.604655:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787826717.604668:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787826717.604681:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787826717.604693:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787826717.604714:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787826717.604727:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787826717.604740:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787826717.604752:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787826717.604765:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787826717.604776:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787826717.604799:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787826717.604814:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787826717.604834:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787826717.604848:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787826717.604862:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787826717.604875:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787826717.604890:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787826717.604904:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787826717.604917:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787826717.604929:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787826717.604942:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787826717.604956:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1787826717.604975:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143584256:0@lo:502: 00000100:00100000:2.0:1787826717.605010:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.605037:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826717.605107:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584256 00000100:00100000:0.0:1787826717.605112:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584256 00000100:00100000:0.0:1787826717.605145:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787826717.605151:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143584256:12345-0@lo:502: 00000100:00100000:0.0:1787826717.605337:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143584256:12345-0@lo:502: Request processed in 186us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.605346:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787826717.605352:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143584256:0@lo:502: 00000040:00080000:2.0:1787826717.605396:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787826717.605404:0:8393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787826717.605723:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787826717.605736:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d5460440000) 00000020:00000080:2.0:1787826717.605753:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787826717.605840:0:8423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547d072000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826717.605843:0:8423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547d072000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826717.605845:0:8423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547d072000 3 00010000:00080000:2.0:1787826717.605865:0:8423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d534260e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826717.607409:0:8423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787826717.607550:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826717.607578:0:8423:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826717.607588:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a79532f2 00000100:00080000:2.0:1787826717.607597:0:8423:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826717.607601:0:8423:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d534260e800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826717.607627:0:8423:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5453335e00 x1874672143584384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826717.607651:0:8423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787826717.607683:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143584384:0@lo:38: 00000100:00100000:1.0:1787826717.607748:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.607758:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143584512:0@lo:400: 00000100:00100000:2.0:1787826717.607788:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.607809:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584384 00000100:00100000:2.0:1787826717.607812:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826717.607813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584384 00000100:00100000:0.0:1787826717.607818:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143584768:0@lo:400: 00000100:00100000:2.0:1787826717.607821:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143584640:0@lo:400: 00000100:00100000:1.0:1787826717.607836:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584512 00000100:00100000:1.0:1787826717.607839:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584512 00000100:00100000:0.0:1787826717.607873:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.607873:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787826717.607873:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.607886:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453336940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143584512:12345-0@lo:400: 00000100:00100000:0.0:1787826717.607903:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826717.607912:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143584896:0@lo:400: 00000100:00100000:2.0:1787826717.607918:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584768 00000100:00100000:2.0:1787826717.607923:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584768 00000100:00100000:1.0:1787826717.607933:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453336940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143584512:12345-0@lo:400: Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.607941:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787826717.607946:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826717.607952:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.607957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787826717.607957:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143584768:12345-0@lo:400: 00000100:00100000:1.0:1787826717.607962:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d1383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3615:x1874672143584384:12345-0@lo:38: 00010000:00080000:1.0:1787826717.607991:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 92 last 0 00000100:00100000:0.0:1787826717.607993:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584640 00000100:00100000:0.0:1787826717.607999:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584640 00000100:00100000:2.0:1787826717.608003:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143584768:12345-0@lo:400: Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826717.608010:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000080:1.0:1787826717.608026:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a79532f9 00000100:00100000:2.0:1787826717.608034:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143584896 00000100:00100000:2.0:1787826717.608037:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143584896 00000100:00100000:0.0:1787826717.608041:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000004:00100000:1.0:1787826717.608045:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787826717.608055:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143584640:12345-0@lo:400: 00000100:00100000:2.0:1787826717.608062:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787826717.608070:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143584896:12345-0@lo:400: 00000100:00080000:1.0:1787826717.608075:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d5476636800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826717.608108:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143584640:12345-0@lo:400: Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826717.608118:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787826717.608118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d1383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143584384:12345-0@lo:38: Request processed in 153us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826717.608118:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143584896:12345-0@lo:400: Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826717.608129:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787826717.608130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826717.608172:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143584896:0@lo:400: 00010000:00080000:1.0:1787826717.608183:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d5453335e00 x1874672143584384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826717.608192:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d5341f62580 x1874672143584768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826717.608208:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826717.608247:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787826717.608254:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787826717.608260:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787826717.608264:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534260e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826717.608274:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143584768:0@lo:400: 00000100:00100000:1.0:1787826717.608277:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143584384:0@lo:38: 00000100:00100000:1.0:1787826717.608313:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143584640:0@lo:400: 00010000:00080000:1.0:1787826717.608326:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d5341f63c00 x1874672143584512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826717.608336:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143584512:0@lo:400: 00000020:01000004:2.0:1787826717.608411:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787826717.608429:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d5342780000) 00000020:00000080:2.0:1787826717.608441:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787826717.608532:0:8423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547d072000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826717.608536:0:8423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547d072000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826717.608538:0:8423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547d072000 3 00010000:00080000:2.0:1787826717.608578:0:8423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d547d17e800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826717.613068:0:8423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787826717.613289:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826717.613335:0:8423:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826717.613349:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a7953307 00000100:00080000:2.0:1787826717.613358:0:8423:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826717.613364:0:8423:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d547d17e800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826717.613393:0:8423:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d54533370c0 x1874672143585024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826717.613414:0:8423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1787826717.613619:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787826717.613693:0:8393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787826717.613722:0:8393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826717.613745:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826717.613756:0:8393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826717.613799:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787826717.613801:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826717.613805:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826717.613806:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826717.613808:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826717.613809:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826717.613810:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826717.613811:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787826717.613812:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787826717.613814:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826717.613815:0:8393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826717.613818:0:8393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787826717.613819:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826717.613820:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826717.613821:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826717.613822:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826717.613822:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826717.613823:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826717.613824:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826717.613824:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787826717.613825:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787826717.613826:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826717.613827:0:8393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826717.613844:0:8393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787826717.613858:0:8393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143585152:0@lo:253: 00000100:00100000:0.0:1787826717.613941:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.613966:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585152 00000100:00100000:2.0:1787826717.613973:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585152 00000100:00100000:0.0:1787826717.613981:0:8393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a84840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826717.614020:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787826717.614029:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143585152:12345-0@lo:253: 20000000:01000000:2.0:1787826717.614053:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787826717.614067:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787826717.615310:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143585024:0@lo:38: 00000100:00100000:1.0:1787826717.615355:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.615405:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585024 00000100:00100000:1.0:1787826717.615410:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585024 00000100:00100000:1.0:1787826717.615446:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787826717.615451:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1874672143585024:12345-0@lo:38: 00010000:00080000:1.0:1787826717.615474:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 92 last 0 00000020:00000080:1.0:1787826717.615517:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a795330e 00000004:00100000:1.0:1787826717.615534:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826717.615565:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d5476634800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826717.615614:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143585024:12345-0@lo:38: Request processed in 162us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.615622:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787826717.615929:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d54533370c0 x1874672143585024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826717.615940:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826717.615954:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787826717.615963:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787826717.615968:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787826717.615971:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d547d17e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826717.615977:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143585024:0@lo:38: 20000000:01000000:3.0:1787826717.616559:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787826717.616572:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787826717.616592:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826717.616597:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826717.616615:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.616638:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5482176e00/0xc0fefc09a7953212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795320b expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.616646:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.616654:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.616694:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.616708:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 16 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826717.616720:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143585280:0@lo:104: 00000100:00100000:3.0:1787826717.616729:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:8393:x1874672143585152:12345-0@lo:253: Request processed in 2700us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826717.616744:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787826717.616766:0:8393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:8393:1874672143585152:0@lo:253: 00000100:00100000:1.0:1787826717.616773:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787826717.616779:0:8393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787826717.616782:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826717.616784:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826717.616786:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826717.616787:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826717.616789:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826717.616790:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826717.616791:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826717.616793:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787826717.616794:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787826717.616795:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826717.616796:0:8393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787826717.616814:0:8393:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787826717.616818:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5482176e00/0xc0fefc09a7953212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795320b expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.616828:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5482176e00/0xc0fefc09a7953212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795320b expref: 15 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826717.616841:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143585408:0@lo:104: 00000100:00100000:1.0:1787826717.616858:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826717.616879:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787826717.616891:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826717.616910:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585280 00000100:00100000:1.0:1787826717.616914:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585280 00000100:00100000:3.0:1787826717.616927:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585408 00000100:00100000:3.0:1787826717.616931:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585408 00000100:00100000:1.0:1787826717.616950:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787826717.616958:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826717.616967:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143585408:12345-0@lo:104: 00000100:00100000:1.0:1787826717.616972:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54756c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143585280:12345-0@lo:104: 00010000:00010000:3.0:1787826717.616980:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.616986:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.617041:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787826717.617048:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787826717.617048:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143585408:12345-0@lo:104: Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.617056:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54756c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143585280:12345-0@lo:104: Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826717.617061:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826717.617068:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787826717.617084:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826717.617090:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.617098:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167dc00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:3.0:1787826717.617103:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.617111:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826717.617118:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617120:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826717.617127:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826717.617137:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826717.617140:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148f000 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826717.617145:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617155:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826717.617163:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.617165:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826717.617181:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826717.617198:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826717.617202:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617207:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826717.617252:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.617260:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544167dc00/0xc0fefc09a795320b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953212 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617266:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617274:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148f000/0xc0fefc09a7953235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795323c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826717.617274:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826717.617279:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826717.617283:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826717.617289:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826717.617292:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826717.617294:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826717.617304:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143585664:0@lo:103: 00000100:00100000:1.0:1787826717.617340:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.617366:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585664 00000100:00100000:2.0:1787826717.617372:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585664 00000100:00100000:1.0:1787826717.617379:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826717.617387:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143585536:0@lo:103: 00010000:00010000:2.0:1787826717.617395:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 16 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826717.617410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826717.617427:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585536 00000100:00100000:2.0:1787826717.617431:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585536 00010000:00010000:2.0:1787826717.617444:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5482176e00/0xc0fefc09a7953212 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795320b expref: 17 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826717.617454:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143585280:0@lo:104: 00000100:00100000:2.0:1787826717.617465:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826717.617471:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143585408:0@lo:104: 00000100:00100000:2.0:1787826717.617473:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:3617:x1874672143585664:12345-0@lo:103: 00010000:00010000:2.0:1787826717.617486:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826717.617493:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.617495:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 17 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.617514:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 17 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.617525:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c81600/0xc0fefc09a795323c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953235 expref: 17 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.617537:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826717.617545:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826717.617556:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3617:x1874672143585536:12345-0@lo:103: 00010000:00010000:1.0:1787826717.617565:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826717.617569:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3617:x1874672143585664:12345-0@lo:103: Request processed in 97us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826717.617579:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5482176e00/0xc0fefc09a7953212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795320b expref: 16 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826717.617580:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787826717.617593:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5482176e00/0xc0fefc09a7953212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795320b expref: 15 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617602:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5482176e00/0xc0fefc09a7953212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795320b expref: 15 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617610:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617616:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826717.617623:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001026772s 00010000:00010000:1.0:1787826717.617626:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617633:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617640:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617646:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617651:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167d800 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826717.617655:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617663:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617686:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826717.617693:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826717.617699:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.617706:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826717.617711:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953315 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826717.617717:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3617:x1874672143585536:12345-0@lo:103: Request processed in 163us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826717.617725:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826717.617751:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143585536:0@lo:103: 00000100:00100000:1.0:1787826717.617759:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143585664:0@lo:103: 00080000:10000000:0.0:1787826717.619697:0:8393:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787826717.619800:0:8393:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787826717.619969:0:8393:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787826717.620070:0:8393:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787826717.620200:0:8393:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787826717.620394:0:8393:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787826717.621100:0:8393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787826717.625366:0:8393:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787826717.625375:0:8393:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787826717.625412:0:8393:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787826717.625448:0:8393:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787826717.625468:0:8393:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787826717.625481:0:8393:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787826717.626419:0:8393:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826717.626590:0:8393:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787826717.905368:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787826717.985595:0:8479:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826717.985765:0:8479:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787826718.929339:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826719.771050:0:8768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787826719.953337:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787826720.138117:0:8820:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826720.138300:0:8820:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787826720.849418:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826720.849455:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143585792:0@lo:41: 00000100:00100000:1.0:1787826720.849537:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826720.849586:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585792 00000100:00100000:0.0:1787826720.849595:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585792 00000100:00100000:0.0:1787826720.849657:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787826720.849668:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143585792:12345-0@lo:41: 00000004:00000024:0.0:1787826720.849706:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1787826720.849765:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143585792:12345-0@lo:41: Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826720.849773:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787826720.850107:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143585792:0@lo:41: 00010000:00010000:2.0:1787826720.977591:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787826721.848605:0:8922:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826721.848776:0:8922:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826721.873390:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143585920:0@lo:41: 00000100:00100000:0.0:1787826721.873470:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826721.873573:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143585920 00000100:00100000:1.0:1787826721.873581:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143585920 00000100:00100000:1.0:1787826721.873638:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826721.873649:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143585920:12345-0@lo:41: 00000004:00000024:1.0:1787826721.873695:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787826721.873758:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143585920:12345-0@lo:41: Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826721.873768:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787826721.873795:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143585920:0@lo:41: 00010000:00010000:3.0:1787826722.001358:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787826722.199712:0:8970:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826722.199721:0:8970:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1787826722.897408:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143586048:0@lo:400: 00000100:00100000:0.0:1787826722.897428:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143586432:0@lo:400: 00000100:00100000:3.0:1787826722.897457:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143586304:0@lo:400: 00000100:00100000:2.0:1787826722.897473:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143586176:0@lo:400: 00000100:00100000:0.0:1787826722.897491:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826722.897491:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826722.897504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826722.897555:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143586816:0@lo:400: 00000100:00100000:2.0:1787826722.897567:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826722.897572:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143586560:0@lo:400: 00000100:00100000:0.0:1787826722.897587:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586048 00000100:00100000:0.0:1787826722.897596:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586048 00000100:00100000:3.0:1787826722.897615:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586432 00000100:00100000:3.0:1787826722.897619:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586432 00000100:00100000:2.0:1787826722.897654:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143586688:0@lo:400: 00000100:00100000:0.0:1787826722.897656:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826722.897668:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826722.897674:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586176 00000100:00100000:3.0:1787826722.897681:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586176 00000100:00100000:0.0:1787826722.897683:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3616:x1874672143586048:12345-0@lo:400: 00000100:00100000:3.0:1787826722.897725:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826722.897728:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826722.897736:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826722.897742:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143586432:12345-0@lo:400: 00000100:00100000:1.0:1787826722.897755:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143586176:12345-0@lo:400: 00000100:00100000:0.0:1787826722.897764:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3616:x1874672143586048:12345-0@lo:400: Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826722.897799:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826722.897807:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143586432:12345-0@lo:400: Request processed in 70us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826722.897808:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826722.897822:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143586176:12345-0@lo:400: Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826722.897822:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787826722.897834:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826722.897852:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586688 00000100:00100000:3.0:1787826722.897864:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586688 00000100:00100000:1.0:1787826722.897865:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586816 00000100:00100000:1.0:1787826722.897871:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586816 00000100:00100000:2.0:1787826722.897888:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586304 00000100:00100000:0.0:1787826722.897889:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586560 00000100:00100000:0.0:1787826722.897898:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586560 00000100:00100000:2.0:1787826722.897898:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586304 00000100:00100000:1.0:1787826722.897919:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787826722.897933:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826722.897935:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143586688:12345-0@lo:400: 00000100:00100000:3.0:1787826722.897951:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453337c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143586816:12345-0@lo:400: 00000100:00100000:0.0:1787826722.897957:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826722.897966:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787826722.897974:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143586560:12345-0@lo:400: 00000100:00100000:1.0:1787826722.897991:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143586688:12345-0@lo:400: Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826722.897993:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143586304:12345-0@lo:400: 00000100:00100000:1.0:1787826722.898010:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787826722.898017:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453337c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143586816:12345-0@lo:400: Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826722.898027:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826722.898032:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143586560:12345-0@lo:400: Request processed in 65us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826722.898041:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787826722.898081:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826722.898086:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143586304:12345-0@lo:400: Request processed in 99us (578us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826722.898087:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787826722.898101:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f61a40 x1874672143586432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826722.898103:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787826722.898110:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f603c0 x1874672143586176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826722.898140:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143586560:0@lo:400: 00000100:00100000:1.0:1787826722.898140:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143586432:0@lo:400: 00000100:00100000:3.0:1787826722.898141:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143586176:0@lo:400: 00000100:00100000:2.0:1787826722.898169:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143586304:0@lo:400: 00000100:00100000:0.0:1787826722.898173:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143586048:0@lo:400: 00010000:00080000:3.0:1787826722.898182:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f60b40 x1874672143586688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826722.898210:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143586688:0@lo:400: 00010000:00080000:2.0:1787826722.898282:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f621c0 x1874672143586816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826722.898296:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143586816:0@lo:400: 00010000:00010000:1.0:1787826723.025464:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826724.049330:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826725.074295:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826725.788569:0:9467:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826725.788574:0:9467:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787826725.788576:0:9467:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787826725.788910:0:9467:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d534260c000 00000020:01000004:2.0:1787826725.788929:0:9467:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787826725.788942:0:9467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826725.788954:0:9467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d5342783370) 00000020:00000080:2.0:1787826725.788969:0:9467:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787826725.809296:0:9467:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787826725.809346:0:9467:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787826725.821199:0:9467:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787826725.821455:0:9467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787826725.821468:0:9467:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787826725.821480:0:9467:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc0fefc09a7953323 00000020:01000004:0.0:1787826725.821487:0:9467:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787826725.821509:0:9467:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787826725.821513:0:9467:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787826725.821519:0:9467:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787826725.821545:0:9467:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787826725.821549:0:9467:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787826725.833063:0:9467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787826725.833101:0:9467:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.106@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787826725.833105:0:9467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787826725.833107:0:9467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787826725.833112:0:9467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826725.833113:0:9467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826725.833114:0:9467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826725.833116:0:9467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826725.833117:0:9467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826725.833118:0:9467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787826725.833119:0:9467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787826725.833120:0:9467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826725.833122:0:9467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826725.833125:0:9467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787826725.833128:0:9467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826725.833129:0:9467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787826725.833130:0:9467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826725.833130:0:9467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826725.833131:0:9467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826725.833132:0:9467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826725.833133:0:9467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826725.833134:0:9467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787826725.833135:0:9467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787826725.833136:0:9467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826725.833137:0:9467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826725.833162:0:9467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787826725.833193:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143586944:0@lo:253: 00000100:00100000:0.0:1787826725.833277:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.833323:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.833325:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143586944 00000100:00100000:3.0:1787826725.833334:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143586944 00000100:00100000:3.0:1787826725.833386:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787826725.833396:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:9467:x1874672143586944:12345-0@lo:253: 20000000:01000000:3.0:1787826725.833425:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787826725.833429:0:6478:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787826725.833435:0:6478:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787826725.833447:0:6478:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787826725.833656:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826725.833800:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1787826725.833815:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787826725.833840:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1787826725.833846:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787826725.833859:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1787826725.833873:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1787826725.833957:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1787826725.833969:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.106@tcp 20000000:01000000:3.0:1787826725.833972:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787826725.833984:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1787826725.833989:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787826725.834003:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1787826725.834008:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:3.0:1787826725.834022:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1787826725.834028:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787826725.834042:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1787826725.834058:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1787826725.834138:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1787826725.834150:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.106@tcp 20000000:01000000:3.0:1787826725.834161:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787826725.834193:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1787826725.834200:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787826725.834246:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1787826725.834253:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:3.0:1787826725.834270:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1787826725.834279:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787826725.834294:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1787826725.834316:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1787826725.834683:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1787826725.834697:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.106@tcp 20000000:01000000:3.0:1787826725.834698:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.106@tcp (null) (null) (null) 00000040:00080000:3.0:1787826725.834712:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1787826725.834717:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787826725.834729:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1787826725.834734:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.106@tcp (null) (null) 00000040:00080000:3.0:1787826725.834746:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1787826725.834761:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787826725.834778:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1787826725.834794:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1787826725.834806:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787826725.834809:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787826725.834812:0:6478:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787826725.834852:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787826725.834855:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787826725.835284:0:9473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1787826725.835302:0:9473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1787826725.835318:0:9473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1787826725.835432:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1787826725.835453:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1787826725.835468:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1787826725.835478:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787826725.835480:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787826725.835786:0:9474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787826725.835803:0:9474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787826725.835831:0:9474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1787826725.835930:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1787826725.835952:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1787826725.835966:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1787826725.835976:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787826725.835978:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787826725.836294:0:9475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1787826725.836309:0:9475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1787826725.836320:0:9475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1787826725.836417:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1787826725.836435:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1787826725.836447:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1787826725.836464:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787826725.836466:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787826725.836709:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1787826725.836797:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1787826725.836815:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1787826725.836828:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1787826725.836836:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787826725.836838:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787826725.837040:0:9477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1787826725.837064:0:9477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1787826725.837072:0:9477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787826725.837145:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787826725.837163:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1787826725.837187:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:2.0:1787826725.837201:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787826725.837243:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837256:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837263:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837271:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837305:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837320:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 14 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.837334:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6478:1874672143587072:0@lo:104: 00000100:00100000:2.0:1787826725.837387:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.837434:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587072 00010000:00010000:2.0:1787826725.837436:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.837440:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587072 00010000:00010000:2.0:1787826725.837459:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 14 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.837483:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787826725.837484:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6478:1874672143587200:0@lo:104: 00000100:00100000:1.0:1787826725.837496:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6478:x1874672143587072:12345-0@lo:104: 00010000:00010000:1.0:1787826725.837509:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.837514:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.837538:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.837553:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587200 00000100:00100000:3.0:1787826725.837557:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587200 00010000:00010000:1.0:1787826725.837579:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826725.837585:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787826725.837591:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6478:x1874672143587072:12345-0@lo:104: Request processed in 94us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.837591:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6478:1874672143587072:0@lo:104: 00000100:00100000:3.0:1787826725.837598:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6478:x1874672143587200:12345-0@lo:104: 00000100:00100000:1.0:1787826725.837610:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787826725.837611:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837636:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826725.837643:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837652:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030400 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826725.837656:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837666:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826725.837674:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.837676:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826725.837684:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6478:x1874672143587200:12345-0@lo:104: Request processed in 90us (170us total) trans 0 rc 0/0 10000000:01000000:1.0:1787826725.837687:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787826725.837692:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787826725.837707:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6478:1874672143587200:0@lo:104: 00010000:00010000:1.0:1787826725.837718:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.837721:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826725.837727:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826725.837730:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837732:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837740:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.837749:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148fe00 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:1.0:1787826725.837756:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79532dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532e4 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826725.837756:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.837764:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826725.837776:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143587328:0@lo:103: 00010000:00010000:3.0:1787826725.837783:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837786:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826725.837790:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826725.837794:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787826725.837794:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826725.837803:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787826725.837810:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826725.837822:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826725.837824:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787826725.837829:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d547d072000 from 39 00010000:00010000:3.0:1787826725.837831:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1787826725.837836:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1787826725.837845:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587328 00000100:00100000:2.0:1787826725.837850:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587328 00010000:00010000:3.0:1787826725.837851:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837857:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837865:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837870:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.837874:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148fe00/0xc0fefc09a79532b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532ba expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.837881:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.837910:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787826725.837917:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826725.837918:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143587584:0@lo:101: 00010000:00010000:3.0:1787826725.837921:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826725.837922:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3618:x1874672143587328:12345-0@lo:103: 00010000:00010000:3.0:1787826725.837926:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826725.837937:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826725.837940:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143587456:0@lo:103: 00010000:00010000:2.0:1787826725.837945:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.837956:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826725.837960:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837975:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c80000/0xc0fefc09a79532e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79532dd expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.837997:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826725.838030:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587584 00000100:00100000:0.0:1787826725.838034:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587584 00000100:00100000:0.0:1787826725.838054:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826725.838058:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143587584:12345-0@lo:101: 00010000:00010000:0.0:1787826725.838067:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826725.838074:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953331 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838085:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838107:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838115:0:6479:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838122:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838127:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c81400, rc 0) 00000100:00100000:1.0:1787826725.838456:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.838456:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.838466:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143587584:12345-0@lo:101: Request processed in 405us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.838473:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143587584:0@lo:101: 00000100:00100000:0.0:1787826725.838478:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787826725.838479:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3618:x1874672143587328:12345-0@lo:103: Request processed in 556us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.838489:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787826725.838496:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.838505:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826725.838507:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587456 00000100:00100000:3.0:1787826725.838514:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587456 00010000:00010000:3.0:1787826725.838534:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.838541:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143587328:0@lo:103: 00000100:00100000:3.0:1787826725.838563:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787826725.838572:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3616:x1874672143587456:12345-0@lo:103: 00010000:00010000:3.0:1787826725.838580:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826725.838585:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838594:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838606:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031a00/0xc0fefc09a79532ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79532b3 expref: 15 pid: 6480 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838616:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838623:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838635:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838648:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838654:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838660:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838666:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826725.838669:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838675:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838688:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838695:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.838703:0:6478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.838713:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838716:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826725.838727:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787826725.838733:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6470:1874672143587712:0@lo:105: 00000100:00100000:3.0:1787826725.838759:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.838783:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53425dfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.838814:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587712 00000100:00100000:0.0:1787826725.838819:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587712 00000100:00100000:0.0:1787826725.838862:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787826725.838871:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6470:x1874672143587712:12345-0@lo:105: 00010000:00010000:0.0:1787826725.838880:0:6468:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838888:0:6468:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838897:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838906:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838934:0:6468:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.838955:0:6468:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8d544167c800) 00010000:00010000:3.0:1787826725.838963:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.838983:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.839000:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6470:x1874672143587712:12345-0@lo:105: Request processed in 129us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.839009:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787826725.839023:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6470:1874672143587712:0@lo:105: 00010000:00010000:2.0:1787826725.839041:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826725.839051:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143587840:0@lo:501: 00010000:00010000:2.0:1787826725.839052:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031e00/0xc0fefc09a795332a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.839067:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826725.839085:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.839114:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53425df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.839124:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:3616:x1874672143587456:12345-0@lo:103: Request processed in 551us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.839132:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826725.839136:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587840 00000100:00100000:0.0:1787826725.839142:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587840 00000100:00100000:1.0:1787826725.839152:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143587456:0@lo:103: 00000100:00100000:0.0:1787826725.839194:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787826725.839203:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143587840:12345-0@lo:501: 00000100:00100000:0.0:1787826725.839324:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143587840:12345-0@lo:501: Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.839331:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787826725.839568:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143587840:0@lo:501: 00000100:00100000:1.0:1787826725.839605:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143587968:0@lo:503: 00000100:00100000:1.0:1787826725.839658:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.839684:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.839697:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143587968 00000100:00100000:2.0:1787826725.839703:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143587968 00000100:00100000:2.0:1787826725.839730:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787826725.839735:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143587968:12345-0@lo:503: 00000100:00100000:2.0:1787826725.839814:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:6482:x1874672143587968:12345-0@lo:503: Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.839825:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787826725.839828:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143587968:0@lo:503: 00000100:00100000:2.0:1787826725.840049:0:9478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9478:1874672143588096:0@lo:502: 00000100:00100000:2.0:1787826725.840082:0:9478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.840098:0:9478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826725.840110:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588096 00000100:00100000:1.0:1787826725.840115:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588096 00000100:00100000:1.0:1787826725.840143:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787826725.840151:0:6480:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1787826725.840159:0:6480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1787826725.840161:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:9478:x1874672143588096:12345-0@lo:502: 00000100:00100000:1.0:1787826725.840304:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:9478:x1874672143588096:12345-0@lo:502: Request processed in 151us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.840315:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787826725.840315:0:9478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9478:1874672143588096:0@lo:502: 00000100:00100000:0.0:1787826725.840352:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:9467:x1874672143586944:12345-0@lo:253: Request processed in 6955us (7072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.840361:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787826725.840385:0:9478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9478:1874672143588224:0@lo:502: 00000100:00100000:1.0:1787826725.840391:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143586944:0@lo:253: 10000000:01000000:1.0:1787826725.840403:0:9467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787826725.840406:0:9467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826725.840408:0:9467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787826725.840410:0:9467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826725.840412:0:9467:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787826725.840414:0:9467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826725.840415:0:9467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826725.840417:0:9467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826725.840419:0:9467:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787826725.840421:0:9467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1787826725.840425:0:9478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1787826725.840426:0:9467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787826725.840444:0:9467:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d534260c000 from lustre-OST0001 10000000:01000000:1.0:1787826725.840464:0:9467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 00000100:00100000:2.0:1787826725.840465:0:9478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e540 going to sleep for 11 seconds 10000000:01000000:1.0:1787826725.840468:0:9467:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787826725.840477:0:9467:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 10000000:01000000:1.0:1787826725.840480:0:9467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1787826725.840493:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588224 00000100:00100000:3.0:1787826725.840498:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588224 00010000:00010000:1.0:1787826725.840500:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.840522:0:9467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826725.840530:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00010000:00010000:1.0:1787826725.840531:0:9467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826725.840541:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:9478:x1874672143588224:12345-0@lo:502: 00000100:00100000:1.0:1787826725.840548:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143588352:0@lo:101: 00000100:00100000:1.0:1787826725.840576:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.840599:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.840653:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588352 00000100:00100000:2.0:1787826725.840657:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588352 00000100:00100000:3.0:1787826725.840672:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:9478:x1874672143588224:12345-0@lo:502: Request processed in 134us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.840678:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826725.840694:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826725.840702:0:9478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9478:1874672143588224:0@lo:502: 00000100:00100000:2.0:1787826725.840708:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+13:9467:x1874672143588352:12345-0@lo:101: 00010000:00010000:2.0:1787826725.840715:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.840722:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440030200/0xc0fefc09a7953346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795333f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826725.840730:0:9478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00010000:00010000:2.0:1787826725.840737:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440030200/0xc0fefc09a7953346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795333f expref: 14 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.840745:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440030200/0xc0fefc09a7953346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795333f expref: 14 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.840752:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030200, rc 0) 00000020:01000000:1.0:1787826725.840788:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 00000100:00100000:2.0:1787826725.840793:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+14:9467:x1874672143588352:12345-0@lo:101: Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.840811:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787826725.840816:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143588352:0@lo:101: 10000000:01000000:1.0:1787826725.840819:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826725.840828:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.840838:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826725.840847:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 00010000:00010000:3.0:1787826725.840847:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826725.840851:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787826725.840856:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826725.840859:0:9467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.840875:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.840883:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.840889:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.840912:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143588480:0@lo:101: 00000100:00100000:3.0:1787826725.840930:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143588608:0@lo:501: 00000100:00100000:1.0:1787826725.840943:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.840967:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.840977:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.840996:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53425dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826725.840999:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588480 00000100:00100000:1.0:1787826725.841004:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588480 00000100:00100000:1.0:1787826725.841028:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588608 00000100:00100000:1.0:1787826725.841031:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588608 00000100:00100000:3.0:1787826725.841040:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787826725.841050:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143588480:12345-0@lo:101: 00010000:00010000:3.0:1787826725.841057:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787826725.841066:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00010000:00010000:3.0:1787826725.841069:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795334d expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.841078:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9467:x1874672143588608:12345-0@lo:501: 00010000:00010000:3.0:1787826725.841086:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795334d expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.841095:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795334d expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.841102:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148e000, rc 0) 00000100:00100000:1.0:1787826725.841151:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9467:x1874672143588608:12345-0@lo:501: Request processed in 77us (175us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826725.841159:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787826725.841166:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143588608:0@lo:501: 10000000:01000000:2.0:1787826725.841193:0:9467:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1787826725.841201:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143588480:12345-0@lo:101: Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.841209:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 10000000:01000000:2.0:1787826725.841245:0:9467:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787826725.841251:0:9467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.841260:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.841267:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.841307:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143588480:0@lo:101: 00010000:00010000:2.0:1787826725.841311:0:9467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826725.841319:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.841329:0:9467:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d534260c000 00010000:00010000:0.0:1787826725.841333:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.841335:0:9467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787826725.841344:0:9467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:3.0:1787826725.841344:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787826725.841351:0:9467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787826725.841352:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x400000000 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.841358:0:9467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 00010000:00010000:3.0:1787826725.841362:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167cc00 already unused, calling callback (ffffffffc13fec20) 10000000:01000000:2.0:1787826725.841364:0:9467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 10000000:00010000:3.0:1787826725.841369:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.841378:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.841384:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.841394:0:9467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826725.841395:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x9400000000 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.841399:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143588864:0@lo:501: 00010000:00010000:2.0:1787826725.841410:0:9467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826725.841410:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787826725.841428:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826725.841429:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.841449:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143588736:0@lo:101: 00010000:00010000:3.0:1787826725.841452:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826725.841457:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588864 00000100:00100000:0.0:1787826725.841459:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826725.841463:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588864 00010000:00010000:3.0:1787826725.841472:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.841481:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a795333f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0fefc09a7953346 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.841492:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826725.841500:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826725.841503:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826725.841505:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588736 00010000:00010000:3.0:1787826725.841506:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826725.841512:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588736 00000100:00100000:0.0:1787826725.841514:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826725.841519:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143588992:0@lo:103: 00000100:00100000:0.0:1787826725.841524:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143588864:12345-0@lo:501: 00000100:00100000:2.0:1787826725.841526:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826725.841542:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787826725.841553:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9467:x1874672143588736:12345-0@lo:101: 00000100:00100000:3.0:1787826725.841556:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826725.841560:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826725.841570:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795335b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.841583:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795335b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.841587:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143588992 00000100:00100000:2.0:1787826725.841593:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143588992 00010000:00010000:1.0:1787826725.841595:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795335b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.841604:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143588864:12345-0@lo:501: Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.841616:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00010000:1.0:1787826725.841623:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544167ce00, rc 0) 00000100:00100000:3.0:1787826725.841636:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826725.841644:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143588864:0@lo:501: 00000100:00100000:3.0:1787826725.841651:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:3617:x1874672143588992:12345-0@lo:103: 00010000:00010000:3.0:1787826725.841659:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826725.841673:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440030200/0xc0fefc09a7953346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795333f expref: 17 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.841680:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:9467:x1874672143588736:12345-0@lo:101: Request processed in 129us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.841681:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143589120:0@lo:503: 00010000:00010000:3.0:1787826725.841687:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826725.841689:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143588736:0@lo:101: 00000100:00100000:1.0:1787826725.841698:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:2.0:1787826725.841705:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.841715:0:9467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.841724:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.841737:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3617:x1874672143588992:12345-0@lo:103: Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.841743:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.841744:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826725.841753:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143589120 00000100:00100000:1.0:1787826725.841759:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143589120 00000100:00100000:3.0:1787826725.841774:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143588992:0@lo:103: 00000100:00100000:2.0:1787826725.841786:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589248:0@lo:501: 00000100:00100000:1.0:1787826725.841795:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787826725.841805:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143589120:12345-0@lo:503: 00000100:00100000:2.0:1787826725.841818:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.841839:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.841840:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143589248 00000100:00100000:0.0:1787826725.841846:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143589248 00000100:00100000:0.0:1787826725.841878:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787826725.841885:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9467:x1874672143589248:12345-0@lo:501: 00000100:00100000:1.0:1787826725.841894:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143589120:12345-0@lo:503: Request processed in 89us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.841903:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787826725.841926:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143589120:0@lo:503: 00000100:00100000:0.0:1787826725.841954:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9467:x1874672143589248:12345-0@lo:501: Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.841961:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787826725.841973:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589248:0@lo:501: 00000100:00100000:1.0:1787826725.842002:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589376:0@lo:503: 00000100:00100000:1.0:1787826725.842039:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.842053:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.842062:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143589376 00000100:00100000:0.0:1787826725.842066:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143589376 00000100:00100000:0.0:1787826725.842091:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787826725.842098:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9467:x1874672143589376:12345-0@lo:503: 00000100:00100000:0.0:1787826725.842190:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9467:x1874672143589376:12345-0@lo:503: Request processed in 92us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.842197:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9480:1874672143589504:0@lo:502: 00000100:00100000:1.0:1787826725.842207:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589376:0@lo:503: 00000100:00100000:0.0:1787826725.842210:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787826725.842274:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.842299:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579ef00 going to sleep for 11 seconds 00000040:00080000:1.0:1787826725.842465:0:9467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826725.842470:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143589504 00000100:00100000:0.0:1787826725.842476:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143589504 00000100:00100000:0.0:1787826725.842505:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787826725.842512:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9480:x1874672143589504:12345-0@lo:502: 00000100:00100000:1.0:1787826725.842526:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589632:0@lo:502: 00000100:00100000:1.0:1787826725.842562:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.842584:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143589632 00000100:00100000:1.0:1787826725.842585:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.842590:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143589632 00000100:00100000:0.0:1787826725.842602:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9480:x1874672143589504:12345-0@lo:502: Request processed in 89us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.842610:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787826725.842628:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787826725.842640:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9480:1874672143589504:0@lo:502: 00000100:00100000:2.0:1787826725.842641:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9467:x1874672143589632:12345-0@lo:502: 00000020:01000000:3.0:1787826725.842669:0:9480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826725.842684:0:9480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.842686:0:9480:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787826725.842694:0:9480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787826725.842696:0:9480:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787826725.842723:0:9480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9480:1874672143589760:0@lo:502: 00000100:00100000:2.0:1787826725.842732:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9467:x1874672143589632:12345-0@lo:502: Request processed in 95us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.842740:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787826725.842747:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589632:0@lo:502: 00000100:00100000:3.0:1787826725.842767:0:9480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.842786:0:9480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53425df540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.842796:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143589760 00000100:00100000:2.0:1787826725.842808:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143589760 00000100:00100000:2.0:1787826725.842841:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787826725.842848:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9480:x1874672143589760:12345-0@lo:502: 00000100:00100000:2.0:1787826725.842923:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9480:x1874672143589760:12345-0@lo:502: Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.842930:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000040:00080000:1.0:1787826725.842953:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787826725.842981:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000100:00100000:3.0:1787826725.842993:0:9480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9480:1874672143589760:0@lo:502: 00000040:00080000:1.0:1787826725.843000:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000020:01000000:3.0:1787826725.843016:0:9480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826725.843023:0:9480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.843025:0:9480:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787826725.843029:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787826725.843030:0:9480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1787826725.843050:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787826725.843068:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787826725.843090:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589888:0@lo:502: 00000020:01000000:0.0:1787826725.843101:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787826725.843129:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000100:00100000:1.0:1787826725.843134:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826725.843138:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.843148:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826725.843157:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 00000100:00100000:1.0:1787826725.843157:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.843161:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143589888 10000000:01000000:0.0:1787826725.843162:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d54789ce800 from 30 10000000:01000000:0.0:1787826725.843166:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1787826725.843167:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143589888 00010000:00010000:0.0:1787826725.843202:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.843211:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.843212:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787826725.843247:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9467:x1874672143589888:12345-0@lo:502: 00010000:00010000:0.0:1787826725.843257:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.843274:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590016:0@lo:101: 00000100:00100000:2.0:1787826725.843326:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:9467:x1874672143589888:12345-0@lo:502: Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.843328:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.843338:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787826725.843343:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143589888:0@lo:502: 00000100:00100000:0.0:1787826725.843371:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.843376:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590016 00000100:00100000:2.0:1787826725.843381:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590016 00000040:00080000:1.0:1787826725.843395:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787826725.843404:0:9467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:2.0:1787826725.843417:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787826725.843425:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143590016:12345-0@lo:101: 00010000:00010000:2.0:1787826725.843432:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.843441:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953369 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.843459:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.843469:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.843476:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031400, rc 0) 00000100:00100000:2.0:1787826725.843510:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143590016:12345-0@lo:101: Request processed in 86us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.843522:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590016:0@lo:101: 00000100:00100000:2.0:1787826725.843526:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00010000:0.0:1787826725.843535:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.843549:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.843599:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590144:0@lo:501: 00000100:00100000:0.0:1787826725.843624:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787826725.843636:0:9481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826725.843642:0:9481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000100:00100000:2.0:1787826725.843643:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590144 00000100:00100000:0.0:1787826725.843645:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272840 going to sleep for 11 seconds 00000020:00000080:1.0:1787826725.843648:0:9481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1787826725.843650:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590144 00000020:00000080:1.0:1787826725.843652:0:9481:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787826725.843660:0:9481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826725.843673:0:9481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d5450ee8000) 00000100:00100000:2.0:1787826725.843679:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787826725.843689:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143590144:12345-0@lo:501: 00000020:00000080:1.0:1787826725.843695:0:9481:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787826725.843703:0:9481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1787826725.843768:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143590144:12345-0@lo:501: Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.843775:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000020:01000004:1.0:1787826725.843781:0:9481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d534260c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787826725.843791:0:9481:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826725.843799:0:9481:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc0fefc09a795337e 00000100:00100000:0.0:1787826725.843813:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590144:0@lo:501: 00000100:00100000:0.0:1787826725.843840:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590272:0@lo:503: 00000100:00100000:0.0:1787826725.843877:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.843895:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.843900:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590272 00000100:00100000:2.0:1787826725.843905:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590272 00000100:00100000:2.0:1787826725.843934:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787826725.843941:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143590272:12345-0@lo:503: 00000100:00100000:2.0:1787826725.844015:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143590272:12345-0@lo:503: Request processed in 74us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.844021:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787826725.844049:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590272:0@lo:503: 00000100:00100000:2.0:1787826725.844248:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9482:1874672143590400:0@lo:502: 00000100:00100000:2.0:1787826725.844285:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.844306:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590400 00000100:00100000:0.0:1787826725.844310:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590400 00000100:00100000:2.0:1787826725.844311:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54473380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.844333:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787826725.844338:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9482:x1874672143590400:12345-0@lo:502: 00000100:00100000:0.0:1787826725.844428:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9482:x1874672143590400:12345-0@lo:502: Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.844435:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787826725.844439:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9482:1874672143590400:0@lo:502: 00000100:00100000:2.0:1787826725.844479:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9482:1874672143590528:0@lo:502: 00000100:00100000:2.0:1787826725.844521:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.844539:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547568a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.844562:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590528 00000100:00100000:3.0:1787826725.844567:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590528 00000100:00100000:3.0:1787826725.844598:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787826725.844607:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9482:x1874672143590528:12345-0@lo:502: 00000100:00100000:3.0:1787826725.844694:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:9482:x1874672143590528:12345-0@lo:502: Request processed in 88us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.844699:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787826725.844705:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9482:1874672143590528:0@lo:502: 00000040:00080000:2.0:1787826725.844726:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787826725.844759:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-47 (rc=0) 10000000:01000000:0.0:1787826725.844781:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826725.844792:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.844799:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826725.844805:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826725.844806:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 5 10000000:01000000:0.0:1787826725.844808:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826725.844822:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.844827:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.844832:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.844840:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590656:0@lo:101: 00000100:00100000:0.0:1787826725.844871:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.844887:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.844890:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590656 00000100:00100000:2.0:1787826725.844902:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590656 00000100:00100000:2.0:1787826725.844934:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787826725.844944:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143590656:12345-0@lo:101: 00010000:00010000:2.0:1787826725.844951:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.844960:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953385 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.844976:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.844985:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.844992:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031200, rc 0) 00000100:00100000:2.0:1787826725.845024:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143590656:12345-0@lo:101: Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.845031:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787826725.845040:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590656:0@lo:101: 00010000:00010000:0.0:1787826725.845054:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.845063:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.845115:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590784:0@lo:256: 00000100:00100000:0.0:1787826725.845144:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.845157:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.845163:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590784 00000100:00100000:2.0:1787826725.845167:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590784 00000100:00100000:2.0:1787826725.845199:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787826725.845203:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143590784:12345-0@lo:256: 20000000:01000000:2.0:1787826725.845212:0:9479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826725.845282:0:9479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826725.845286:0:9479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787826725.845357:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143590784:12345-0@lo:256: Request processed in 154us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.845363:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787826725.845377:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590784:0@lo:256: 10000000:01000000:0.0:1787826725.845420:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826725.845426:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.845433:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826725.845439:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787826725.845441:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1787826725.845444:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787826725.845458:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.845465:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.845472:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.845483:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590912:0@lo:101: 00000100:00100000:0.0:1787826725.845511:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.845534:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143590912 00000100:00100000:2.0:1787826725.845538:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143590912 00000100:00100000:0.0:1787826725.845541:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.845567:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787826725.845572:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143590912:12345-0@lo:101: 00010000:00010000:2.0:1787826725.845577:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.845582:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953393 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.845592:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.845597:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.845601:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031600, rc 0) 00000100:00100000:2.0:1787826725.845623:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143590912:12345-0@lo:101: Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.845627:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787826725.845644:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143590912:0@lo:101: 00010000:00010000:0.0:1787826725.845656:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.845676:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.845721:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143591040:0@lo:501: 00000100:00100000:0.0:1787826725.845746:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.845764:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.845847:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591040 00000100:00100000:3.0:1787826725.845853:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591040 00000100:00100000:3.0:1787826725.845883:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787826725.845892:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143591040:12345-0@lo:501: 00000100:00100000:3.0:1787826725.845988:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143591040:12345-0@lo:501: Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.845999:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143591040:0@lo:501: 00000100:00100000:3.0:1787826725.846005:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787826725.846030:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143591168:0@lo:503: 00000100:00100000:0.0:1787826725.846068:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.846087:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.846101:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591168 00000100:00100000:3.0:1787826725.846106:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591168 00000100:00100000:3.0:1787826725.846137:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787826725.846155:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143591168:12345-0@lo:503: 00000100:00100000:3.0:1787826725.846280:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143591168:12345-0@lo:503: Request processed in 126us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.846287:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787826725.846293:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143591168:0@lo:503: 00000100:00100000:2.0:1787826725.846555:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9483:1874672143591296:0@lo:502: 00000100:00100000:2.0:1787826725.847247:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.847289:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54473380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.847336:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591296 00000100:00100000:0.0:1787826725.847342:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591296 00000100:00100000:0.0:1787826725.847415:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787826725.847424:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:9483:x1874672143591296:12345-0@lo:502: 00000100:00100000:0.0:1787826725.847533:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:9483:x1874672143591296:12345-0@lo:502: Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.847541:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787826725.847563:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9483:1874672143591296:0@lo:502: 00010000:00010000:1.0:1787826725.847581:0:9481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000020:01000000:2.0:1787826725.847591:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826725.847608:0:9483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787826725.847616:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.847618:0:9483:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787826725.847623:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826725.847627:0:9483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:01000000:2.0:1787826725.847660:0:9483:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787826725.847664:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826725.847685:0:9483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d53427819b8) 00000020:00000080:2.0:1787826725.847709:0:9483:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osp with refcount 2 00000020:00000080:2.0:1787826725.847716:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000001:02000400:1.0:1787826725.847828:0:9481:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000004:00080000:2.0:1787826725.847833:0:9483:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787826725.847840:0:9483:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787826725.847848:0:9483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc0fefc09a79533a8 00010000:00080000:2.0:1787826725.847878:0:9483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826725.848050:0:9483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000001:00000004:1.0:1787826725.850252:0:9481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787826725.850490:0:9481:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00000040:01000000:2.0:1787826725.852067:0:9483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787826725.852087:0:9483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787826725.852316:0:9483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826725.852611:0:9483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826725.852735:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787826725.852825:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787826725.853203:0:9484:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787826725.853208:0:9484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787826725.853682:0:9483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787826725.853692:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787826725.853730:0:9483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787826725.853752:0:9483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc0fefc09a79533af 00000100:00080000:2.0:1787826725.853767:0:9483:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826725.853773:0:9483:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826725.853805:0:9483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d54533e4000 x1874672143591424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826725.853835:0:9483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787826725.853892:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826725.853897:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.853899:0:9483:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787826725.853903:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826725.853905:0:9483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787826725.853912:0:9483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826725.853921:0:9483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826725.853923:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826725.853928:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.853929:0:9483:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000100:00100000:0.0:1787826725.853932:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143591424:0@lo:8: 00000020:01000000:2.0:1787826725.853934:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826725.853941:0:9483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787826725.853945:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.853947:0:9483:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787826725.853952:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826725.853956:0:9483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000100:00100000:0.0:1787826725.854010:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.854087:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591424 00000100:00100000:0.0:1787826725.854093:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591424 00000100:00100000:3.0:1787826725.854099:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143591552:0@lo:400: 00000100:00100000:0.0:1787826725.854121:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826725.854127:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143591424:12345-0@lo:8: 00000100:00100000:3.0:1787826725.854133:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787826725.854152:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000100:00100000:3.0:1787826725.854156:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143592064:0@lo:400: 00000020:00000080:0.0:1787826725.854197:0:8399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc0fefc09a79533b6 00000100:00100000:3.0:1787826725.854205:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1787826725.854249:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d5478967000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:3.0:1787826725.854250:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826725.854258:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143591680:0@lo:400: 00002000:00080000:0.0:1787826725.854260:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787826725.854268:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787826725.854287:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.854306:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143592192:0@lo:400: 00002000:00100000:0.0:1787826725.854322:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787826725.854331:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.854373:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143591808:0@lo:400: 00000100:00100000:3.0:1787826725.854403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.854424:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826725.854431:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143591936:0@lo:400: 00000100:00100000:3.0:1787826725.854459:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.854498:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591552 00000100:00100000:3.0:1787826725.854502:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591552 00000100:00100000:3.0:1787826725.854531:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592064 00000100:00100000:3.0:1787826725.854535:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592064 00002000:00080000:0.0:1787826725.854552:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:3.0:1787826725.854563:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592192 00000100:00100000:3.0:1787826725.854568:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592192 00000100:00080000:0.0:1787826725.854575:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d5478963000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826725.854587:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591808 00000100:00100000:3.0:1787826725.854592:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591808 00000100:00100000:3.0:1787826725.854613:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787826725.854621:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343476940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143591552:12345-0@lo:400: 00000100:00100000:0.0:1787826725.854633:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1874672143591424:12345-0@lo:8: Request processed in 502us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.854654:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787826725.854679:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343476940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143591552:12345-0@lo:400: Request processed in 59us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.854686:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787826725.854703:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d54533e4000 x1874672143591424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826725.854703:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787826725.854716:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343475680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143592064:12345-0@lo:400: 00000100:00100000:0.0:1787826725.854718:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826725.854729:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787826725.854736:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787826725.854741:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787826725.854744:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826725.854760:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343475680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143592064:12345-0@lo:400: Request processed in 46us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.854767:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1787826725.854775:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787826725.854780:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787826725.854785:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143591424:0@lo:8: 00000100:00100000:3.0:1787826725.854788:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343477c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143592192:12345-0@lo:400: 00000100:00100000:3.0:1787826725.854817:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343477c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143592192:12345-0@lo:400: Request processed in 31us (486us total) trans 0 rc 0/0 00000004:00080000:0.0:1787826725.854819:0:9484:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787826725.854822:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787826725.854830:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826725.854834:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343477840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143591808:12345-0@lo:400: 00000100:00100000:3.0:1787826725.854858:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343477840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143591808:12345-0@lo:400: Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.854862:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1787826725.854880:0:9484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 100717664243ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787826725.854880:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591680 00000100:00100000:3.0:1787826725.854884:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591680 00080000:00080000:0.0:1787826725.854889:0:9484:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787826725.854914:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143591936 00000100:00100000:3.0:1787826725.854919:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143591936 00000100:00100000:3.0:1787826725.854936:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787826725.854943:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826725.854944:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143591680:12345-0@lo:400: 00000100:00080000:0.0:1787826725.854949:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826725.854966:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826725.854978:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143591936:12345-0@lo:400: 00000100:00100000:3.0:1787826725.854990:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143591680:12345-0@lo:400: Request processed in 46us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.855007:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826725.855024:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143591936:12345-0@lo:400: Request processed in 48us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.855040:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826725.855088:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143592320:0@lo:700: 00080000:10000000:1.0:1787826725.855108:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000100:00100000:0.0:1787826725.855124:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.855146:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.855197:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143591936:0@lo:400: 00010000:00080000:0.0:1787826725.855207:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5453268b40 x1874672143591808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.855231:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143591808:0@lo:400: 00000100:00100000:0.0:1787826725.855267:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143591680:0@lo:400: 00010000:00080000:0.0:1787826725.855280:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53434743c0 x1874672143592192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.855288:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143592192:0@lo:400: 00010000:00080000:0.0:1787826725.855300:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d545326a580 x1874672143591552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.855309:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143591552:0@lo:400: 00010000:00080000:0.0:1787826725.855327:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343474780 x1874672143592064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.855334:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143592064:0@lo:400: 00000100:00100000:3.0:1787826725.855353:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592320 00000100:00100000:3.0:1787826725.855359:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592320 00000100:00100000:3.0:1787826725.855402:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000001:00000400:1.0:1787826725.855410:0:9481:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00000100:00100000:3.0:1787826725.855411:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9485:x1874672143592320:12345-0@lo:700: 00000100:00100000:0.0:1787826725.855422:0:8409:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:0.0:1787826725.855429:0:8409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:3.0:1787826725.855445:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8408:1874672143592448:0@lo:700: 00000100:00100000:3.0:1787826725.855475:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.855496:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53425df3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787826725.855507:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:2.0:1787826725.855517:0:9483:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787826725.855523:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1787826725.855523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592448 00000100:00100000:3.0:1787826725.855526:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592448 00000020:00000080:2.0:1787826725.855535:0:9483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d5342784d28) 00000020:00000080:2.0:1787826725.855550:0:9483:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type osp with refcount 2 00000020:00000080:2.0:1787826725.855557:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1787826725.855557:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826725.855565:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53434752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8408:x1874672143592448:12345-0@lo:700: 00000004:00080000:2.0:1787826725.855654:0:9483:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787826725.855660:0:9483:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787826725.855667:0:9483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc0fefc09a79533c4 00010000:00080000:2.0:1787826725.855709:0:9483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d53434cf000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826725.855947:0:9483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-8 is initialized 00000040:01000000:2.0:1787826725.856031:0:9483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787826725.856041:0:9483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787826725.856154:0:9483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826725.856329:0:9483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826725.856426:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787826725.856530:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787826725.856765:0:9487:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787826725.856770:0:9487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1787826725.857353:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00080000:10000000:0.0:1787826725.860308:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787826725.860412:0:9483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787826725.860427:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787826725.860469:0:9483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787826725.860500:0:9483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc0fefc09a79533cb 00000100:00080000:3.0:1787826725.860511:0:9483:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826725.860518:0:9483:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d53434cf000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826725.860552:0:9483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343477480 x1874672143592576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826725.860578:0:9483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787826725.860595:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143592576:0@lo:8: 00000020:01000000:3.0:1787826725.860659:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826725.860663:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.860665:0:9483:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787826725.860667:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826725.860671:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.860676:0:9483:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787826725.860680:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787826725.860681:0:9483:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787826725.860705:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9483:1874672143592704:0@lo:502: 00000100:00100000:1.0:1787826725.860716:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.860747:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592576 00000100:00100000:3.0:1787826725.860752:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592576 00000100:00100000:3.0:1787826725.860784:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826725.860789:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143592576:12345-0@lo:8: 00010000:02000000:3.0:1787826725.860801:0:8402:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (not set up) 00000020:00000080:2.0:1787826725.861452:0:9481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787826725.861461:0:9481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826725.861466:0:9481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.861468:0:9481:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787826725.861479:0:9481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826725.861495:0:9481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.861497:0:9481:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787826725.861502:0:9481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787826725.861503:0:9481:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787826725.861524:0:9481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826725.861529:0:9481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.861530:0:9481:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787826725.861534:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787826725.862022:0:9467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787826725.862059:0:9467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787826725.862068:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.862080:0:9467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826725.862088:0:9467:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d534260c000 from 1 10000000:01000000:0.0:1787826725.862091:0:9467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826725.862118:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.862126:0:9467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826725.862137:0:9467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.862153:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143592832:0@lo:101: 00000100:00100000:0.0:1787826725.862209:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.862256:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.862349:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592832 00000100:00100000:2.0:1787826725.862356:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592832 00000100:00100000:2.0:1787826725.862404:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787826725.862414:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:9467:x1874672143592832:12345-0@lo:101: 00010000:00010000:2.0:1787826725.862426:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.862438:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79533d2 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.862464:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.862476:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.862491:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031e00, rc 0) 00000100:00100000:2.0:1787826725.862534:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143592832:12345-0@lo:101: Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.862542:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787826725.862590:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143592832:0@lo:101: 00010000:00010000:2.0:1787826725.862600:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.862616:0:9467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.862749:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143592960:0@lo:501: 00000100:00100000:2.0:1787826725.862776:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.862897:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.862921:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592960 00000100:00100000:0.0:1787826725.862927:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592960 00000100:00100000:0.0:1787826725.862961:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787826725.862970:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143592960:12345-0@lo:501: 00000100:00100000:0.0:1787826725.863081:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143592960:12345-0@lo:501: Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.863088:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787826725.863118:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143592960:0@lo:501: 00000100:00100000:2.0:1787826725.863158:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593088:0@lo:503: 00000100:00100000:2.0:1787826725.863234:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.863261:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593088 00000100:00100000:2.0:1787826725.863264:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.863267:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593088 00000100:00100000:0.0:1787826725.863312:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787826725.863319:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143593088:12345-0@lo:503: 00000100:00100000:0.0:1787826725.863396:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143593088:12345-0@lo:503: Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.863404:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787826725.863407:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593088:0@lo:503: 00000040:00080000:2.0:1787826725.863843:0:9467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826725.863905:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593216:0@lo:502: 00000100:00100000:2.0:1787826725.863947:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.863971:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.864032:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143592576:12345-0@lo:8: Request processed in 3240us (3316us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826725.864042:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787826725.864045:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593216 00000100:00100000:0.0:1787826725.864051:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593216 40000000:02000000:3.0:1787826725.864074:0:6492:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1787826725.864086:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787826725.864097:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143593216:12345-0@lo:502: 00000100:00100000:0.0:1787826725.864192:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143593216:12345-0@lo:502: Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.864199:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787826725.864205:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593216:0@lo:502: 00000040:00080000:2.0:1787826725.864414:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787826725.864432:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787826725.864446:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593344:0@lo:502: 00000100:00100000:2.0:1787826725.864471:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.864500:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.864515:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593344 00000100:00100000:0.0:1787826725.864521:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593344 00000100:00100000:0.0:1787826725.864552:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787826725.864560:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143593344:12345-0@lo:502: 00000100:00100000:0.0:1787826725.864651:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143593344:12345-0@lo:502: Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.864657:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787826725.864791:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593344:0@lo:502: 00000040:00080000:2.0:1787826725.864826:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787826725.864832:0:9467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787826725.865415:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826725.865423:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826725.865425:0:9492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787826725.865432:0:9492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d534260c000 00000020:00000080:0.0:1787826725.865444:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826725.865456:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826725.865459:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826725.865461:0:9492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787826725.865463:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787826725.865519:0:9467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787826725.865544:0:9467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826725.865554:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.865565:0:9467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.865607:0:9467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787826725.865610:0:9467:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d534260c000 10000000:01000000:2.0:1787826725.865613:0:9467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d534260c000 10000000:01000000:2.0:1787826725.865617:0:9467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826725.865623:0:9467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d534260c000 from 1 10000000:01000000:2.0:1787826725.865625:0:9467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826725.865657:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.865666:0:9467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.865676:0:9467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.865690:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593472:0@lo:101: 00000100:00100000:2.0:1787826725.865723:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.865755:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.866018:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593472 00000100:00100000:0.0:1787826725.866030:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593472 00000100:00100000:2.0:1787826725.866115:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787826725.866125:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:9467:x1874672143593472:12345-0@lo:101: 00010000:00010000:2.0:1787826725.866136:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.866149:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79533e0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.866291:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 20 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.866303:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 20 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.866311:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030200, rc 0) 00000100:00100000:2.0:1787826725.866352:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593472:12345-0@lo:101: Request processed in 229us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.866359:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787826725.866386:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593472:0@lo:101: 00000100:00080000:1.0:1787826725.866391:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53434cf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:0.0:1787826725.866401:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826725.866402:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00010000:00010000:0.0:1787826725.866413:0:9467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.866414:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143592576:0@lo:8: 00000100:00100000:0.0:1787826725.866498:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593600:0@lo:501: 00000100:00100000:0.0:1787826725.866536:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.866562:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.866575:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593600 00000100:00100000:2.0:1787826725.866580:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593600 00000100:00100000:2.0:1787826725.866613:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787826725.866620:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593600:12345-0@lo:501: 00000100:00100000:2.0:1787826725.866723:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593600:12345-0@lo:501: Request processed in 103us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.866731:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787826725.866749:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593600:0@lo:501: 00000100:00100000:1.0:1787826725.866778:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593728:0@lo:503: 00000100:00100000:1.0:1787826725.866816:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.866837:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.866853:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593728 00000100:00100000:0.0:1787826725.866859:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593728 00000100:00100000:0.0:1787826725.866880:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787826725.866884:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593728:12345-0@lo:503: 00000100:00100000:0.0:1787826725.866977:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593728:12345-0@lo:503: Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.866981:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593728:0@lo:503: 00000100:00100000:0.0:1787826725.866990:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000040:00080000:1.0:1787826725.867146:0:9467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826725.867235:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593856:0@lo:502: 00000100:00100000:1.0:1787826725.867269:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.867285:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.867317:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593856 00000100:00100000:0.0:1787826725.867321:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593856 00000100:00100000:0.0:1787826725.867349:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787826725.867356:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593856:12345-0@lo:502: 00000100:00100000:0.0:1787826725.867452:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593856:12345-0@lo:502: Request processed in 95us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.867459:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787826725.867481:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593856:0@lo:502: 00000040:00080000:1.0:1787826725.867635:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787826725.867658:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787826725.867669:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787826725.867676:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787826725.867683:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787826725.867689:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787826725.867696:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787826725.867702:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787826725.867709:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787826725.867715:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787826725.867722:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787826725.867728:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787826725.867735:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787826725.867741:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787826725.867757:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787826725.867765:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787826725.867775:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787826725.867795:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787826725.867807:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787826725.867819:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787826725.867831:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787826725.867842:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787826725.867863:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787826725.867878:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787826725.867892:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787826725.867903:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787826725.867918:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787826725.867944:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787826725.867959:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787826725.867971:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787826725.867995:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787826725.868010:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787826725.868023:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787826725.868035:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787826725.868047:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787826725.868063:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787826725.868077:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1787826725.868088:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787826725.868100:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1787826725.868111:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1787826725.868122:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1787826725.868133:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1787826725.868144:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1787826725.868155:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1787826725.868167:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1787826725.868194:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1787826725.868239:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593984:0@lo:502: 00000100:00100000:1.0:1787826725.868278:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.868309:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.868330:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143593984 00000100:00100000:2.0:1787826725.868335:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143593984 00000100:00100000:2.0:1787826725.868369:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787826725.868378:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593984:12345-0@lo:502: 00000100:00100000:3.0:1787826725.868399:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53434752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8408:x1874672143592448:12345-0@lo:700: Request processed in 12832us (12919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.868409:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787826725.868414:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53434761c0 x1874672143592448/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826725.868427:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8408:1874672143592448:0@lo:700: 40000000:02000000:1.0:1787826725.868438:0:8408:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1787826725.868465:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.868489:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9467:x1874672143593984:12345-0@lo:502: Request processed in 112us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.868497:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787826725.868500:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143592704 00000100:00100000:3.0:1787826725.868505:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143592704 00000100:00100000:2.0:1787826725.868529:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787826725.868539:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9483:x1874672143592704:12345-0@lo:502: 00000100:00100000:3.0:1787826725.868547:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53425dfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.868622:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:9483:x1874672143592704:12345-0@lo:502: Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.868629:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787826725.868648:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9483:1874672143592704:0@lo:502: 00000020:01000000:3.0:1787826725.868680:0:9483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1787826725.868682:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143593984:0@lo:502: 00000020:00000080:3.0:1787826725.868689:0:9483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.868694:0:9483:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787826725.868699:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787826725.868726:0:9467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1787826725.868737:0:9467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000000:2.0:1787826725.869278:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-42 (rc=0) 10000000:01000000:2.0:1787826725.869306:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787826725.869313:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.869321:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.869328:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787826725.869330:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5448400800 from 30 10000000:01000000:2.0:1787826725.869332:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826725.869360:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.869368:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.869377:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.869393:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594112:0@lo:101: 00000100:00100000:2.0:1787826725.869429:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.869455:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143594112 00000100:00100000:3.0:1787826725.869461:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143594112 00000100:00100000:2.0:1787826725.869463:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.869497:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787826725.869505:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143594112:12345-0@lo:101: 00010000:00010000:3.0:1787826725.869525:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826725.869538:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79533ee expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.869562:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.869574:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.869583:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148fe00, rc 0) 00000100:00100000:3.0:1787826725.869622:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143594112:12345-0@lo:101: Request processed in 118us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.869629:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787826725.869669:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594112:0@lo:101: 00010000:00010000:3.0:1787826725.869679:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.869686:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826725.869742:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594240:0@lo:501: 00000100:00100000:3.0:1787826725.869773:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.869788:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.870406:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143594240 00000100:00100000:2.0:1787826725.870413:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143594240 00000100:00100000:2.0:1787826725.870444:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787826725.870454:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143594240:12345-0@lo:501: 00000100:00100000:2.0:1787826725.870565:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143594240:12345-0@lo:501: Request processed in 112us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.870573:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787826725.870578:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594240:0@lo:501: 00000100:00100000:3.0:1787826725.870606:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594368:0@lo:503: 00000100:00100000:3.0:1787826725.870640:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.870683:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143594368 00000100:00100000:3.0:1787826725.870686:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.870688:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143594368 00000100:00100000:2.0:1787826725.870723:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787826725.870733:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143594368:12345-0@lo:503: 00000100:00100000:2.0:1787826725.870818:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143594368:12345-0@lo:503: Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.870826:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787826725.870826:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594368:0@lo:503: 00000100:00100000:0.0:1787826725.871895:0:9495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f630c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9495:1874672143594496:0@lo:502: 00000100:00100000:0.0:1787826725.871943:0:9495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.871986:0:9495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.872054:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143594496 00000100:00100000:2.0:1787826725.872060:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143594496 00000020:01000004:0.0:1787826725.872078:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787826725.872090:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d5450e88000) 00000100:00100000:2.0:1787826725.872094:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787826725.872103:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:9495:x1874672143594496:12345-0@lo:502: 00000020:00000080:0.0:1787826725.872110:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000100:00100000:2.0:1787826725.872252:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:9495:x1874672143594496:12345-0@lo:502: Request processed in 150us (309us total) trans 0 rc 0/0 00000020:01000004:0.0:1787826725.872257:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d534260c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787826725.872263:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d534260c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787826725.872266:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d534260c000 3 00000100:00100000:2.0:1787826725.872273:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00080000:0.0:1787826725.872305:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5343591800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.106@tcp at head 00000100:00100000:1.0:1787826725.874317:0:9495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f630c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9495:1874672143594496:0@lo:502: 00000100:00100000:1.0:1787826725.874393:0:9495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9495:1874672143594624:0@lo:502: 00000100:00100000:1.0:1787826725.874461:0:9495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.874488:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143594624 00000100:00100000:2.0:1787826725.874493:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143594624 00000100:00100000:1.0:1787826725.874506:0:9495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038000 going to sleep for 11 seconds 00010000:00010000:0.0:1787826725.874529:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000100:00100000:2.0:1787826725.874555:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787826725.874563:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:9495:x1874672143594624:12345-0@lo:502: 00000100:00100000:2.0:1787826725.874690:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:9495:x1874672143594624:12345-0@lo:502: Request processed in 126us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.874711:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000020:00000080:0.0:1787826725.874741:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787826725.874792:0:9494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787826725.874806:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc0fefc09a7953403 00000100:00080000:0.0:1787826725.874814:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826725.874819:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d5343591800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826725.874843:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5341f60f00 x1874672143594752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826725.874874:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1874672143594752:0@lo:38: 00000100:00100000:0.0:1787826725.874915:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826725.874952:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000001:00100000:2.0:1787826725.875050:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787826725.875147:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143592320:12345-0@lo:700: Request processed in 19738us (20023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.875157:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787826725.875210:0:9485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f61680 x1874672143592320/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.875253:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143592320:0@lo:700: 00000100:00100000:3.0:1787826725.875704:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143594752 00000100:00100000:3.0:1787826725.875710:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143594752 00000100:00100000:3.0:1787826725.875955:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787826725.875962:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1874672143594752:12345-0@lo:38: 00010000:00080000:3.0:1787826725.875984:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000020:00000080:3.0:1787826725.876018:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc0fefc09a795340a 00000004:00100000:3.0:1787826725.876032:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826725.876060:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d5343507000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826725.876123:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1874672143594752:12345-0@lo:38: Request processed in 160us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.876131:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787826725.876342:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f60f00 x1874672143594752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826725.876344:0:9495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9495:1874672143594624:0@lo:502: 00000100:00100000:2.0:1787826725.876354:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826725.876360:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787826725.876366:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787826725.876370:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787826725.876372:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5343591800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:1.0:1787826725.876374:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1787826725.876378:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1874672143594752:0@lo:38: 00000020:01000004:3.0:1787826725.876407:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787826725.876422:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d547c5a3370) 00000020:00000080:3.0:1787826725.876441:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000000:2.0:1787826725.876445:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-47 (rc=0) 10000000:01000000:2.0:1787826725.876486:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826725.876495:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.876505:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.876515:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826725.876518:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 5 10000000:01000000:2.0:1787826725.876521:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:01000004:3.0:1787826725.876532:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d534260c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787826725.876538:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d534260c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787826725.876540:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d534260c000 3 00010000:00010000:2.0:1787826725.876546:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.876555:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.876565:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787826725.876569:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5343507800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.106@tcp at head 00000100:00100000:2.0:1787826725.876590:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594880:0@lo:101: 00000100:00100000:2.0:1787826725.876624:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.876651:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.876664:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143594880 00000100:00100000:2.0:1787826725.876667:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143594880 00000100:00100000:2.0:1787826725.876697:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787826725.876704:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143594880:12345-0@lo:101: 00010000:00010000:2.0:1787826725.876713:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.876735:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953418 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.876757:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.876768:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.876776:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350f400, rc 0) 00000100:00100000:2.0:1787826725.876807:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143594880:12345-0@lo:101: Request processed in 104us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.876813:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787826725.876848:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143594880:0@lo:101: 00010000:00010000:2.0:1787826725.876862:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.876871:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.876954:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595008:0@lo:256: 00000100:00100000:2.0:1787826725.876987:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.877003:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.877022:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595008 00000100:00100000:2.0:1787826725.877025:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595008 00000100:00100000:2.0:1787826725.877045:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787826725.877050:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143595008:12345-0@lo:256: 20000000:01000000:2.0:1787826725.877060:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826725.877073:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826725.877076:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787826725.877151:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143595008:12345-0@lo:256: Request processed in 99us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.877158:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787826725.877204:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595008:0@lo:256: 10000000:01000000:2.0:1787826725.877269:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826725.877275:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.877282:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.877289:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787826725.877292:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787826725.877294:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787826725.877310:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.877326:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.877332:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.877340:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595136:0@lo:101: 00000100:00100000:2.0:1787826725.877363:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.877381:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.877391:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595136 00000100:00100000:2.0:1787826725.877393:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595136 00000004:00080000:0.0:1787826725.877396:0:9485:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787826725.877402:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143595264:0@lo:13: 00000100:00100000:2.0:1787826725.877414:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787826725.877419:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143595392:0@lo:7: 00000100:00100000:2.0:1787826725.877422:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143595136:12345-0@lo:101: 00010000:00010000:2.0:1787826725.877428:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.877437:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953426 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.877446:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826725.877449:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.877456:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.877461:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350f800, rc 0) 00000100:00100000:0.0:1787826725.877470:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.877494:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.877502:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143595136:12345-0@lo:101: Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.877505:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595264 00000100:00100000:1.0:1787826725.877511:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595264 00000100:00100000:0.0:1787826725.877514:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595392 00000100:00100000:0.0:1787826725.877519:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595392 00000100:00100000:2.0:1787826725.877519:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787826725.877548:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826725.877559:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143595264:12345-0@lo:13: 00000100:00100000:0.0:1787826725.877564:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826725.877566:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595136:0@lo:101: 00000100:00100000:3.0:1787826725.877572:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787826725.877579:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9485:x1874672143595392:12345-0@lo:7: 00000100:00100000:3.0:1787826725.877584:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00000024:1.0:1787826725.877586:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00010000:00010000:2.0:1787826725.877590:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.877599:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.877648:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143595264:12345-0@lo:13: Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.877652:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595520:0@lo:501: 00000100:00100000:1.0:1787826725.877659:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826725.877689:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787826725.877701:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f61680 x1874672143595264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826725.877708:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826725.877720:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143595264:0@lo:13: 00000100:00100000:2.0:1787826725.877723:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595520 00000100:00100000:2.0:1787826725.877726:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595520 00000100:00100000:2.0:1787826725.877748:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787826725.877754:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143595520:12345-0@lo:501: 00000100:00100000:2.0:1787826725.877831:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143595520:12345-0@lo:501: Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.877838:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787826725.877875:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595520:0@lo:501: 00000100:00100000:2.0:1787826725.877910:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595648:0@lo:503: 00000100:00100000:2.0:1787826725.877952:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.877968:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.877980:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595648 00000100:00100000:2.0:1787826725.877984:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595648 00000100:00100000:2.0:1787826725.878010:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787826725.878023:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143595648:12345-0@lo:503: 00000100:00100000:2.0:1787826725.878104:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143595648:12345-0@lo:503: Request processed in 87us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.878111:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787826725.878162:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143595648:0@lo:503: 00000100:00100000:2.0:1787826725.878504:0:9497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9497:1874672143595776:0@lo:901: 00000100:00100000:2.0:1787826725.878542:0:9497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.878565:0:9497:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826725.878585:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595776 00000100:00100000:1.0:1787826725.878591:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595776 00000100:00080000:2.0:1787826725.878640:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826725.878650:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787826725.878659:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9497:x1874672143595776:12345-0@lo:901: 00000100:00100000:1.0:1787826725.878743:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9497:x1874672143595776:12345-0@lo:901: Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.878751:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787826725.878762:0:9497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d54533e6d00 x1874672143595776/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826725.878774:0:9497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6d00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9497:1874672143595776:0@lo:901: 00010000:00010000:3.0:1787826725.878898:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787826725.879104:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787826725.879146:0:9494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826725.879158:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc0fefc09a7953434 00000100:00080000:3.0:1787826725.879166:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826725.879183:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d5343507800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826725.879240:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343474b40 x1874672143595904/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826725.879259:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787826725.879364:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1874672143595904:0@lo:38: 00000100:00100000:2.0:1787826725.879407:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.880381:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9499:1874672143596032:0@lo:502: 00000100:00100000:2.0:1787826725.880428:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.880452:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596032 00000100:00100000:2.0:1787826725.880457:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596032 00000100:00100000:3.0:1787826725.880478:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.880494:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787826725.880503:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:9499:x1874672143596032:12345-0@lo:502: 00000100:00100000:3.0:1787826725.880520:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143595904 00000100:00100000:3.0:1787826725.880525:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143595904 00000100:00100000:3.0:1787826725.880552:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826725.880559:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1874672143595904:12345-0@lo:38: 00010000:00080000:3.0:1787826725.880581:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000100:00100000:2.0:1787826725.880617:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:9499:x1874672143596032:12345-0@lo:502: Request processed in 114us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.880626:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000020:00000080:3.0:1787826725.880646:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc0fefc09a795343b 00000004:00100000:3.0:1787826725.880662:0:6487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787826725.880685:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9499:1874672143596032:0@lo:502: 00000100:00080000:3.0:1787826725.880696:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8d5342a66000 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1787826725.880724:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826725.880730:0:9499:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787826725.880736:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826725.880737:0:9499:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:3.0:1787826725.880757:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1874672143595904:12345-0@lo:38: Request processed in 197us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.880766:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787826725.880770:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343474b40 x1874672143595904/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826725.880786:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826725.880792:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787826725.880797:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787826725.880801:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787826725.880804:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5343507800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826725.880808:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1874672143595904:0@lo:38: 00000020:00000080:3.0:1787826725.880818:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787826725.880824:0:9499:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:01000000:3.0:1787826725.880850:0:9499:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787826725.880854:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826725.880876:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d53437f4d28) 00000020:00000080:3.0:1787826725.880894:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787826725.880901:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787826725.880996:0:9499:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787826725.881003:0:9499:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787826725.881010:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a7953449 00000040:00080000:2.0:1787826725.881559:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1787826725.881674:0:9467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1787826725.881713:0:9467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826725.881723:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.881734:0:9467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787826725.881737:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.106@tcp at head 00002000:00080000:0.0:1787826725.881779:0:8401:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787826725.881786:0:8401:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000020:01000004:2.0:1787826725.881788:0:9467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787826725.881791:0:9467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787826725.881793:0:9467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826725.881795:0:9467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826725.881797:0:9467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826725.881798:0:9467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826725.881800:0:9467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826725.881802:0:9467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787826725.881803:0:9467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787826725.881805:0:9467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826725.881807:0:9467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826725.881810:0:9467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787826725.881813:0:9467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826725.881815:0:9467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787826725.881817:0:9467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826725.881818:0:9467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826725.881825:0:9467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826725.881826:0:9467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826725.881827:0:9467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826725.881828:0:9467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787826725.881829:0:9467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787826725.881830:0:9467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826725.881831:0:9467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787826725.881840:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143595392:12345-0@lo:7: Request processed in 4266us (4371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.881848:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:2.0:1787826725.881850:0:9467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787826725.881863:0:9467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143596160:0@lo:253: 00010000:00080000:0.0:1787826725.881876:0:9485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f62d00 x1874672143595392/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.881884:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143595392:0@lo:7: 00000004:00080000:0.0:1787826725.881893:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787826725.881912:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143596288:0@lo:5: 00000100:00100000:2.0:1787826725.881922:0:9467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.881947:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.881959:0:9467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5342ac0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.881973:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.881981:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596160 00000100:00100000:2.0:1787826725.881986:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596160 00000100:00100000:0.0:1787826725.881998:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596288 00000100:00100000:0.0:1787826725.882004:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596288 00000100:00100000:2.0:1787826725.882025:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787826725.882038:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:9467:x1874672143596160:12345-0@lo:253: 00000100:00100000:0.0:1787826725.882041:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826725.882052:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143596288:12345-0@lo:5: 00010000:00010000:3.0:1787826725.882058:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-11 is initialized 20000000:01000000:2.0:1787826725.882063:0:9479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00002000:00080000:0.0:1787826725.882070:0:8399:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 20000000:01000000:2.0:1787826725.882076:0:9479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787826725.882099:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143596288:12345-0@lo:5: Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.882104:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787826725.882130:0:9485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f62d00 x1874672143596288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.882149:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143596288:0@lo:5: 00000004:00080000:0.0:1787826725.882160:0:9485:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787826725.882201:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143596416:0@lo:5: 00000100:00100000:0.0:1787826725.882261:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.882284:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.882302:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596416 00000100:00100000:0.0:1787826725.882305:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596416 00000100:00100000:0.0:1787826725.882335:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787826725.882344:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143596416:12345-0@lo:5: 00002000:00080000:0.0:1787826725.882370:0:8399:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787826725.884240:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9485:x1874672143596416:12345-0@lo:5: Request processed in 1894us (1976us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787826725.884251:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787826725.884333:0:9485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f62d00 x1874672143596416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.884347:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143596416:0@lo:5: 00000004:00080000:0.0:1787826725.884358:0:9485:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787826725.884391:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9485:1874672143596544:0@lo:900: 00000100:00100000:0.0:1787826725.884425:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.884451:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.884476:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596544 00000100:00100000:0.0:1787826725.884481:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596544 00000100:00100000:0.0:1787826725.884518:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826725.884526:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9485:x1874672143596544:12345-0@lo:900: 00000100:00100000:0.0:1787826725.884585:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9485:x1874672143596544:12345-0@lo:900: Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.884593:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787826725.884631:0:9485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f61680 x1874672143596544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826725.884642:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9485:1874672143596544:0@lo:900: 00000040:01000000:3.0:1787826725.886423:0:9499:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787826725.886437:0:9499:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 20000000:01000000:2.0:1787826725.886442:0:9479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826725.886454:0:9479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787826725.886478:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826725.886483:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826725.886502:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.886519:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.886527:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.886534:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.886564:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.886578:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 23 pid: 9479 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.886591:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143596672:0@lo:104: 00000040:00080000:3.0:1787826725.886628:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826725.886640:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.886668:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596672 00000100:00100000:3.0:1787826725.886675:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596672 00000100:00100000:2.0:1787826725.886678:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:9467:x1874672143596160:12345-0@lo:253: Request processed in 4644us (4755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.886691:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:1.0:1787826725.886707:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.886719:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 22 pid: 6478 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826725.886720:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787826725.886734:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143596672:12345-0@lo:104: 00000100:00100000:1.0:1787826725.886737:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143596800:0@lo:104: 00000100:00100000:2.0:1787826725.886749:0:9467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9467:1874672143596160:0@lo:253: 00010000:00010000:3.0:1787826725.886750:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.886762:0:9467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787826725.886766:0:9467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826725.886768:0:9467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787826725.886770:0:9467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826725.886771:0:9467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826725.886773:0:9467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826725.886777:0:9467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826725.886780:0:9467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:1.0:1787826725.886781:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787826725.886782:0:9467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787826725.886785:0:9467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787826725.886786:0:9467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826725.886794:0:9467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787826725.886813:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0380c0 going to sleep for 11 seconds 00000020:02000000:2.0:1787826725.886817:0:9467:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787826725.886819:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826725.886830:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143596672:12345-0@lo:104: Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.886831:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143596672:0@lo:104: 00000100:00100000:3.0:1787826725.886845:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787826725.886860:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596800 00000100:00100000:3.0:1787826725.886863:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596800 00000100:00100000:3.0:1787826725.886888:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787826725.886895:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143596800:12345-0@lo:104: 00010000:00010000:3.0:1787826725.886904:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.886958:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787826725.886964:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143596800:12345-0@lo:104: Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826725.886971:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787826725.886979:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143596800:0@lo:104: 00010000:00010000:1.0:1787826725.886997:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.886997:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826725.887005:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.887015:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030400 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:3.0:1787826725.887019:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.887033:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826725.887040:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826725.887046:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826725.887067:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.887073:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826725.887089:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.887094:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a7953418 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795341f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.887099:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787826725.887103:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826725.887106:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.887110:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81c00 already unused, calling callback (ffffffffc13fec20) 00000100:00100000:1.0:1787826725.887112:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143596928:0@lo:103: 10000000:00010000:3.0:1787826725.887113:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.887123:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826725.887127:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826725.887135:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826725.887147:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.887148:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826725.887155:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826725.887169:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826725.887185:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c81c00/0xc0fefc09a7953385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795338c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826725.887197:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143597056:0@lo:103: 00010000:00010000:3.0:1787826725.887197:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826725.887199:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826725.887201:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826725.887209:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826725.887282:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.887316:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143596928 00000100:00100000:1.0:1787826725.887321:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143596928 00010000:00010000:1.0:1787826725.887341:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 23 pid: 9479 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.887372:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597056 00000100:00100000:1.0:1787826725.887379:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597056 00010000:00010000:1.0:1787826725.887393:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 24 pid: 6478 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826725.887412:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787826725.887419:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5447d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143596928:12345-0@lo:103: 00010000:00010000:1.0:1787826725.887431:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826725.887435:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 24 pid: 9479 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826725.887439:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:1.0:1787826725.887458:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 24 pid: 9479 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887473:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350f400/0xc0fefc09a795341f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953418 expref: 24 pid: 9479 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887485:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826725.887517:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5447d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143596928:12345-0@lo:103: Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.887524:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000040:00080000:3.0:1787826725.887542:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000100:00100000:1.0:1787826725.887566:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787826725.887575:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f61680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3618:x1874672143597056:12345-0@lo:103: 00010000:00010000:1.0:1787826725.887583:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826725.887588:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 22 pid: 6478 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887597:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 22 pid: 6478 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887609:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031200/0xc0fefc09a795338c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953385 expref: 22 pid: 6478 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887620:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887628:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826725.887641:0:6471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001157925s 00000040:00080000:3.0:1787826725.887650:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00010000:00010000:1.0:1787826725.887652:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887662:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887668:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887674:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887680:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167d800 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826725.887684:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887691:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887704:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887713:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826725.887749:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f61680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143597056:12345-0@lo:103: Request processed in 175us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.887757:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826725.887771:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143597056:0@lo:103: 00000100:00100000:1.0:1787826725.887794:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143596928:0@lo:103: 00010000:00010000:1.0:1787826725.887815:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887820:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826725.887830:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544167d800/0xc0fefc09a7953450 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826725.887888:0:9502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787826725.887894:0:9502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787826725.888343:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826725.888352:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787826725.888382:0:9499:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787826725.888404:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0fefc09a7953457 00000100:00080000:3.0:1787826725.888411:0:9499:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826725.888415:0:9499:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826725.888438:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343475a40 x1874672143597184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826725.888462:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143597184:0@lo:8: 00000100:00100000:3.0:1787826725.888496:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.888540:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597184 00000100:00080000:3.0:1787826725.888545:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787826725.888546:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597184 00000100:00100000:0.0:1787826725.888575:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787826725.888581:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143597184:12345-0@lo:8: 00010000:00080000:0.0:1787826725.888602:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000020:00000080:0.0:1787826725.888637:0:8402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0fefc09a795345e 00000020:01000000:3.0:1787826725.888638:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826725.888644:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.888646:0:9499:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787826725.888649:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00002000:00100000:0.0:1787826725.888650:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d5343595800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:01000000:3.0:1787826725.888652:0:9499:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00002000:00080000:0.0:1787826725.888657:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000020:01000000:3.0:1787826725.888658:0:9499:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00002000:00100000:0.0:1787826725.888662:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1787826725.888662:0:9499:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826725.888666:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787826725.888670:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.888671:0:9499:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787826725.888673:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787826725.888676:0:9499:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787826725.888680:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.888681:0:9499:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787826725.888686:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787826725.888690:0:9499:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:01000000:3.0:1787826725.888709:0:9499:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00002000:00080000:0.0:1787826725.888711:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:3.0:1787826725.888714:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826725.888726:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d53437f0000) 00000100:00080000:0.0:1787826725.888733:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d5343592000 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1787826725.888743:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787826725.888750:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787826725.888781:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1874672143597184:12345-0@lo:8: Request processed in 198us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.888788:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787826725.888795:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343475a40 x1874672143597184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826725.888805:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826725.888812:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787826725.888817:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787826725.888820:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787826725.888822:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787826725.888829:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787826725.888833:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143597184:0@lo:8: 00000004:00080000:0.0:1787826725.888840:0:9502:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787826725.888878:0:9502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 100751662951ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787826725.888885:0:9502:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787826725.889095:0:9499:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787826725.889099:0:9499:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787826725.889104:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0fefc09a795346c 00010000:00080000:3.0:1787826725.889122:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d534380b800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1787826725.889312:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787826725.889485:0:9499:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787826725.889496:0:9499:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787826725.889604:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826725.889705:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826725.889808:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787826725.889892:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:3.0:1787826725.890141:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787826725.890208:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143597312:0@lo:13: 00000100:00100000:3.0:1787826725.890268:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.890295:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597312 00000100:00100000:1.0:1787826725.890302:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597312 00000004:00080000:3.0:1787826725.890310:0:9503:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787826725.890326:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143597440:0@lo:7: 00000100:00100000:3.0:1787826725.890346:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826725.890355:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787826725.890365:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53434770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143597312:12345-0@lo:13: 00000100:00100000:3.0:1787826725.890366:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.890372:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597440 00000100:00100000:0.0:1787826725.890378:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597440 00002000:00000024:1.0:1787826725.890386:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1787826725.890411:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826725.890421:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:9503:x1874672143597440:12345-0@lo:7: 00000100:00100000:1.0:1787826725.890438:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53434770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874672143597312:12345-0@lo:13: Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826725.890445:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787826725.890448:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343475a40 x1874672143597312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826725.890465:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143597312:0@lo:13: 00000100:00080000:2.0:1787826725.890615:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00080000:10000000:2.0:1787826725.891918:0:9467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787826725.892201:0:9467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787826725.892513:0:9467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787826725.892695:0:9467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787826725.892983:0:9467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787826725.893329:0:9467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000040:00080000:3.0:1787826725.893603:0:9504:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787826725.893608:0:9504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787826725.894250:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826725.894261:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787826725.894297:0:9499:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000001:00000004:2.0:1787826725.894311:0:9467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:00000080:3.0:1787826725.894317:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0fefc09a7953473 00000100:00080000:3.0:1787826725.894326:0:9499:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826725.894336:0:9499:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d534380b800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826725.894363:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343475a40 x1874672143597568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826725.894385:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143597568:0@lo:8: 00000100:00100000:3.0:1787826725.894454:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.894509:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597568 00000100:00100000:3.0:1787826725.894515:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597568 00000100:00100000:3.0:1787826725.894549:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787826725.894556:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53434761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143597568:12345-0@lo:8: 00000100:00100000:3.0:1787826725.894599:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53434761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143597568:12345-0@lo:8: Request processed in 43us (146us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787826725.894604:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787826725.894630:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826725.894636:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826725.894646:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826725.894649:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143597568:0@lo:8: 00000100:00080000:3.0:1787826725.894676:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787826725.894721:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826725.894725:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.894727:0:9499:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787826725.894729:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826725.894733:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.894734:0:9499:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787826725.894737:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787826725.894738:0:9499:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787826725.894757:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9499:1874672143597696:0@lo:502: 00000100:00100000:3.0:1787826725.894791:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.894818:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3fad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.894841:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597696 00000100:00100000:2.0:1787826725.894847:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597696 00000100:00100000:2.0:1787826725.894882:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787826725.894889:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:9499:x1874672143597696:12345-0@lo:502: 00000100:00100000:2.0:1787826725.895001:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:9499:x1874672143597696:12345-0@lo:502: Request processed in 113us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.895009:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787826725.895028:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:9499:1874672143597696:0@lo:502: 00000020:01000000:3.0:1787826725.895053:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826725.895057:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826725.895059:0:9499:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787826725.895063:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787826725.895140:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-42 (rc=0) 10000000:01000000:2.0:1787826725.895167:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787826725.895189:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895200:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826725.895210:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787826725.895212:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d5450ee99b8 from 1 10000000:01000000:2.0:1787826725.895238:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787826725.895264:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895279:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895288:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.895299:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143597824:0@lo:101: 00000100:00100000:2.0:1787826725.895323:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.895339:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.895350:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597824 00000100:00100000:2.0:1787826725.895353:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597824 00000100:00100000:2.0:1787826725.895375:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787826725.895382:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143597824:12345-0@lo:101: 00010000:00010000:2.0:1787826725.895390:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826725.895407:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795347a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895427:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795347a expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895437:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795347a expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895445:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350e800, rc 0) 00000100:00100000:2.0:1787826725.895477:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143597824:12345-0@lo:101: Request processed in 95us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.895483:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787826725.895527:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143597824:0@lo:101: 00010000:00010000:2.0:1787826725.895542:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895548:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826725.895594:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143597952:0@lo:501: 00000100:00100000:2.0:1787826725.895619:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826725.895644:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53434459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826725.895657:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143597952 00000100:00100000:3.0:1787826725.895662:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143597952 00000100:00100000:3.0:1787826725.895692:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787826725.895701:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143597952:12345-0@lo:501: 00000100:00100000:3.0:1787826725.895770:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143597952:12345-0@lo:501: Request processed in 70us (149us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826725.895777:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787826725.895801:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143597952:0@lo:501: 10000000:01000000:2.0:1787826725.895828:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787826725.895834:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826725.895844:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787826725.896804:0:8399:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787826725.896810:0:8399:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787826725.896865:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143597440:12345-0@lo:7: Request processed in 6445us (6516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.896875:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787826725.896909:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343474000 x1874672143597440/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826725.896923:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143597440:0@lo:7: 00000004:00080000:3.0:1787826725.896932:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787826725.896955:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143598080:0@lo:5: 00000100:00100000:3.0:1787826725.896981:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.897010:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.897804:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598080 00000100:00100000:0.0:1787826725.897820:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598080 00000100:00100000:0.0:1787826725.897856:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787826725.897864:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143598080:12345-0@lo:5: 00002000:00080000:0.0:1787826725.897885:0:8401:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787826725.897889:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1787826725.900112:0:9467:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787826725.900122:0:9467:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787826725.900190:0:9467:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826725.900252:0:9467:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826725.900273:0:9467:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787826725.900285:0:9467:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000001:00080000:3.0:1787826725.900934:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:3.0:1787826725.900946:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787826725.900952:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000020:00000004:2.0:1787826725.901143:0:9467:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826725.901395:0:9467:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1787826725.901811:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143598080:12345-0@lo:5: Request processed in 3944us (4825us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787826725.901824:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787826725.901848:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343474000 x1874672143598080/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826725.901860:0:9503:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787826725.901867:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143598080:0@lo:5: 00000004:00080000:3.0:1787826725.901890:0:9503:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787826725.901934:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143598208:0@lo:700: 00000100:00100000:3.0:1787826725.901974:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826725.902010:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598208 00000100:00100000:3.0:1787826725.902015:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598208 00000100:00100000:3.0:1787826725.902059:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826725.902069:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143598208:12345-0@lo:700: 00000100:00100000:3.0:1787826725.902238:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3facc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826725.910857:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143598208:12345-0@lo:700: Request processed in 8784us (8877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826725.910875:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787826725.910942:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343474000 x1874672143598208/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826725.910959:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143598208:0@lo:700: 00000004:02000040:2.0:1787826725.913335:0:9503:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787826725.918042:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143598336:0@lo:5: 00000100:00100000:2.0:1787826725.918107:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.918169:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598336 00000100:00100000:2.0:1787826725.918187:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826725.918188:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598336 00000100:00100000:0.0:1787826725.918262:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826725.918271:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143598336:12345-0@lo:5: 00002000:00080000:0.0:1787826725.923349:0:9498:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787826725.923366:0:9498:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1787826725.924956:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143598336:12345-0@lo:5: Request processed in 6681us (6844us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787826725.924967:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787826725.925009:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d54533e4000 x1874672143598336/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826725.925028:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143598336:0@lo:5: 00000004:00080000:2.0:1787826725.925043:0:9503:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1787826725.969304:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143598464:0@lo:41: 00000100:00100000:0.0:1787826725.969370:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826725.969452:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598464 00000100:00100000:0.0:1787826725.969464:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598464 00000100:00100000:0.0:1787826725.969504:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826725.969514:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143598464:12345-0@lo:41: 00000004:00000024:0.0:1787826725.969546:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787826725.969597:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143598464:12345-0@lo:41: Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826725.969605:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826725.969650:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143598464:0@lo:41: 00010000:00010000:3.0:1787826726.097294:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826726.236428:0:9557:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826726.236595:0:9557:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787826726.993458:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826726.993497:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143598592:0@lo:41: 00000100:00100000:2.0:1787826726.993570:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826726.993608:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598592 00000100:00100000:0.0:1787826726.993617:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598592 00000100:00100000:0.0:1787826726.993691:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787826726.993703:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143598592:12345-0@lo:41: 00000004:00000024:0.0:1787826726.993736:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826726.993846:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143598592:12345-0@lo:41: Request processed in 146us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826726.993854:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787826726.993927:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143598592:0@lo:41: 00010000:00010000:3.0:1787826727.121385:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826728.035520:0:9847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787826728.145312:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787826728.364721:0:9899:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826728.364938:0:9899:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:3.0:1787826728.673737:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1787826729.169336:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826729.985905:0:10000:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826729.986039:0:10000:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826730.194428:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787826730.306045:0:10048:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826730.306052:0:10048:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1787826730.445016:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.445073:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134127744 00000100:00100000:2.0:1787826730.445083:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134127744 00000100:00100000:2.0:1787826730.445130:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:2.0:1787826730.445149:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1874672134127744:12345-192.168.203.6@tcp:250: 00010000:00080000:2.0:1787826730.445177:0:6480:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 668c91cd-9397-44b8-9716-665203a7cec4@192.168.203.6@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:2.0:1787826730.445235:0:6480:0:(genops.c:1385:class_connect()) connect: client 668c91cd-9397-44b8-9716-665203a7cec4, cookie 0xc0fefc09a7953488 00000100:00080000:2.0:1787826730.445371:0:6480:0:(import.c:65:import_set_state_nolock()) ffff8d5343504800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826730.445436:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+5:2389:x1874672134127744:12345-192.168.203.6@tcp:250: Request processed in 296us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.445444:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:3.0:1787826730.446175:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.446229:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134127872 00000100:00100000:2.0:1787826730.446236:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134127872 00000100:00100000:2.0:1787826730.446270:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:2.0:1787826730.446278:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+5:6137:x1874672134127872:12345-192.168.203.6@tcp:101: 00010000:00010000:2.0:1787826730.446287:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826730.446302:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346727b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826730.446325:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826730.446336:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826730.446345:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350f200, rc 0) 00000100:00100000:2.0:1787826730.446384:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+6:6137:x1874672134127872:12345-192.168.203.6@tcp:101: Request processed in 106us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.446390:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:0.0:1787826730.447285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.447320:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128000 00000100:00100000:2.0:1787826730.447326:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128000 00000100:00100000:2.0:1787826730.447362:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 149 00000100:00100000:2.0:1787826730.447369:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+6:6137:x1874672134128000:12345-192.168.203.6@tcp:501: 00000100:00100000:2.0:1787826730.447456:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+6:6137:x1874672134128000:12345-192.168.203.6@tcp:501: Request processed in 87us (172us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826730.447471:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 149 00000100:00100000:1.0:1787826730.448705:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826730.448761:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128128 00000100:00100000:3.0:1787826730.448768:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128128 00000100:00100000:3.0:1787826730.448806:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:3.0:1787826730.448814:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+6:6137:x1874672134128128:12345-192.168.203.6@tcp:101: 00010000:00010000:3.0:1787826730.448834:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826730.448848:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467282 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826730.448873:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826730.448901:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826730.448910:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030400, rc 0) 00000100:00100000:3.0:1787826730.448953:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+7:6137:x1874672134128128:12345-192.168.203.6@tcp:101: Request processed in 139us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826730.448960:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:3.0:1787826730.449735:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826730.449781:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128256 00000100:00100000:0.0:1787826730.449787:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128256 00000100:00100000:0.0:1787826730.449817:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:0.0:1787826730.449825:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+7:6137:x1874672134128256:12345-192.168.203.6@tcp:501: 00000100:00100000:0.0:1787826730.449950:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+8:6137:x1874672134128256:12345-192.168.203.6@tcp:501: Request processed in 125us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826730.449957:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:0.0:1787826730.450674:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.450727:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128384 00000100:00100000:2.0:1787826730.450732:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128384 00000100:00100000:2.0:1787826730.450770:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 152 00000100:00100000:2.0:1787826730.450778:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+8:6137:x1874672134128384:12345-192.168.203.6@tcp:503: 00000100:00100000:2.0:1787826730.450871:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+8:6137:x1874672134128384:12345-192.168.203.6@tcp:503: Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.450878:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 152 00000100:00100000:1.0:1787826730.451993:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.452083:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128512 00000100:00100000:2.0:1787826730.452090:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128512 00000100:00100000:2.0:1787826730.452125:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 153 00000100:00100000:2.0:1787826730.452134:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+8:6155:x1874672134128512:12345-192.168.203.6@tcp:502: 00000100:00100000:2.0:1787826730.452257:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+8:6155:x1874672134128512:12345-192.168.203.6@tcp:502: Request processed in 123us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.452264:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 153 00000100:00100000:3.0:1787826730.464886:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.464943:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128640 00000100:00100000:2.0:1787826730.464952:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128640 00000100:00100000:2.0:1787826730.465004:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:2.0:1787826730.465012:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+8:6155:x1874672134128640:12345-192.168.203.6@tcp:502: 00000100:00100000:2.0:1787826730.465156:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+8:6155:x1874672134128640:12345-192.168.203.6@tcp:502: Request processed in 144us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.465164:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:0.0:1787826730.466977:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.467021:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128768 00000100:00100000:2.0:1787826730.467027:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128768 00000100:00100000:2.0:1787826730.467053:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 155 00000100:00100000:2.0:1787826730.467064:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+8:6137:x1874672134128768:12345-192.168.203.6@tcp:101: 00010000:00010000:2.0:1787826730.467082:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826730.467096:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350e600/0xc0fefc09a795349d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34672b3 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826730.467114:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350e600/0xc0fefc09a795349d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672b3 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826730.467121:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350e600/0xc0fefc09a795349d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672b3 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826730.467127:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350e600, rc 0) 00000100:00100000:2.0:1787826730.467174:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+9:6137:x1874672134128768:12345-192.168.203.6@tcp:101: Request processed in 114us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.467180:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 155 00000100:00100000:1.0:1787826730.468624:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826730.468666:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134128896 00000100:00100000:0.0:1787826730.468671:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134128896 00000100:00100000:0.0:1787826730.468697:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 156 00000100:00100000:0.0:1787826730.468702:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+9:6137:x1874672134128896:12345-192.168.203.6@tcp:256: 20000000:01000000:0.0:1787826730.468714:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787826730.468728:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787826730.468731:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787826730.468733:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787826730.468736:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787826730.468737:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787826730.469573:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+9:6137:x1874672134128896:12345-192.168.203.6@tcp:256: Request processed in 853us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826730.469588:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 156 00000100:00100000:3.0:1787826730.470781:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826730.470870:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129024 00000100:00100000:0.0:1787826730.470879:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129024 00000100:00100000:0.0:1787826730.471010:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 157 00000100:00100000:0.0:1787826730.471021:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+9:6137:x1874672134129024:12345-192.168.203.6@tcp:101: 00010000:00010000:0.0:1787826730.471049:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826730.471182:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34672ba expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826730.471309:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 10 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826730.471334:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 10 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826730.471356:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80a00, rc 0) 00000100:00100000:0.0:1787826730.471406:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6137:x1874672134129024:12345-192.168.203.6@tcp:101: Request processed in 387us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826730.471412:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 157 00000100:00100000:1.0:1787826730.472283:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.472336:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129152 00000100:00100000:2.0:1787826730.472344:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129152 00000100:00100000:2.0:1787826730.472379:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 158 00000100:00100000:2.0:1787826730.472385:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:6137:x1874672134129152:12345-192.168.203.6@tcp:501: 00000100:00100000:2.0:1787826730.472520:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:6137:x1874672134129152:12345-192.168.203.6@tcp:501: Request processed in 133us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.472530:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 158 00000100:00100000:3.0:1787826730.473185:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.473232:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129280 00000100:00100000:2.0:1787826730.473237:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129280 00000100:00100000:2.0:1787826730.473261:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 159 00000100:00100000:2.0:1787826730.473268:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:6137:x1874672134129280:12345-192.168.203.6@tcp:503: 00000100:00100000:2.0:1787826730.473348:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:6137:x1874672134129280:12345-192.168.203.6@tcp:503: Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.473365:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 159 00000100:00100000:3.0:1787826730.474368:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826730.474443:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129408 00000100:00100000:0.0:1787826730.474451:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129408 00000100:00100000:0.0:1787826730.474553:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 160 00000100:00100000:0.0:1787826730.474582:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:6159:x1874672134129408:12345-192.168.203.6@tcp:502: 00000100:00100000:0.0:1787826730.474858:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:6159:x1874672134129408:12345-192.168.203.6@tcp:502: Request processed in 294us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826730.474866:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 160 00000100:00100000:1.0:1787826730.475829:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826730.475881:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129536 00000100:00100000:0.0:1787826730.475890:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129536 00000100:00100000:0.0:1787826730.475932:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 161 00000100:00100000:0.0:1787826730.475942:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6159:x1874672134129536:12345-192.168.203.6@tcp:502: 00000100:00100000:0.0:1787826730.476057:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6159:x1874672134129536:12345-192.168.203.6@tcp:502: Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826730.476065:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 161 00000100:00100000:3.0:1787826730.477331:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826730.477397:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129664 00000100:00100000:2.0:1787826730.477404:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129664 00000100:00100000:2.0:1787826730.477442:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:2.0:1787826730.477448:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53434743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1874672134129664:12345-192.168.203.6@tcp:38: 00010000:00080000:2.0:1787826730.477469:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 623ddf66-2f94-46d4-a38e-7bde7caf88c3@192.168.203.6@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:2.0:1787826730.477519:0:6485:0:(genops.c:1385:class_connect()) connect: client 623ddf66-2f94-46d4-a38e-7bde7caf88c3, cookie 0xc0fefc09a79534ab 00000004:00100000:2.0:1787826730.477547:0:6485:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787826730.477675:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826730.477738:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129920 00000100:00100000:3.0:1787826730.477743:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129920 00000100:00100000:3.0:1787826730.477772:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:3.0:1787826730.477777:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1874672134129920:12345-192.168.203.6@tcp:38: 00000100:00080000:2.0:1787826730.477789:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d5478965000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1787826730.477796:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 623ddf66-2f94-46d4-a38e-7bde7caf88c3@192.168.203.6@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:3.0:1787826730.477840:0:6487:0:(genops.c:1385:class_connect()) connect: client 623ddf66-2f94-46d4-a38e-7bde7caf88c3, cookie 0xc0fefc09a79534b2 00000100:00100000:2.0:1787826730.477844:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53434743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2389:x1874672134129664:12345-192.168.203.6@tcp:38: Request processed in 392us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826730.477854:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00000004:00100000:3.0:1787826730.477857:0:6487:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787826730.478051:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8d534390d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826730.478089:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2389:x1874672134129920:12345-192.168.203.6@tcp:38: Request processed in 309us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826730.478097:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:0.0:1787826731.089406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143598720:0@lo:13: 00000100:00100000:3.0:1787826731.089415:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143599104:0@lo:400: 00000100:00100000:1.0:1787826731.089424:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143599360:0@lo:400: 00000100:00080000:2.0:1787826731.089455:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787826731.089462:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787826731.089466:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d53434cf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826731.089472:0:471:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 100 00000100:00080000:2.0:1787826731.089478:0:471:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826731.089485:0:471:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d53434cf000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826731.089492:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826731.089494:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826731.089496:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.089513:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547d354000 x1874672143600128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826731.089548:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787826731.089552:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787826731.089554:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826731.089560:0:471:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d534380b800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826731.089583:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143598976:0@lo:41: 00000100:00100000:2.0:1787826731.089585:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547d354f00 x1874672143600512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826731.089592:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143599488:0@lo:400: 00000100:00100000:1.0:1787826731.089592:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143599872:0@lo:400: 00000100:00100000:3.0:1787826731.089613:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.089624:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143599232:0@lo:400: 00000100:00100000:3.0:1787826731.089639:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143598848:0@lo:13: 00000100:00100000:1.0:1787826731.089642:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826731.089656:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143599360 00000100:00100000:0.0:1787826731.089662:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143599360 00000100:00100000:2.0:1787826731.089670:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826731.089687:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.089702:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143599744:0@lo:400: 00000100:00100000:1.0:1787826731.089710:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598720 00000100:00100000:0.0:1787826731.089713:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598976 00000100:00100000:1.0:1787826731.089716:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598720 00000100:00100000:0.0:1787826731.089719:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598976 00000100:00100000:3.0:1787826731.089724:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143599616:0@lo:400: 00000100:00100000:2.0:1787826731.089738:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826731.089742:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787826731.089751:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143599360:12345-0@lo:400: 00000100:00100000:1.0:1787826731.089759:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143598848 00000100:00100000:1.0:1787826731.089765:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143598848 00000100:00100000:2.0:1787826731.089769:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143600384:0@lo:400: 00000100:00100000:3.0:1787826731.089777:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826731.089808:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143600256:0@lo:400: 00000100:00100000:1.0:1787826731.089818:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826731.089821:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826731.089833:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143599360:12345-0@lo:400: Request processed in 80us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826731.089833:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143598720:12345-0@lo:13: 00000100:00100000:3.0:1787826731.089847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826731.089851:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787826731.089860:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787826731.089868:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826731.089878:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143599616 00000100:00100000:2.0:1787826731.089878:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143599872 00000100:00100000:0.0:1787826731.089883:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143599616 00000100:00100000:2.0:1787826731.089885:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143599872 00000100:00100000:3.0:1787826731.089890:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143600128:0@lo:8: 00000100:00100000:0.0:1787826731.089902:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826731.089910:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143598976:12345-0@lo:41: 00000100:00100000:1.0:1787826731.089916:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143598720:12345-0@lo:13: Request processed in 89us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826731.089926:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00000024:0.0:1787826731.089935:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787826731.089939:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143599232 00000100:00100000:2.0:1787826731.089943:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143599232 00000100:00100000:3.0:1787826731.089946:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826731.089951:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826731.089971:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143598848:12345-0@lo:13: 00000100:00100000:2.0:1787826731.089972:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143599744 00000100:00100000:3.0:1787826731.089976:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143600512:0@lo:8: 00000100:00100000:2.0:1787826731.089978:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143599744 00002000:00000024:1.0:1787826731.089986:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826731.089992:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143598976:12345-0@lo:41: Request processed in 81us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.090001:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787826731.090002:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600384 00000100:00100000:2.0:1787826731.090006:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600384 00000100:00100000:3.0:1787826731.090017:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826731.090023:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787826731.090032:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600256 00000100:00100000:1.0:1787826731.090033:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143598848:12345-0@lo:13: Request processed in 72us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.090035:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143599616:12345-0@lo:400: 00000100:00100000:2.0:1787826731.090037:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600256 00000100:00100000:1.0:1787826731.090048:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787826731.090065:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787826731.090071:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600128 00000100:00100000:2.0:1787826731.090077:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143599872:12345-0@lo:400: 00000100:00100000:3.0:1787826731.090078:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600128 00000100:00100000:1.0:1787826731.090084:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826731.090090:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143599616:12345-0@lo:400: Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826731.090097:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143599232:12345-0@lo:400: 00000100:00100000:0.0:1787826731.090100:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826731.090112:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600512 00000100:00100000:3.0:1787826731.090116:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600512 00000100:00100000:2.0:1787826731.090128:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143599872:12345-0@lo:400: Request processed in 54us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.090129:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787826731.090151:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787826731.090154:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787826731.090160:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787826731.090168:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143600128:12345-0@lo:8: 00000100:00100000:0.0:1787826731.090175:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.090179:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787826731.090181:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143599232:12345-0@lo:400: Request processed in 87us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826731.090190:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787826731.090194:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 105 last 0 00000100:00100000:0.0:1787826731.090197:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143600000:0@lo:400: 00000100:00100000:2.0:1787826731.090200:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143599744:12345-0@lo:400: 00000100:00100000:1.0:1787826731.090207:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143599488 00000100:00100000:1.0:1787826731.090212:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143599488 00000020:00000080:3.0:1787826731.090254:0:8402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc0fefc09a79534b9 00000100:00100000:0.0:1787826731.090255:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826731.090261:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787826731.090271:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143600384:12345-0@lo:400: 00002000:00100000:3.0:1787826731.090271:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d534390b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787826731.090280:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787826731.090285:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:0.0:1787826731.090289:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343474f00 x1874672143598720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826731.090294:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143599744:12345-0@lo:400: Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.090309:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787826731.090315:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143600384:12345-0@lo:400: Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826731.090316:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787826731.090326:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826731.090338:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143598720:0@lo:13: 00000100:00100000:2.0:1787826731.090339:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00002000:00100000:3.0:1787826731.090345:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787826731.090348:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787826731.090352:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143600256:12345-0@lo:400: 00000100:00100000:1.0:1787826731.090362:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143599488:12345-0@lo:400: 00010000:00080000:0.0:1787826731.090383:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d354b40 x1874672143599872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826731.090403:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143599872:0@lo:400: 00000100:00100000:2.0:1787826731.090406:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143600256:12345-0@lo:400: Request processed in 56us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826731.090416:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787826731.090423:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143599488:12345-0@lo:400: Request processed in 65us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.090430:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143599360:0@lo:400: 00000100:00100000:1.0:1787826731.090433:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787826731.090436:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826731.090442:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826731.090466:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143599104 00000100:00100000:2.0:1787826731.090470:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143599104 00010000:00080000:0.0:1787826731.090487:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d357840 x1874672143599232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826731.090497:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143599232:0@lo:400: 00000100:00100000:2.0:1787826731.090507:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00010000:00080000:0.0:1787826731.090512:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d357480 x1874672143599744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826731.090519:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3619:x1874672143599104:12345-0@lo:400: 00000100:00100000:0.0:1787826731.090525:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143599744:0@lo:400: 00010000:00080000:1.0:1787826731.090545:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d3561c0 x1874672143599488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826731.090551:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356d00 x1874672143600384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826731.090565:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143599488:0@lo:400: 00000100:00100000:2.0:1787826731.090565:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3619:x1874672143599104:12345-0@lo:400: Request processed in 47us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.090569:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143600384:0@lo:400: 00000100:00100000:2.0:1787826731.090582:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787826731.090646:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600000 00000100:00100000:2.0:1787826731.090651:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600000 00000100:00100000:1.0:1787826731.090653:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826731.090662:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143599616:0@lo:400: 00000100:00100000:1.0:1787826731.090662:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143600512:12345-0@lo:8: 00000100:00100000:2.0:1787826731.090673:0:9498:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00002000:00080000:3.0:1787826731.090677:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:2.0:1787826731.090680:0:9498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:0.0:1787826731.090684:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d355a40 x1874672143600256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826731.090686:0:8401:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 105 last 0 00000100:00100000:2.0:1787826731.090695:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787826731.090700:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143600256:0@lo:400: 00000100:00100000:2.0:1787826731.090705:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787826731.090706:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d534390e000 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1787826731.090713:0:8401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0fefc09a79534c0 00000100:00100000:2.0:1787826731.090717:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143600000:12345-0@lo:400: 00000100:00100000:0.0:1787826731.090718:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143599104:0@lo:400: 00002000:00100000:1.0:1787826731.090724:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d547f762000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787826731.090730:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787826731.090732:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787826731.090738:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143598976:0@lo:41: 00000100:00100000:3.0:1787826731.090765:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3615:x1874672143600128:12345-0@lo:8: Request processed in 595us (819us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826731.090770:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5341f60780 x1874672143598848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1787826731.090772:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1787826731.090774:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143600000:12345-0@lo:400: Request processed in 58us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826731.090778:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826731.090791:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:1.0:1787826731.090792:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8d547f761000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826731.090792:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826731.090815:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143598848:0@lo:13: 00010000:00080000:3.0:1787826731.090819:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d354000 x1874672143600128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826731.090834:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1874672143600512:12345-0@lo:8: Request processed in 172us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826731.090835:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826731.090844:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00100000:1.0:1787826731.090845:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787826731.090852:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787826731.090860:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787826731.090864:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53434cf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787826731.090882:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00080000:2.0:1787826731.090888:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d3570c0 x1874672143600000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826731.090891:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143600128:0@lo:8: 00000004:00080000:0.0:1787826731.090911:0:9487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1787826731.090913:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d354f00 x1874672143600512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826731.090916:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143600000:0@lo:400: 00000100:00080000:3.0:1787826731.090931:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787826731.090936:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787826731.090940:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787826731.090943:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787826731.090965:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787826731.090969:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143600512:0@lo:8: 00000004:00080000:0.0:1787826731.090972:0:9487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 105953755746ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787826731.090981:0:9487:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787826731.091022:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143600640:0@lo:700: 00000004:00080000:2.0:1787826731.091025:0:9504:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787826731.091058:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.091083:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600640 00000100:00100000:3.0:1787826731.091083:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442c86a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826731.091089:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600640 00000100:00080000:3.0:1787826731.091113:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826731.091125:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826731.091133:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9488:x1874672143600640:12345-0@lo:700: 00000004:00080000:0.0:1787826731.091173:0:9504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 105953957599ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787826731.091178:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8408:1874672143600768:0@lo:700: 00080000:00080000:0.0:1787826731.091183:0:9504:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787826731.091239:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.091256:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e1d2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826731.091489:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600768 00000100:00100000:0.0:1787826731.091494:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600768 00000100:00100000:0.0:1787826731.091530:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826731.091538:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8408:x1874672143600768:12345-0@lo:700: 00000004:00080000:1.0:1787826731.092090:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:1.0:1787826731.092110:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000001:00100000:3.0:1787826731.092172:0:6464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000004:00080000:1.0:1787826731.092269:0:9506:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787826731.092284:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143600896:0@lo:13: 00000100:00100000:1.0:1787826731.092289:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143601024:0@lo:7: 00000100:00100000:0.0:1787826731.092328:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826731.092334:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826731.092359:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826731.092384:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143600896 00000100:00100000:0.0:1787826731.092387:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601024 00000100:00100000:3.0:1787826731.092390:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143600896 00000100:00100000:0.0:1787826731.092393:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601024 00000100:00080000:2.0:1787826731.092433:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826731.092434:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787826731.092447:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:9506:x1874672143601024:12345-0@lo:7: 00000100:00100000:3.0:1787826731.092452:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787826731.092463:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1874672143600896:12345-0@lo:13: 00002000:00000024:3.0:1787826731.092480:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787826731.092522:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1874672143600896:12345-0@lo:13: Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826731.092528:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787826731.092554:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386c000 x1874672143600896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826731.092575:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143600896:0@lo:13: 00000004:00080000:3.0:1787826731.094378:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787826731.094454:0:6493:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00002000:00080000:0.0:1787826731.096342:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787826731.096350:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787826731.096440:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9506:x1874672143601024:12345-0@lo:7: Request processed in 3993us (4104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.096451:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787826731.096488:0:9506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386da40 x1874672143601024/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826731.096503:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143601024:0@lo:7: 00000004:00080000:2.0:1787826731.096517:0:9506:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787826731.096556:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143601152:0@lo:5: 00000100:00100000:2.0:1787826731.096590:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.096616:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e1d2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826731.096653:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601152 00000100:00100000:0.0:1787826731.096660:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601152 00000100:00100000:0.0:1787826731.096721:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787826731.096731:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9506:x1874672143601152:12345-0@lo:5: 00002000:00080000:0.0:1787826731.096754:0:8401:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787826731.096758:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1787826731.099305:0:9469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787826731.099321:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787826731.099325:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787826731.099492:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9506:x1874672143601152:12345-0@lo:5: Request processed in 2759us (2898us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787826731.099522:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787826731.099529:0:9506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356940 x1874672143601152/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826731.099539:0:9506:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787826731.099546:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143601152:0@lo:5: 00000100:00100000:1.0:1787826731.099569:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8408:x1874672143600768:12345-0@lo:700: Request processed in 8030us (8354us total) trans 0 rc 0/0 00000004:00080000:2.0:1787826731.099570:0:9506:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787826731.099607:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826731.099617:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143601280:0@lo:700: 00000100:00100000:2.0:1787826731.099650:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.099679:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e1d2b40 going to sleep for 11 seconds 00010000:00080000:3.0:1787826731.099744:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d3570c0 x1874672143600768/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826731.099757:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601280 00000100:00100000:3.0:1787826731.099758:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8408:1874672143600768:0@lo:700: 00000100:00100000:0.0:1787826731.099763:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601280 40000000:02000000:3.0:1787826731.099769:0:8408:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1787826731.099795:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826731.099801:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9506:x1874672143601280:12345-0@lo:700: 00000100:00100000:3.0:1787826731.109972:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9488:x1874672143600640:12345-0@lo:700: Request processed in 18834us (18909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826731.109983:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787826731.110020:0:9488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d36ed00 x1874672143600640/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826731.110032:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143600640:0@lo:700: 00000004:00080000:1.0:1787826731.112773:0:9488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787826731.112793:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826731.112800:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143601536:0@lo:7: 00000100:00100000:0.0:1787826731.112811:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143601408:0@lo:13: 00000100:00100000:1.0:1787826731.112862:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826731.112864:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826731.112918:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826731.112921:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601536 00000100:00100000:2.0:1787826731.112930:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601536 00000100:00100000:3.0:1787826731.112950:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601408 00000100:00100000:3.0:1787826731.112956:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601408 00000100:00100000:2.0:1787826731.112980:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787826731.112989:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:9488:x1874672143601536:12345-0@lo:7: 00000100:00100000:3.0:1787826731.112995:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787826731.113005:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143601408:12345-0@lo:13: 00002000:00000024:3.0:1787826731.113022:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787826731.113062:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143601408:12345-0@lo:13: Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826731.113070:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787826731.113132:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386c000 x1874672143601408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826731.113166:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143601408:0@lo:13: 00000100:00100000:0.0:1787826731.115531:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9506:x1874672143601280:12345-0@lo:700: Request processed in 15724us (15875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.115544:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787826731.115576:0:9506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356940 x1874672143601280/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826731.115590:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143601280:0@lo:700: 00002000:00080000:2.0:1787826731.116984:0:10061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787826731.116990:0:10061:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787826731.117043:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:9488:x1874672143601536:12345-0@lo:7: Request processed in 4055us (4185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826731.117052:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787826731.117107:0:9488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386cf00 x1874672143601536/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826731.117119:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143601536:0@lo:7: 00000004:00080000:1.0:1787826731.117130:0:9488:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787826731.117173:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143601664:0@lo:5: 00000100:00100000:1.0:1787826731.117208:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826731.117292:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826731.117295:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601664 00000100:00100000:0.0:1787826731.117303:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601664 00000100:00100000:0.0:1787826731.117349:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787826731.117366:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9488:x1874672143601664:12345-0@lo:5: 00002000:00080000:0.0:1787826731.117392:0:8402:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787826731.117450:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9488:x1874672143601664:12345-0@lo:5: Request processed in 85us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.117457:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787826731.117516:0:9488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386cf00 x1874672143601664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826731.117527:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143601664:0@lo:5: 00000004:00080000:1.0:1787826731.117546:0:9488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787826731.117570:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143601792:0@lo:5: 00000100:00100000:1.0:1787826731.117593:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826731.117617:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826731.117734:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601792 00000100:00100000:0.0:1787826731.117738:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601792 00000100:00100000:0.0:1787826731.117767:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826731.117774:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9488:x1874672143601792:12345-0@lo:5: 00002000:00080000:0.0:1787826731.117802:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:02000040:3.0:1787826731.117990:0:9506:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1787826731.119112:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9488:x1874672143601792:12345-0@lo:5: Request processed in 1336us (1515us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787826731.119118:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787826731.119166:0:9488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386cf00 x1874672143601792/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826731.119180:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9488:1874672143601792:0@lo:5: 00000004:00080000:2.0:1787826731.119194:0:9488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787826731.119248:0:9488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9488:1874672143601920:0@lo:900: 00000100:00100000:2.0:1787826731.119278:0:9488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826731.119297:0:9488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e1d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826731.119298:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143601920 00000100:00100000:0.0:1787826731.119304:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143601920 00000100:00100000:0.0:1787826731.119339:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826731.119347:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9488:x1874672143601920:12345-0@lo:900: 00000100:00100000:0.0:1787826731.119391:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9488:x1874672143601920:12345-0@lo:900: Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.119398:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787826731.119414:0:9488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d357c00 x1874672143601920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826731.119422:0:9488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9488:1874672143601920:0@lo:900: 00000100:00100000:3.0:1787826731.121185:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143602048:0@lo:5: 00000100:00100000:3.0:1787826731.121260:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826731.121292:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442c86e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826731.121312:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143602048 00000100:00100000:2.0:1787826731.121319:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143602048 00000100:00100000:2.0:1787826731.121366:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787826731.121375:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:9506:x1874672143602048:12345-0@lo:5: 00002000:00080000:2.0:1787826731.124008:0:10061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787826731.124022:0:10061:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787826731.125093:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:9506:x1874672143602048:12345-0@lo:5: Request processed in 3715us (3829us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787826731.125104:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787826731.125160:0:9506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d36c780 x1874672143602048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787826747 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826731.125175:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9506:1874672143602048:0@lo:5: 00000004:00080000:3.0:1787826731.125187:0:9506:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1787826731.217351:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826731.478583:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826731.478628:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826731.478659:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134129792 00000100:00100000:2.0:1787826731.478669:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134129792 00000100:00100000:3.0:1787826731.478718:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130176 00000100:00100000:3.0:1787826731.478723:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130176 00000100:00100000:2.0:1787826731.478738:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00080000:0.0:1787826731.478747:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826731.478758:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:0:x1874672134129792:12345-192.168.203.6@tcp:41: 00000100:00100000:1.0:1787826731.478789:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000004:00000024:2.0:1787826731.478801:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787826731.478830:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130048 00000100:00100000:0.0:1787826731.478836:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130048 00000100:00100000:2.0:1787826731.478865:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:0:x1874672134129792:12345-192.168.203.6@tcp:41: Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826731.478897:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:3.0:1787826731.478913:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:0.0:1787826731.478923:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:0.0:1787826731.478936:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:0:x1874672134130048:12345-192.168.203.6@tcp:41: 00000100:00080000:1.0:1787826731.478949:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1787826731.478957:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826731.478990:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:0:x1874672134130048:12345-192.168.203.6@tcp:41: Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.479000:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:3.0:1787826731.479001:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130176:12345-192.168.203.6@tcp:41: 00000004:00000024:3.0:1787826731.479015:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787826731.479144:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130176:12345-192.168.203.6@tcp:41: Request processed in 210us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826731.479151:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:1.0:1787826731.479860:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826731.479913:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130304 00000100:00100000:2.0:1787826731.479919:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130304 00000100:00100000:2.0:1787826731.479953:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:2.0:1787826731.479970:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130304:12345-192.168.203.6@tcp:40: 00000100:00100000:2.0:1787826731.480013:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130304:12345-192.168.203.6@tcp:40: Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826731.480020:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:1.0:1787826731.480735:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826731.480763:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826731.480789:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130432 00000100:00100000:1.0:1787826731.480795:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826731.480796:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130432 00000100:00100000:2.0:1787826731.480819:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130816 00000100:00100000:2.0:1787826731.480823:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130816 00000100:00100000:0.0:1787826731.480831:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:1.0:1787826731.480833:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826731.480840:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134130432:12345-192.168.203.6@tcp:8: 00000100:00100000:2.0:1787826731.480858:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 4 00010000:00080000:0.0:1787826731.480866:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 623ddf66-2f94-46d4-a38e-7bde7caf88c3@192.168.203.6@tcp t0 exp 0000000000000000 cur 106 last 0 00000100:00100000:1.0:1787826731.480868:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130688 00000100:00100000:2.0:1787826731.480868:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130816:12345-192.168.203.6@tcp:900: 00000100:00100000:1.0:1787826731.480874:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130688 00000100:00100000:3.0:1787826731.480882:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130560 00000100:00100000:3.0:1787826731.480888:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130560 00000100:00100000:1.0:1787826731.480906:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:1.0:1787826731.480915:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134130688:12345-192.168.203.6@tcp:8: 00000020:00000080:0.0:1787826731.480917:0:8402:0:(genops.c:1385:class_connect()) connect: client 623ddf66-2f94-46d4-a38e-7bde7caf88c3, cookie 0xc0fefc09a79534c7 00000100:00100000:2.0:1787826731.480917:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130816:12345-192.168.203.6@tcp:900: Request processed in 50us (151us total) trans 0 rc 0/0 00010000:00080000:1.0:1787826731.480934:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 623ddf66-2f94-46d4-a38e-7bde7caf88c3@192.168.203.6@tcp t0 exp 0000000000000000 cur 106 last 0 00000100:00100000:3.0:1787826731.480940:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 163 00000100:00100000:2.0:1787826731.480941:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1787826731.480953:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134130560:12345-192.168.203.6@tcp:400: 00000020:00000080:1.0:1787826731.480959:0:8399:0:(genops.c:1385:class_connect()) connect: client 623ddf66-2f94-46d4-a38e-7bde7caf88c3, cookie 0xc0fefc09a79534ce 00002000:00100000:1.0:1787826731.480971:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 623ddf66-2f94-46d4-a38e-7bde7caf88c3/ffff8d547f760000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787826731.480975:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 623ddf66-2f94-46d4-a38e-7bde7caf88c3/ffff8d534351c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787826731.480981:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:0.0:1787826731.480984:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787826731.480989:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134130560:12345-192.168.203.6@tcp:400: Request processed in 37us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826731.480997:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 163 00002000:00080000:1.0:1787826731.481246:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787826731.481274:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d547f767800 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1787826731.481281:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787826731.481301:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d5343518000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826731.481329:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2389:x1874672134130688:12345-192.168.203.6@tcp:8: Request processed in 414us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826731.481332:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2389:x1874672134130432:12345-192.168.203.6@tcp:8: Request processed in 491us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826731.481343:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:0.0:1787826731.481354:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:1.0:1787826731.481803:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826731.481877:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134130944 00000100:00100000:0.0:1787826731.481883:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134130944 00000100:00100000:0.0:1787826731.481910:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:0.0:1787826731.481917:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130944:12345-192.168.203.6@tcp:33: 00000004:00080000:2.0:1787826731.490756:0:6488:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8781us 00000004:00200000:2.0:1787826731.495732:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787826731.495829:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6137:x1874672134130944:12345-192.168.203.6@tcp:33: Request processed in 13906us (14021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826731.495853:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:2.0:1787826731.561836:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826731.561911:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131072 00000100:00100000:1.0:1787826731.561920:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131072 00000100:00100000:1.0:1787826731.561978:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:1.0:1787826731.561989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6177:x1874672134131072:12345-192.168.203.6@tcp:101: 00010000:00010000:1.0:1787826731.562010:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826731.562090:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167d800/0xc0fefc09a79534d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34672eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826731.562166:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167dc00/0xc0fefc09a79534dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826731.562178:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167dc00/0xc0fefc09a79534dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826731.562189:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167dc00/0xc0fefc09a79534dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826731.562265:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826731.562269:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826731.562284:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167dc00/0xc0fefc09a79534dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826731.562308:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167d800/0xc0fefc09a79534d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672eb expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826731.562323:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167dc00/0xc0fefc09a79534dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672eb expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826731.562342:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d545a81ed00) 00010000:00010000:1.0:1787826731.562345:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826731.562348:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544167dc00, rc 0) 00000100:00100000:1.0:1787826731.562425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:6177:x1874672134131072:12345-192.168.203.6@tcp:101: Request processed in 435us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826731.562433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:3.0:1787826732.113386:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826732.113408:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143602176:0@lo:41: 00000100:00100000:3.0:1787826732.113458:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826732.113500:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143602176 00000100:00100000:2.0:1787826732.113507:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143602176 00000100:00100000:2.0:1787826732.113552:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787826732.113563:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143602176:12345-0@lo:41: 00000004:00000024:2.0:1787826732.113585:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826732.113642:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143602176:12345-0@lo:41: Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826732.113655:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787826732.113677:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143602176:0@lo:41: 00010000:00010000:3.0:1787826732.241379:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826732.975056:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826732.975104:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131200 00000100:00100000:3.0:1787826732.975113:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131200 00000100:00100000:3.0:1787826732.975183:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:3.0:1787826732.975195:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6229:x1874672134131200:12345-192.168.203.6@tcp:41: 00000004:00000024:3.0:1787826732.975257:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826732.975309:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:6229:x1874672134131200:12345-192.168.203.6@tcp:41: Request processed in 119us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826732.975314:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:0.0:1787826732.976783:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826732.976839:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131328 00000100:00100000:1.0:1787826732.976846:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131328 00000100:00080000:0.0:1787826732.976900:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826732.976908:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:1.0:1787826732.976918:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:6229:x1874672134131328:12345-192.168.203.6@tcp:13: 00002000:00000024:1.0:1787826732.976942:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826732.976994:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:6229:x1874672134131328:12345-192.168.203.6@tcp:13: Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826732.977001:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:2.0:1787826732.977718:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826732.977762:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131456 00000100:00100000:1.0:1787826732.977767:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131456 00000100:00080000:0.0:1787826732.977817:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826732.977823:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:1.0:1787826732.977832:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:6229:x1874672134131456:12345-192.168.203.6@tcp:13: 00002000:00000024:1.0:1787826732.977847:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826732.977888:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:6229:x1874672134131456:12345-192.168.203.6@tcp:13: Request processed in 56us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826732.977895:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00010000:00010000:1.0:1787826733.266324:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826734.008571:0:10147:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787826734.289368:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787826735.185719:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826735.185725:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 6 10000000:01000000:2.0:1787826735.185730:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826735.185773:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.185785:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.185796:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.185847:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602304:0@lo:101: 00000100:00100000:2.0:1787826735.185911:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826735.185961:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53436c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826735.186262:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143602304 00000100:00100000:0.0:1787826735.186271:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143602304 00000100:00100000:0.0:1787826735.186319:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787826735.186328:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143602304:12345-0@lo:101: 00010000:00010000:0.0:1787826735.186351:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826735.186363:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79534e3 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.186386:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.186398:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.186418:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80c00, rc 0) 00000100:00100000:0.0:1787826735.186464:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143602304:12345-0@lo:101: Request processed in 138us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826735.186471:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787826735.187590:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602304:0@lo:101: 00010000:00010000:2.0:1787826735.187609:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.187626:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.187686:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602432:0@lo:256: 00000100:00100000:2.0:1787826735.187732:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826735.187770:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53436c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826735.187920:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143602432 00000100:00100000:0.0:1787826735.187926:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143602432 00000100:00100000:0.0:1787826735.187965:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787826735.187973:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143602432:12345-0@lo:256: 20000000:01000000:0.0:1787826735.187988:0:9479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826735.188004:0:9479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826735.188007:0:9479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787826735.188083:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143602432:12345-0@lo:256: Request processed in 110us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826735.188090:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787826735.188419:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602432:0@lo:256: 10000000:01000000:2.0:1787826735.188480:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826735.188488:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.188497:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826735.188507:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826735.188509:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 6 10000000:01000000:2.0:1787826735.188512:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826735.188532:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.188549:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.188559:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.188571:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602560:0@lo:101: 00000100:00100000:2.0:1787826735.188599:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826735.188632:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53436c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826735.188691:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143602560 00000100:00100000:0.0:1787826735.188696:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143602560 00000100:00100000:0.0:1787826735.188885:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787826735.188894:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143602560:12345-0@lo:101: 00010000:00010000:0.0:1787826735.188903:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826735.188914:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79534f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.188934:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.188944:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.188964:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c81000, rc 0) 00000100:00100000:0.0:1787826735.188996:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143602560:12345-0@lo:101: Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826735.189002:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787826735.189073:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602560:0@lo:101: 00010000:00010000:1.0:1787826735.189093:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.189102:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.189159:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602688:0@lo:256: 00000100:00100000:1.0:1787826735.189191:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826735.191320:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826735.191332:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143602688 00000100:00100000:2.0:1787826735.191341:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143602688 00000100:00100000:3.0:1787826735.191422:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787826735.191526:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143602688:12345-0@lo:256: 20000000:01000000:3.0:1787826735.191559:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787826735.191680:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787826735.191684:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787826735.191828:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143602688:12345-0@lo:256: Request processed in 393us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826735.191838:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787826735.191873:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143602688:0@lo:256: 10000000:01000000:1.0:1787826735.191956:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826735.191965:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.191975:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.315116:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826735.406823:0:10295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe79affd70 20000000:00000080:3.0:1787826735.406840:0:10295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d5343692c00 uarg=0000000000000000 20000000:01000000:3.0:1787826735.406881:0:10295:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787826735.406883:0:10295:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787826735.406885:0:10295:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787826735.406890:0:10295:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787826735.406894:0:10295:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787826735.406951:0:10295:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787826735.406954:0:10295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787826735.407871:0:10296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787826735.408164:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787826735.408190:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787826735.408204:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1787826735.408292:0:10295:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787826735.408295:0:10295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787826735.409364:0:10297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1787826735.409550:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1787826735.409587:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1787826735.409610:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1787826735.409625:0:10295:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787826735.409628:0:10295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787826735.410020:0:10298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1787826735.410273:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1787826735.410293:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1787826735.410308:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1787826735.410314:0:10295:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787826735.410316:0:10295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787826735.410548:0:10299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1787826735.410666:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1787826735.410690:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1787826735.410708:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1787826735.410717:0:10295:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787826735.410720:0:10295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787826735.410962:0:10300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787826735.411051:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787826735.411074:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787826735.411090:0:10295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:3.0:1787826735.411103:0:10295:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787826735.411135:0:10295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411153:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411161:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795334d expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411177:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795335b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411184:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411201:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411207:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411238:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411246:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411253:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795347a expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411261:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411268:0:10295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411276:0:10295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411320:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411334:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 9 pid: 6479 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826735.411350:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143602816:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787826735.411458:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411467:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 9 pid: 6478 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826735.411474:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143602944:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787826735.411521:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795347a expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411528:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795347a expref: 23 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826735.411535:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603072:0@lo:104: 00000100:00100000:3.0:1787826735.411569:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826735.411598:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.411611:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 23 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826735.411628:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603200:0@lo:104: 00010000:00010000:3.0:1787826735.411660:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.411663:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787826735.411670:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 23 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826735.411683:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603328:0@lo:104: 00000100:00100000:0.0:1787826735.411688:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826735.411722:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603072 00000100:00100000:3.0:1787826735.411722:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826735.411729:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603072 00000100:00100000:1.0:1787826735.411741:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603200 00000100:00100000:1.0:1787826735.411748:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603200 00000100:00100000:3.0:1787826735.411756:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603328 00000100:00100000:3.0:1787826735.411762:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603328 00000100:00100000:0.0:1787826735.411778:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787826735.411787:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787826735.411792:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534277b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10295:x1874672143603072:12345-0@lo:104: 00000100:00100000:1.0:1787826735.411799:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10295:x1874672143603200:12345-0@lo:104: 00010000:00010000:0.0:1787826735.411808:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.411809:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.411877:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826735.411884:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534277b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10295:x1874672143603072:12345-0@lo:104: Request processed in 98us (314us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826735.411888:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787826735.411895:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787826735.411897:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10295:x1874672143603200:12345-0@lo:104: Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826735.411908:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787826735.411955:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826735.411958:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826735.411963:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.411964:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.411974:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.411986:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350fc00 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:1.0:1787826735.411987:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350e200 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:2.0:1787826735.411993:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 23 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826735.411996:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826735.411996:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.412008:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603456:0@lo:104: 00010000:00010000:1.0:1787826735.412015:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.412026:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826735.412027:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.412042:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787826735.412047:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1787826735.412049:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826735.412058:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826735.412070:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.412085:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 23 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.412093:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603584:0@lo:104: 00000100:00100000:2.0:1787826735.412128:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826735.412134:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.412143:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826735.412147:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412154:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826735.412164:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412166:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412172:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d534350e200/0xc0fefc09a7953426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795342d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.412174:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.412196:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d534350fc00/0xc0fefc09a795347a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953481 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412197:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826735.412197:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 23 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412200:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826735.412203:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826735.412244:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603968:0@lo:104: 00000100:00100000:1.0:1787826735.412249:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143603712:0@lo:103: 00010000:00010000:0.0:1787826735.412251:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826735.412255:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826735.412259:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826735.412273:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143603840:0@lo:103: 00000100:00100000:2.0:1787826735.412277:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826735.412294:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826735.412320:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826735.412320:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795335b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.412332:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795335b expref: 23 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.412339:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603712 00000100:00100000:2.0:1787826735.412342:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143604096:0@lo:104: 00000100:00100000:1.0:1787826735.412351:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603712 00000100:00100000:2.0:1787826735.412373:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826735.412384:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603456 00010000:00010000:1.0:1787826735.412387:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 24 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.412390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603456 00010000:00010000:2.0:1787826735.412412:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795334d expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.412415:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603840 00000100:00100000:0.0:1787826735.412418:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603584 00000100:00100000:1.0:1787826735.412421:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603840 00000100:00100000:0.0:1787826735.412425:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603584 00010000:00010000:2.0:1787826735.412428:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795334d expref: 25 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412439:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795347a expref: 25 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.412441:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143604224:0@lo:104: 00000100:00100000:0.0:1787826735.412445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143603968 00000100:00100000:0.0:1787826735.412450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143603968 00000100:00100000:1.0:1787826735.412472:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826735.412474:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604096 00000100:00100000:0.0:1787826735.412479:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604096 00000100:00100000:2.0:1787826735.412482:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826735.412485:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d1392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3617:x1874672143603712:12345-0@lo:103: 00010000:00010000:2.0:1787826735.412507:0:10295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 25 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.412512:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787826735.412512:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826735.412518:0:10295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 25 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412521:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 25 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.412525:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604224 00000100:00100000:0.0:1787826735.412531:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604224 00000100:00100000:2.0:1787826735.412542:0:10295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143604352:0@lo:104: 00010000:00010000:1.0:1787826735.412544:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 25 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.412553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826735.412564:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+8:10295:x1874672143603456:12345-0@lo:104: 00010000:00010000:1.0:1787826735.412571:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826735.412585:0:10295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826735.412588:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.412601:0:10295:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826735.412630:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d1392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3617:x1874672143603712:12345-0@lo:103: Request processed in 149us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826735.412637:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787826735.412645:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603072:0@lo:104: 00000100:00100000:1.0:1787826735.412655:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787826735.412661:0:10295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350f800/0xc0fefc09a795342d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953426 expref: 24 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.412665:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143603840:12345-0@lo:103: 00010000:00010000:1.0:1787826735.412678:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826735.412680:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603200:0@lo:104: 00010000:00010000:1.0:1787826735.412686:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795347a expref: 23 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412698:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795347a expref: 23 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.412704:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603456:0@lo:104: 00010000:00010000:0.0:1787826735.412709:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826735.412720:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+8:10295:x1874672143603456:12345-0@lo:104: Request processed in 156us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826735.412729:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787826735.412730:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350e800/0xc0fefc09a7953481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795347a expref: 23 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.412744:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826735.412745:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604352 00000100:00100000:0.0:1787826735.412749:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604352 00010000:00010000:2.0:1787826735.412761:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787826735.412768:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787826735.412768:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.412779:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030a00 already unused, calling callback (ffffffffc13fec20) 00000100:00100000:0.0:1787826735.412782:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+8:10295:x1874672143603584:12345-0@lo:104: 10000000:00010000:2.0:1787826735.412785:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.412788:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143603840:12345-0@lo:103: Request processed in 124us (467us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826735.412796:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.412805:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787826735.412809:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826735.412820:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826735.412826:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787826735.412842:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143603712:0@lo:103: 00010000:00010000:2.0:1787826735.412852:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.412854:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826735.412863:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+8:10295:x1874672143603584:12345-0@lo:104: Request processed in 83us (732us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826735.412865:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787826735.412874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826735.412884:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787826735.412885:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.412894:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787826735.412899:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+7:10295:x1874672143603968:12345-0@lo:104: 00000100:00100000:0.0:1787826735.412907:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+7:10295:x1874672143604096:12345-0@lo:104: 00010000:00010000:1.0:1787826735.412913:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.412922:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.412922:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5440030a00/0xc0fefc09a79533e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533e7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.412945:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826735.412949:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.412956:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80800 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826735.412959:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.412966:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.412968:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1787826735.412974:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.412982:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+7:10295:x1874672143604096:12345-0@lo:104: Request processed in 79us (609us total) trans 0 rc 0/0 10000000:01000000:2.0:1787826735.412984:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787826735.412994:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826735.413014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787826735.413014:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413015:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787826735.413026:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787826735.413029:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f855050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+6:10295:x1874672143604224:12345-0@lo:104: 00000100:00100000:1.0:1787826735.413029:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+6:10295:x1874672143603968:12345-0@lo:104: Request processed in 132us (751us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826735.413034:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413046:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.413047:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787826735.413048:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c80800/0xc0fefc09a7953393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a795339a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.413071:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787826735.413071:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826735.413082:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.413083:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10295:x1874672143604352:12345-0@lo:104: 00010000:00010000:0.0:1787826735.413094:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787826735.413096:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030e00 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:1.0:1787826735.413098:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826735.413101:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.413103:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f855050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10295:x1874672143604224:12345-0@lo:104: Request processed in 77us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826735.413133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787826735.413136:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826735.413144:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826735.413150:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826735.413162:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787826735.413169:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143603840:0@lo:103: 00010000:00010000:2.0:1787826735.413170:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.413171:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:10295:x1874672143604352:12345-0@lo:104: Request processed in 90us (585us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826735.413187:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826735.413188:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787826735.413194:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826735.413201:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413202:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413240:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80200 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:2.0:1787826735.413242:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a795335b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953362 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826735.413246:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.413248:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1787826735.413259:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826735.413260:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.413263:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143604736:0@lo:103: 00010000:00010000:2.0:1787826735.413266:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826735.413280:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.413281:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167d000 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826735.413287:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826735.413290:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787826735.413300:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826735.413312:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413318:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826735.413321:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826735.413331:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826735.413339:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826735.413355:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413357:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826735.413361:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413371:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c80200/0xc0fefc09a7953369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953370 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.413373:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826735.413380:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413386:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826735.413389:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544167d000/0xc0fefc09a795334d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953354 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413390:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826735.413393:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826735.413403:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787826735.413404:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826735.413408:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826735.413409:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826735.413415:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143604864:0@lo:103: 00000100:00100000:2.0:1787826735.413423:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143604608:0@lo:103: 00000100:00100000:0.0:1787826735.413461:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826735.413482:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603584:0@lo:104: 00000100:00100000:2.0:1787826735.413498:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603968:0@lo:104: 00000100:00100000:0.0:1787826735.413508:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604736 00000100:00100000:0.0:1787826735.413513:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604736 00000100:00100000:2.0:1787826735.413517:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143604096:0@lo:104: 00000100:00100000:2.0:1787826735.413526:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143604224:0@lo:104: 00000100:00100000:2.0:1787826735.413536:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143604352:0@lo:104: 00010000:00010000:0.0:1787826735.413537:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795335b expref: 22 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413553:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826735.413563:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.413564:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604864 00000100:00100000:2.0:1787826735.413566:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143604480:0@lo:103: 00000100:00100000:0.0:1787826735.413570:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604864 00010000:00010000:1.0:1787826735.413574:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167c800 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826735.413580:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413590:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826735.413599:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413601:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 23 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826735.413615:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787826735.413618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826735.413643:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143604992:0@lo:103: 00000100:00100000:0.0:1787826735.413646:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604480 00010000:00010000:1.0:1787826735.413646:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.413652:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604480 00010000:00010000:1.0:1787826735.413657:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826735.413664:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413670:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 24 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413673:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544167c800/0xc0fefc09a7953331 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953338 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.413684:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826735.413695:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604992 00010000:00010000:1.0:1787826735.413698:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826735.413699:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604992 00010000:00010000:1.0:1787826735.413702:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826735.413706:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787826735.413713:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826735.413718:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143605120:0@lo:103: 00010000:00010000:1.0:1787826735.413725:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826735.413726:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795334d expref: 25 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413728:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826735.413744:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826735.413748:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143605120 00000100:00100000:0.0:1787826735.413754:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143605120 00000100:00100000:1.0:1787826735.413755:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826735.413771:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143604608 00010000:00010000:0.0:1787826735.413772:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 26 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.413777:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143604608 00000100:00100000:0.0:1787826735.413795:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787826735.413799:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 27 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.413807:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+27:3617:x1874672143604736:12345-0@lo:103: 00010000:00010000:0.0:1787826735.413817:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826735.413824:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787826735.413825:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795335b expref: 27 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.413835:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826735.413839:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+27:3616:x1874672143604864:12345-0@lo:103: 00010000:00010000:0.0:1787826735.413840:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795335b expref: 27 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.413850:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+27:3618:x1874672143604480:12345-0@lo:103: 00010000:00010000:1.0:1787826735.413853:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826735.413862:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 27 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413863:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544167ce00/0xc0fefc09a7953362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795335b expref: 27 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.413865:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826735.413873:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 27 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413889:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 26 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.413901:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 26 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.413911:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826735.413917:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440030200/0xc0fefc09a79533e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79533e0 expref: 26 pid: 9479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.413923:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953369 expref: 26 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.413930:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826735.413932:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787826735.413940:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:10295:x1874672143603328:12345-0@lo:104: 00010000:00010000:3.0:1787826735.413949:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.413958:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3617:x1874672143604736:12345-0@lo:103: Request processed in 154us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826735.413970:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787826735.413972:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3618:x1874672143604480:12345-0@lo:103: Request processed in 123us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826735.413981:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787826735.413989:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826735.414000:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3618:x1874672143604992:12345-0@lo:103: 00010000:00010000:1.0:1787826735.414003:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826735.414003:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787826735.414010:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826735.414016:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795334d expref: 22 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.414019:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3618:x1874672143605120:12345-0@lo:103: 00010000:00010000:3.0:1787826735.414030:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787826735.414038:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826735.414040:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143604864:12345-0@lo:103: Request processed in 205us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826735.414042:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:10295:x1874672143603328:12345-0@lo:104: Request processed in 101us (2319us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826735.414046:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 22 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.414050:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795334d expref: 22 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.414060:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787826735.414061:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787826735.414073:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 22 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.414088:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787826735.414092:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953354 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795334d expref: 21 pid: 6480 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414095:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c81400/0xc0fefc09a7953338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953331 expref: 21 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.414102:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5447d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143604608:12345-0@lo:103: 00010000:00010000:0.0:1787826735.414121:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826735.414131:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826735.414133:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826735.414139:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 19 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.414149:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 19 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826735.414162:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031600/0xc0fefc09a795339a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953393 expref: 19 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.414170:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:3618:x1874672143604992:12345-0@lo:103: Request processed in 172us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826735.414174:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:3618:x1874672143605120:12345-0@lo:103: Request processed in 158us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826735.414186:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826735.414190:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787826735.414191:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826735.414198:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826735.414210:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131584 00000100:00100000:0.0:1787826735.414235:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131584 00000100:00100000:3.0:1787826735.414248:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00010000:0.0:1787826735.414254:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 10 pid: 6479 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.414258:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131712 00000100:00100000:2.0:1787826735.414263:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131712 00000100:00100000:1.0:1787826735.414266:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5447d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3619:x1874672143604608:12345-0@lo:103: Request processed in 168us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826735.414274:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 27 00010000:00010000:2.0:1787826735.414281:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 11 pid: 6478 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826735.414285:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668c91cd-9397-44b8-9716-665203a7cec4+11:2390:x1874672134131584:12345-192.168.203.6@tcp:103: 00000100:00100000:1.0:1787826735.414286:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787826735.414297:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826735.414303:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 11 pid: 6479 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.414305:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1787826735.414318:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:668c91cd-9397-44b8-9716-665203a7cec4+11:2391:x1874672134131712:12345-192.168.203.6@tcp:103: 00010000:00010000:3.0:1787826735.414323:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 11 pid: 6479 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.414329:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826735.414330:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143605120:0@lo:103: 00010000:00010000:0.0:1787826735.414337:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 11 pid: 6478 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.414337:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826735.414346:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143604480:0@lo:103: 00010000:00010000:0.0:1787826735.414355:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 11 pid: 6478 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.414357:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143604608:0@lo:103: 00000100:00100000:2.0:1787826735.414362:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143604992:0@lo:103: 00000100:00100000:3.0:1787826735.414374:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668c91cd-9397-44b8-9716-665203a7cec4+11:2390:x1874672134131584:12345-192.168.203.6@tcp:103: Request processed in 92us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826735.414376:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826735.414383:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:0.0:1787826735.414404:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134131712:12345-192.168.203.6@tcp:103: Request processed in 89us (156us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826735.414406:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787826735.414412:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143604736:0@lo:103: 00010000:00010000:2.0:1787826735.414413:0:10295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440030400/0xc0fefc09a7953496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467282 expref: 10 pid: 6479 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.414414:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826735.414419:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00010000:00010000:3.0:1787826735.414426:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031a00 already unused, calling callback (ffffffffc13fec20) 00000100:00100000:2.0:1787826735.414431:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143602816:192.168.203.6@tcp:104: 10000000:00010000:3.0:1787826735.414432:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.414439:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826735.414446:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414449:0:10295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350f200/0xc0fefc09a795348f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346727b expref: 8 pid: 6478 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.414450:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143604864:0@lo:103: 10000000:01000000:3.0:1787826735.414458:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787826735.414475:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143602944:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787826735.414483:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.414488:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826735.414493:0:10295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10295:1874672143603328:0@lo:104: 00010000:00010000:3.0:1787826735.414502:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.414504:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143605248:0@lo:103: 00010000:00010000:3.0:1787826735.414524:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a79533ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.414539:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826735.414540:0:10295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826735.414542:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826735.414544:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826735.414546:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826735.414573:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143605248 00000100:00100000:2.0:1787826735.414577:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143605248 00010000:00010000:2.0:1787826735.414595:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 16 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826735.414617:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787826735.414623:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d1392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:3616:x1874672143605248:12345-0@lo:103: 00010000:00010000:2.0:1787826735.414631:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826735.414635:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 16 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414645:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 16 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414655:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544148fe00/0xc0fefc09a79533f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79533ee expref: 16 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414667:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414675:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414696:0:7428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414703:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414711:0:7428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414717:0:7428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414722:0:7428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148f000 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826735.414726:0:7428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414733:0:7428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414751:0:7428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826735.414897:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826735.414923:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d1392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3616:x1874672143605248:12345-0@lo:103: Request processed in 301us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826735.414929:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787826735.414946:0:10295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.414956:0:10295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826735.414962:0:10295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544148f000/0xc0fefc09a79534ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826735.415009:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143605248:0@lo:103: 00000100:00100000:0.0:1787826736.209406:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143605504:0@lo:13: 00000100:00100000:2.0:1787826736.209412:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143605632:0@lo:13: 00000100:00100000:3.0:1787826736.209473:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143605760:0@lo:400: 00000100:00100000:2.0:1787826736.209482:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.209522:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.209532:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.209551:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143606144:0@lo:13: 00000100:00100000:0.0:1787826736.209571:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143605376:0@lo:41: 00000100:00100000:3.0:1787826736.209579:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143606272:0@lo:400: 00000100:00100000:0.0:1787826736.209611:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.209622:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.209625:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.209637:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143606016:0@lo:400: 00000100:00100000:2.0:1787826736.209645:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143606656:0@lo:400: 00000100:00100000:3.0:1787826736.209659:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143606784:0@lo:400: 00000100:00100000:0.0:1787826736.209673:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.209680:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.209698:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143606528:0@lo:13: 00000100:00100000:3.0:1787826736.209704:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143605632 00000100:00100000:3.0:1787826736.209711:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143605632 00000100:00100000:2.0:1787826736.209715:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143607168:0@lo:400: 00000100:00100000:0.0:1787826736.209729:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.209749:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143607040:0@lo:400: 00000100:00100000:2.0:1787826736.209749:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.209761:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143605504 00000100:00100000:3.0:1787826736.209766:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143605504 00000100:00100000:0.0:1787826736.209781:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.209790:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606144 00000100:00100000:3.0:1787826736.209795:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606144 00000100:00100000:2.0:1787826736.209803:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606272 00000100:00100000:0.0:1787826736.209808:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143607552:0@lo:400: 00000100:00100000:2.0:1787826736.209809:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606272 00000100:00100000:3.0:1787826736.209816:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606528 00000100:00100000:3.0:1787826736.209821:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606528 00000100:00100000:0.0:1787826736.209842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.209849:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826736.209861:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143605632:12345-0@lo:13: 00000100:00100000:0.0:1787826736.209865:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787826736.209874:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143605888:0@lo:400: 00002000:00000024:3.0:1787826736.209889:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826736.209899:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.209949:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143605632:12345-0@lo:13: Request processed in 91us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.209956:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826736.209972:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787826736.209981:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143605504:12345-0@lo:13: 00002000:00000024:3.0:1787826736.210004:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826736.210022:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606656 00000100:00100000:2.0:1787826736.210027:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606656 00000100:00100000:0.0:1787826736.210040:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143606400:0@lo:400: 00000100:00100000:3.0:1787826736.210043:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143605504:12345-0@lo:13: Request processed in 63us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.210049:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607168 00000100:00100000:2.0:1787826736.210052:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607168 00000100:00100000:3.0:1787826736.210053:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826736.210076:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.210078:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787826736.210090:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143605888 00000100:00100000:3.0:1787826736.210090:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143606144:12345-0@lo:13: 00000100:00100000:2.0:1787826736.210096:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143605888 00002000:00000024:3.0:1787826736.210116:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826736.210117:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143606912:0@lo:400: 00000100:00100000:2.0:1787826736.210128:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826736.210136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826736.210137:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143606272:12345-0@lo:400: 00000100:00100000:1.0:1787826736.210146:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143606656:12345-0@lo:400: 00000100:00100000:3.0:1787826736.210152:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143606144:12345-0@lo:13: Request processed in 65us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.210160:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826736.210178:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.210181:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787826736.210187:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143606272:12345-0@lo:400: Request processed in 49us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.210188:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143606656:12345-0@lo:400: Request processed in 45us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.210195:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826736.210200:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826736.210204:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143607424:0@lo:400: 00000100:00100000:3.0:1787826736.210211:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143606528:12345-0@lo:13: 00000100:00100000:2.0:1787826736.210233:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826736.210242:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826736.210245:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143607168:12345-0@lo:400: 00002000:00000024:3.0:1787826736.210249:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826736.210251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143605888:12345-0@lo:400: 00000100:00100000:0.0:1787826736.210259:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.210314:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143607168:12345-0@lo:400: Request processed in 71us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.210322:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787826736.210323:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d36d680 x1874672143606528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826736.210323:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143605888:12345-0@lo:400: Request processed in 72us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.210334:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143606528:12345-0@lo:13: Request processed in 128us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.210337:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826736.210338:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607040 00000100:00100000:2.0:1787826736.210342:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607040 00000100:00100000:3.0:1787826736.210348:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826736.210370:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143606528:0@lo:13: 00000100:00100000:2.0:1787826736.210370:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607552 00000100:00100000:2.0:1787826736.210375:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607552 00000100:00080000:1.0:1787826736.210385:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826736.210390:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826736.210390:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606912 00010000:00080000:0.0:1787826736.210392:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c3840 x1874672143605504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826736.210394:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826736.210400:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606912 00000100:00100000:3.0:1787826736.210411:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.210416:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143605504:0@lo:13: 00000100:00100000:1.0:1787826736.210418:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143605376 00000100:00100000:2.0:1787826736.210418:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607424 00000100:00100000:1.0:1787826736.210424:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143605376 00000100:00100000:2.0:1787826736.210424:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607424 00000100:00100000:2.0:1787826736.210441:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826736.210441:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143607296:0@lo:400: 00000100:00100000:1.0:1787826736.210444:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606016 00000100:00100000:1.0:1787826736.210447:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606016 00000100:00100000:2.0:1787826736.210451:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143607040:12345-0@lo:400: 00000100:00100000:0.0:1787826736.210458:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143605888:0@lo:400: 00000100:00100000:1.0:1787826736.210464:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606400 00000100:00100000:1.0:1787826736.210468:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606400 00000100:00100000:3.0:1787826736.210486:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826736.210490:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826736.210499:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143605376:12345-0@lo:41: 00000100:00100000:0.0:1787826736.210500:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826736.210507:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143607040:12345-0@lo:400: Request processed in 56us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.210518:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143607552:12345-0@lo:400: 00000100:00100000:2.0:1787826736.210518:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826736.210521:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143606272:0@lo:400: 00000004:00000024:1.0:1787826736.210524:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787826736.210535:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787826736.210543:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143606912:12345-0@lo:400: 00000100:00100000:3.0:1787826736.210555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143606784 00000100:00100000:3.0:1787826736.210560:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143606784 00000100:00100000:1.0:1787826736.210572:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143605376:12345-0@lo:41: Request processed in 74us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.210579:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787826736.210590:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143607552:12345-0@lo:400: Request processed in 76us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.210592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607296 00000100:00100000:3.0:1787826736.210597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607296 00000100:00100000:1.0:1787826736.210598:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787826736.210598:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143606912:12345-0@lo:400: Request processed in 57us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.210603:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826736.210610:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826736.210611:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143606016:12345-0@lo:400: 00000100:00100000:3.0:1787826736.210626:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826736.210629:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787826736.210639:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143606784:12345-0@lo:400: 00000100:00100000:0.0:1787826736.210641:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143607424:12345-0@lo:400: 00000100:00100000:1.0:1787826736.210647:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143606016:12345-0@lo:400: Request processed in 38us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.210660:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826736.210678:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826736.210684:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143607424:12345-0@lo:400: Request processed in 44us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.210691:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143606400:12345-0@lo:400: 00000100:00100000:0.0:1787826736.210696:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787826736.210703:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143606784:12345-0@lo:400: Request processed in 67us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.210711:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826736.210727:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826736.210735:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143606400:12345-0@lo:400: Request processed in 47us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.210740:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143607296:12345-0@lo:400: 00000100:00080000:3.0:1787826736.210742:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826736.210747:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787826736.210765:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d36ed00 x1874672143606144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826736.210780:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143606144:0@lo:13: 00000100:00100000:0.0:1787826736.210787:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143607296:12345-0@lo:400: Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.210792:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143605760 00000100:00100000:1.0:1787826736.210797:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143605760 00000100:00100000:3.0:1787826736.210798:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143606656:0@lo:400: 00000100:00100000:0.0:1787826736.210811:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787826736.210818:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143607168:0@lo:400: 00010000:00080000:3.0:1787826736.210833:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5341f62d00 x1874672143605632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826736.210846:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143605632:0@lo:13: 00000100:00100000:1.0:1787826736.210848:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787826736.210859:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3619:x1874672143605760:12345-0@lo:400: 00000100:00100000:0.0:1787826736.210865:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143606400:0@lo:400: 00010000:00080000:0.0:1787826736.210881:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b21c0 x1874672143606912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826736.210891:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b2580 x1874672143606784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826736.210898:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:3619:x1874672143605760:12345-0@lo:400: Request processed in 41us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.210906:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143606784:0@lo:400: 00000100:00100000:0.0:1787826736.210910:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143606912:0@lo:400: 00010000:00080000:3.0:1787826736.210922:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b0b40 x1874672143607296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826736.210926:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:0.0:1787826736.210934:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b30c0 x1874672143607424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826736.210940:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143607296:0@lo:400: 00000100:00100000:0.0:1787826736.210951:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143607424:0@lo:400: 00000100:00100000:3.0:1787826736.210960:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143605760:0@lo:400: 00000100:00100000:0.0:1787826736.210970:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143606016:0@lo:400: 00010000:00080000:0.0:1787826736.210984:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b12c0 x1874672143607040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826736.210993:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143607040:0@lo:400: 00010000:00080000:0.0:1787826736.211004:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b0000 x1874672143607552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826736.211012:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143607552:0@lo:400: 00000100:00100000:0.0:1787826736.211025:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143605376:0@lo:41: 00010000:00010000:2.0:1787826736.337715:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787826736.467189:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787826736.467197:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d534260c000 from 48 10000000:01000000:2.0:1787826736.467202:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826736.467340:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f200/0xc0fefc09a7953506 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.467354:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350f200/0xc0fefc09a7953506 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.467365:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350f200/0xc0fefc09a7953506 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826736.467389:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143607680:0@lo:101: 00000100:00100000:2.0:1787826736.467456:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.467544:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.467744:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607680 00000100:00100000:1.0:1787826736.467760:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607680 00000100:00100000:1.0:1787826736.467811:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787826736.467830:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+15:6482:x1874672143607680:12345-0@lo:101: 00010000:00010000:1.0:1787826736.467842:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826736.467854:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544167c800/0xc0fefc09a795350d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953506 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.467876:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167c800/0xc0fefc09a795350d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953506 expref: 16 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.467886:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544167c800/0xc0fefc09a795350d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953506 expref: 16 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.467893:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544167c800, rc 0) 00000100:00100000:1.0:1787826736.468280:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143607680:12345-0@lo:101: Request processed in 445us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.468287:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787826736.468373:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143607680:0@lo:101: 00010000:00010000:2.0:1787826736.468388:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350f200/0xc0fefc09a7953506 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795350d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.468397:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350f200/0xc0fefc09a7953506 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795350d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826736.468456:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143607808:0@lo:501: 00000100:00100000:2.0:1787826736.468482:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.468778:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.469002:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607808 00000100:00100000:1.0:1787826736.469008:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607808 00000100:00100000:1.0:1787826736.469044:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787826736.469051:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143607808:12345-0@lo:501: 00000100:00100000:1.0:1787826736.469297:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143607808:12345-0@lo:501: Request processed in 246us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.469305:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787826736.469611:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143607808:0@lo:501: 00000100:00100000:2.0:1787826736.469641:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143607936:0@lo:503: 00000100:00100000:2.0:1787826736.469805:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.469936:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.470126:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143607936 00000100:00100000:3.0:1787826736.470131:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143607936 00000100:00100000:3.0:1787826736.470205:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787826736.470239:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143607936:12345-0@lo:503: 00000100:00100000:3.0:1787826736.470344:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143607936:12345-0@lo:503: Request processed in 131us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.470351:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787826736.470413:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143607936:0@lo:503: 00000100:00100000:2.0:1787826736.470971:0:10313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10313:1874672143608064:0@lo:502: 00000100:00100000:2.0:1787826736.471051:0:10313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.471110:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608064 00000100:00100000:2.0:1787826736.471113:0:10313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.471117:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608064 00000100:00100000:3.0:1787826736.471192:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787826736.471199:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:10313:x1874672143608064:12345-0@lo:502: 00000100:00100000:3.0:1787826736.471324:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:10313:x1874672143608064:12345-0@lo:502: Request processed in 125us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.471330:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787826736.471370:0:10313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10313:1874672143608064:0@lo:502: 00000100:00100000:2.0:1787826736.471418:0:10313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10313:1874672143608192:0@lo:502: 00000100:00100000:2.0:1787826736.471473:0:10313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.471502:0:10313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.471660:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608192 00000100:00100000:1.0:1787826736.471666:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608192 00000100:00100000:1.0:1787826736.471705:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787826736.471711:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:10313:x1874672143608192:12345-0@lo:502: 00000100:00100000:1.0:1787826736.471871:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:10313:x1874672143608192:12345-0@lo:502: Request processed in 160us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.471878:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787826736.471988:0:10313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10313:1874672143608192:0@lo:502: 00000040:00080000:2.0:1787826736.472020:0:10313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787826736.472244:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787826736.472279:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826736.472292:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f200/0xc0fefc09a7953506 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795350d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.472302:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350f200/0xc0fefc09a7953506 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795350d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826736.472312:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787826736.472314:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787826736.472316:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787826736.472343:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a7953514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.472349:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a7953514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.472356:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a7953514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826736.472365:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608320:0@lo:101: 00000100:00100000:1.0:1787826736.472392:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826736.472417:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826736.472433:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608320 00000100:00100000:0.0:1787826736.472440:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608320 00000100:00100000:0.0:1787826736.472486:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787826736.472497:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+16:6482:x1874672143608320:12345-0@lo:101: 00010000:00010000:0.0:1787826736.472510:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826736.472524:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c80200/0xc0fefc09a795351b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953514 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.472568:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c80200/0xc0fefc09a795351b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953514 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.472580:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c80200/0xc0fefc09a795351b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953514 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.472590:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80200, rc 0) 00000100:00100000:0.0:1787826736.472642:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143608320:12345-0@lo:101: Request processed in 147us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.472649:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787826736.472701:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608320:0@lo:101: 00010000:00010000:1.0:1787826736.472721:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a7953514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795351b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.472728:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a7953514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795351b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826736.472766:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608448:0@lo:501: 00000100:00100000:1.0:1787826736.472783:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826736.472820:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826736.472847:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608448 00000100:00100000:2.0:1787826736.472855:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608448 00000100:00100000:2.0:1787826736.472880:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787826736.472884:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143608448:12345-0@lo:501: 00000100:00100000:2.0:1787826736.473008:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143608448:12345-0@lo:501: Request processed in 123us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.473013:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787826736.473048:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608448:0@lo:501: 00000100:00100000:1.0:1787826736.473078:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608576:0@lo:503: 00000100:00100000:1.0:1787826736.473124:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826736.473140:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.473162:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608576 00000100:00100000:3.0:1787826736.473167:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608576 00000100:00100000:3.0:1787826736.473196:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787826736.473202:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143608576:12345-0@lo:503: 00000100:00100000:3.0:1787826736.473382:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143608576:12345-0@lo:503: Request processed in 179us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.473389:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787826736.473449:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608576:0@lo:503: 00000100:00100000:3.0:1787826736.473746:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10314:1874672143608704:0@lo:502: 00000100:00100000:3.0:1787826736.473782:0:10314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.473808:0:10314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.473826:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608704 00000100:00100000:1.0:1787826736.473831:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608704 00000100:00100000:1.0:1787826736.473858:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787826736.473865:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:10314:x1874672143608704:12345-0@lo:502: 00000100:00100000:1.0:1787826736.473955:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:10314:x1874672143608704:12345-0@lo:502: Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.473960:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787826736.474078:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10314:1874672143608704:0@lo:502: 00000020:01000000:3.0:1787826736.474112:0:10314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826736.474122:0:10314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826736.474124:0:10314:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787826736.474131:0:10314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787826736.474152:0:10314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10314:1874672143608832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826736.474193:0:10314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.474230:0:10314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442c863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826736.474291:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608832 00000100:00100000:0.0:1787826736.474297:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608832 00000100:00100000:0.0:1787826736.474327:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787826736.474335:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:10314:x1874672143608832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.474420:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:10314:x1874672143608832:12345-0@lo:502:llog_process_th.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.474428:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787826736.474461:0:10314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10314:1874672143608832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787826736.474482:0:10314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826736.474488:0:10314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826736.474489:0:10314:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787826736.474494:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787826736.474658:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787826736.474676:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787826736.474683:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a7953514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795351b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.474692:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544167cc00/0xc0fefc09a7953514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795351b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826736.474701:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826736.474703:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d547d072000 from 48 10000000:01000000:0.0:1787826736.474713:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826736.474731:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.474750:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.474760:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.474774:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.474804:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.474828:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826736.474846:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143608960 00000100:00100000:2.0:1787826736.474851:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143608960 00000100:00100000:2.0:1787826736.474875:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787826736.474880:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+17:6482:x1874672143608960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826736.474887:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826736.474898:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953522 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.474916:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953522 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.474927:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953522 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.474935:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350f800, rc 0) 00000100:00100000:2.0:1787826736.474979:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143608960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.474987:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787826736.475016:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143608960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826736.475029:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.475039:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.475089:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.475125:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.475143:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.475162:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609088 00000100:00100000:3.0:1787826736.475168:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609088 00000100:00100000:3.0:1787826736.475199:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787826736.475205:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143609088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.475308:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143609088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.475315:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787826736.475376:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.475405:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.475442:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.475468:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826736.475491:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609216 00000100:00100000:2.0:1787826736.475505:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609216 00000100:00100000:2.0:1787826736.475580:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787826736.475595:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143609216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.475858:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143609216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.475867:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787826736.475888:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.476681:0:10315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10315:1874672143609344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.476733:0:10315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.476776:0:10315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.476989:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609344 00000100:00100000:1.0:1787826736.476995:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609344 00000100:00100000:1.0:1787826736.477044:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787826736.477054:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:10315:x1874672143609344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.477187:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:10315:x1874672143609344:12345-0@lo:502:llog_process_th.0 Request processed in 134us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.477196:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787826736.477466:0:10315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10315:1874672143609344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.477612:0:10315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10315:1874672143609472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.477651:0:10315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.477683:0:10315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.477700:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609472 00000100:00100000:1.0:1787826736.477883:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609472 00000100:00100000:1.0:1787826736.477922:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787826736.477929:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:10315:x1874672143609472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.478017:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:10315:x1874672143609472:12345-0@lo:502:llog_process_th.0 Request processed in 88us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.478025:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787826736.478150:0:10315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10315:1874672143609472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787826736.478173:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787826736.478451:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787826736.478473:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826736.478483:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.478494:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826736.478503:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787826736.478506:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787826736.478509:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787826736.478536:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.478544:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.478555:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.478570:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.478603:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.478663:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.478704:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609600 00000100:00100000:3.0:1787826736.478709:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609600 00000100:00100000:3.0:1787826736.478780:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787826736.478788:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+18:6482:x1874672143609600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826736.478798:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826736.478812:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953530 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.478846:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953530 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.478857:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953530 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.478865:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148f000, rc 0) 00000100:00100000:3.0:1787826736.478906:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:6482:x1874672143609600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.478920:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787826736.478984:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826736.478998:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.479006:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.479065:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.479090:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.479369:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.479421:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609728 00000100:00100000:1.0:1787826736.479425:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609728 00000100:00100000:1.0:1787826736.479460:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787826736.479467:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:6482:x1874672143609728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826736.479573:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:6482:x1874672143609728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.479580:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787826736.479646:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.479671:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.479704:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.479798:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.480060:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609856 00000100:00100000:1.0:1787826736.480064:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609856 00000100:00100000:1.0:1787826736.480091:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787826736.480107:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:6482:x1874672143609856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826736.480175:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:6482:x1874672143609856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.480190:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787826736.480311:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143609856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.480661:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10316:1874672143609984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.480699:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.480736:0:10316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.480833:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143609984 00000100:00100000:1.0:1787826736.480838:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143609984 00000100:00100000:1.0:1787826736.480869:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787826736.480877:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:10316:x1874672143609984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.480956:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:10316:x1874672143609984:12345-0@lo:502:llog_process_th.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.480964:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787826736.481062:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10316:1874672143609984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826736.481085:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826736.481094:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826736.481107:0:10316:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787826736.481116:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787826736.481136:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10316:1874672143610112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.481168:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.481190:0:10316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.481318:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143610112 00000100:00100000:1.0:1787826736.481322:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143610112 00000100:00100000:1.0:1787826736.481344:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787826736.481350:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:10316:x1874672143610112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.481425:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:10316:x1874672143610112:12345-0@lo:502:llog_process_th.0 Request processed in 74us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.481432:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787826736.481497:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10316:1874672143610112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826736.481517:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826736.481522:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826736.481524:0:10316:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787826736.481528:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1787826736.481791:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787826736.481809:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787826736.481817:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.481827:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826736.481837:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787826736.481840:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d54789ce800 from 48 10000000:01000000:1.0:1787826736.481843:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826736.481866:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167ce00/0xc0fefc09a795353e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.481881:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544167ce00/0xc0fefc09a795353e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.481890:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544167ce00/0xc0fefc09a795353e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826736.481904:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826736.481932:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826736.481957:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53436c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.481995:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143610240 00000100:00100000:3.0:1787826736.481999:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143610240 00000100:00100000:3.0:1787826736.482029:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787826736.482036:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+19:6482:x1874672143610240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826736.482045:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826736.482057:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795353e expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.482076:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795353e expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.482087:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544148e000/0xc0fefc09a7953545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795353e expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.482096:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148e000, rc 0) 00000100:00100000:3.0:1787826736.482145:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143610240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.482150:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787826736.482391:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826736.482403:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544167ce00/0xc0fefc09a795353e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953545 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.482423:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544167ce00/0xc0fefc09a795353e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953545 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.482468:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.482494:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.482524:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.482572:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143610368 00000100:00100000:3.0:1787826736.482576:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143610368 00000100:00100000:3.0:1787826736.482607:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787826736.482613:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143610368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.482777:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143610368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.482784:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787826736.483027:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.483060:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.483086:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.483114:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.483160:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143610496 00000100:00100000:3.0:1787826736.483163:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143610496 00000100:00100000:3.0:1787826736.483187:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787826736.483194:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143610496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.483293:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143610496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.483299:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787826736.483407:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.484259:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10317:1874672143610624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.484297:0:10317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.484323:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.484451:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143610624 00000100:00100000:3.0:1787826736.484457:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143610624 00000100:00100000:3.0:1787826736.484495:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787826736.484508:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:10317:x1874672143610624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826736.484604:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:10317:x1874672143610624:12345-0@lo:502:llog_process_th.0 Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.484611:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787826736.484647:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10317:1874672143610624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.484689:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10317:1874672143610752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.484786:0:10317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.484813:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.484861:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143610752 00000100:00100000:3.0:1787826736.484866:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143610752 00000100:00100000:3.0:1787826736.485246:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787826736.485254:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:10317:x1874672143610752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826736.485323:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:10317:x1874672143610752:12345-0@lo:502:llog_process_th.0 Request processed in 68us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.485329:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787826736.485812:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10317:1874672143610752:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787826736.485836:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787826736.485956:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787826736.485979:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826736.485991:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544167ce00/0xc0fefc09a795353e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953545 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.486003:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544167ce00/0xc0fefc09a795353e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953545 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826736.486013:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787826736.486015:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787826736.486019:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787826736.486046:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350fa00/0xc0fefc09a795354c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.486054:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350fa00/0xc0fefc09a795354c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.486075:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350fa00/0xc0fefc09a795354c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826736.486091:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.486137:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.486163:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.486177:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143610880 00000100:00100000:1.0:1787826736.486193:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143610880 00000100:00100000:1.0:1787826736.486395:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787826736.486416:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143610880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826736.486427:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826736.486442:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544167d000/0xc0fefc09a7953553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795354c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.486467:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167d000/0xc0fefc09a7953553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795354c expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.486479:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544167d000/0xc0fefc09a7953553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795354c expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.486487:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544167d000, rc 0) 00000100:00100000:1.0:1787826736.486526:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143610880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.486532:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787826736.486581:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143610880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826736.486596:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350fa00/0xc0fefc09a795354c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953553 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.486604:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350fa00/0xc0fefc09a795354c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953553 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826736.486717:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.486740:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.486762:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826736.486776:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611008 00000100:00100000:0.0:1787826736.486782:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611008 00000100:00100000:0.0:1787826736.486869:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787826736.486883:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143611008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.486995:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143611008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.487003:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787826736.487014:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.487043:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.487078:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.487111:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.487161:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611136 00000100:00100000:1.0:1787826736.487166:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611136 00000100:00100000:1.0:1787826736.487201:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787826736.487208:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143611136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826736.487340:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143611136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.487347:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787826736.487434:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.487958:0:10318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10318:1874672143611264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.487991:0:10318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.488015:0:10318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.488021:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611264 00000100:00100000:1.0:1787826736.488026:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611264 00000100:00100000:1.0:1787826736.488052:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787826736.488057:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10318:x1874672143611264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.488153:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10318:x1874672143611264:12345-0@lo:502:llog_process_th.0 Request processed in 94us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.488161:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787826736.488175:0:10318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10318:1874672143611264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826736.488199:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826736.488209:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826736.488211:0:10318:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787826736.488244:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787826736.488262:0:10318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10318:1874672143611392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.488292:0:10318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.488319:0:10318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826736.488360:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611392 00000100:00100000:0.0:1787826736.488366:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611392 00000100:00100000:0.0:1787826736.488399:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787826736.488421:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10318:x1874672143611392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.488511:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10318:x1874672143611392:12345-0@lo:502:llog_process_th.0 Request processed in 103us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.488519:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787826736.488529:0:10318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10318:1874672143611392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826736.488550:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826736.488554:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826736.488556:0:10318:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787826736.488559:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1787826736.488712:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1787826736.488746:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787826736.488760:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350fa00/0xc0fefc09a795354c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953553 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.488771:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350fa00/0xc0fefc09a795354c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953553 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826736.488782:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826736.488784:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5448400800 from 48 10000000:01000000:0.0:1787826736.488788:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826736.488811:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81a00/0xc0fefc09a795355a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.488818:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c81a00/0xc0fefc09a795355a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.488828:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c81a00/0xc0fefc09a795355a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.488849:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.488878:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.488906:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.488991:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611520 00000100:00100000:3.0:1787826736.489006:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611520 00000100:00100000:3.0:1787826736.489045:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787826736.489053:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143611520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826736.489062:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826736.489075:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544148fe00/0xc0fefc09a7953561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795355a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.489095:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148fe00/0xc0fefc09a7953561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795355a expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.489118:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544148fe00/0xc0fefc09a7953561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795355a expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.489127:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148fe00, rc 0) 00000100:00100000:3.0:1787826736.489162:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143611520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.489169:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787826736.489414:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826736.489443:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c81a00/0xc0fefc09a795355a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953561 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.489455:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81a00/0xc0fefc09a795355a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953561 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.489538:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.489590:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.489647:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826736.489711:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611648 00000100:00100000:2.0:1787826736.489718:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611648 00000100:00100000:2.0:1787826736.489792:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787826736.489802:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143611648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.489934:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143611648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.489941:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787826736.490006:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.490032:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.490072:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.490086:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.490176:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611776 00000100:00100000:1.0:1787826736.490194:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611776 00000100:00100000:1.0:1787826736.490263:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787826736.490271:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143611776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826736.490392:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143611776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.490400:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787826736.490422:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143611776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826736.491553:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10319:1874672143611904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.491609:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826736.491682:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826736.491718:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143611904 00000100:00100000:0.0:1787826736.491725:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143611904 00000100:00100000:0.0:1787826736.491904:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787826736.491914:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10319:x1874672143611904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826736.492038:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10319:x1874672143611904:12345-0@lo:502:llog_process_th.0 Request processed in 126us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.492056:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787826736.492113:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10319:1874672143611904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.492178:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10319:1874672143612032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.492312:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826736.495070:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53436c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826736.495147:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612032 00000100:00100000:2.0:1787826736.495170:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612032 00000100:00100000:2.0:1787826736.495527:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787826736.495540:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10319:x1874672143612032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826736.496027:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10319:1874672143612032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.496055:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10319:x1874672143612032:12345-0@lo:502:llog_process_th.0 Request processed in 514us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.496065:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000040:00080000:1.0:1787826736.496087:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787826736.496187:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787826736.496841:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826736.496856:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81a00/0xc0fefc09a795355a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953561 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.496870:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81a00/0xc0fefc09a795355a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953561 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826736.497674:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787826736.497682:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787826736.497687:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826736.497872:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a7953568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.497884:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a7953568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.497895:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a7953568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826736.497918:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.498052:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.498109:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5450f03780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826736.498130:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612160 00000100:00100000:2.0:1787826736.498143:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612160 00000100:00100000:2.0:1787826736.498393:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787826736.498407:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143612160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826736.498423:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826736.498443:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350ee00/0xc0fefc09a795356f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953568 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.498473:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350ee00/0xc0fefc09a795356f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953568 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.498495:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350ee00/0xc0fefc09a795356f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953568 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826736.498505:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350ee00, rc 0) 00000100:00100000:2.0:1787826736.498574:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143612160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.498593:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787826736.498665:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826736.498683:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a7953568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795356f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.498691:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a7953568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795356f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826736.498756:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.498787:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.500483:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5450f03780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826736.500790:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612288 00000100:00100000:0.0:1787826736.500804:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612288 00000100:00100000:1.0:1787826736.500898:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787826736.500914:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143612288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826736.501202:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143612288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.501210:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787826736.501373:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.501418:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.501469:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.501492:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612416 00000100:00100000:3.0:1787826736.501496:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612416 00000100:00100000:3.0:1787826736.501517:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787826736.501523:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143612416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.501610:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143612416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.501618:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787826736.501664:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5450f03780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.501677:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.501871:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10320:1874672143612544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826736.501906:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.501931:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612544 00000100:00100000:3.0:1787826736.501935:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612544 00000100:00100000:3.0:1787826736.501965:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787826736.501971:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10320:x1874672143612544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826736.502135:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10320:x1874672143612544:12345-0@lo:502:llog_process_th.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.502142:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787826736.502171:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5446489480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826736.502183:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10320:1874672143612544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826736.502292:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826736.502300:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826736.502302:0:10320:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787826736.502308:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787826736.502327:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10320:1874672143612672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826736.502361:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.502396:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826736.502414:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612672 00000100:00100000:2.0:1787826736.502425:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612672 00000100:00100000:2.0:1787826736.502484:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787826736.502497:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10320:x1874672143612672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826736.502724:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10320:x1874672143612672:12345-0@lo:502:llog_process_th.0 Request processed in 230us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.502733:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787826736.502759:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10320:1874672143612672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826736.502787:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826736.502792:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826736.502794:0:10320:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787826736.502798:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787826736.503046:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787826736.503072:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787826736.503081:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a7953568 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795356f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.503090:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440031a00/0xc0fefc09a7953568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795356f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826736.503111:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787826736.503113:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d5450ee99b8 from 1 10000000:01000000:0.0:1787826736.503115:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787826736.503136:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.503147:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826736.503156:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826736.503168:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.503198:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826736.503239:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826736.503255:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612800 00000100:00100000:1.0:1787826736.503261:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612800 00000100:00100000:1.0:1787826736.503295:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787826736.503302:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143612800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826736.503312:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826736.503324:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544167d800/0xc0fefc09a795357d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953576 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.503346:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544167d800/0xc0fefc09a795357d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953576 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.503357:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544167d800/0xc0fefc09a795357d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953576 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826736.503367:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544167d800, rc 0) 00000100:00100000:1.0:1787826736.503402:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143612800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.503409:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787826736.503577:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826736.503589:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.503596:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826736.503700:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826736.503721:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826736.503743:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826736.503756:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143612928 00000100:00100000:0.0:1787826736.503760:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143612928 00000100:00100000:0.0:1787826736.503790:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787826736.503797:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143612928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826736.503858:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143612928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (135us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826736.503865:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787826736.503881:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143612928:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787826736.503898:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787826736.503903:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826736.503911:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826736.530181:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826736.530209:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826736.530258:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826736.530276:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826736.530286:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132224 00000100:00100000:0.0:1787826736.530294:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132224 00000100:00100000:2.0:1787826736.530300:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826736.530321:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131968 00000100:00100000:2.0:1787826736.530324:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131968 00000100:00100000:3.0:1787826736.530368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132096 00000100:00100000:3.0:1787826736.530371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132096 00000100:00100000:1.0:1787826736.530408:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134131840 00000100:00100000:1.0:1787826736.530411:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134131840 00000100:00100000:1.0:1787826736.530436:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 211 00000100:00100000:1.0:1787826736.530442:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+8:2391:x1874672134131840:12345-192.168.203.6@tcp:400: 00000100:00100000:0.0:1787826736.530452:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132352 00000100:00100000:0.0:1787826736.530458:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132352 00000100:00100000:1.0:1787826736.530546:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+8:2391:x1874672134131840:12345-192.168.203.6@tcp:400: Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826736.530552:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 211 00000100:00100000:2.0:1787826736.530594:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:2.0:1787826736.530600:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134131968:12345-192.168.203.6@tcp:400: 00000100:00100000:2.0:1787826736.530632:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134131968:12345-192.168.203.6@tcp:400: Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.530639:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:2.0:1787826736.530660:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:2.0:1787826736.530668:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134132224:12345-192.168.203.6@tcp:400: 00000100:00100000:2.0:1787826736.530694:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134132224:12345-192.168.203.6@tcp:400: Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826736.530700:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00080000:2.0:1787826736.530761:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826736.530764:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826736.530765:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826736.530767:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826736.531131:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:3.0:1787826736.531141:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2391:x1874672134132096:12345-192.168.203.6@tcp:400: 00000100:00100000:0.0:1787826736.531157:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:0.0:1787826736.531170:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134132352:12345-192.168.203.6@tcp:400: 00000100:00100000:3.0:1787826736.531180:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2391:x1874672134132096:12345-192.168.203.6@tcp:400: Request processed in 41us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826736.531188:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1787826736.531205:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134132352:12345-192.168.203.6@tcp:400: Request processed in 37us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826736.531233:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:2.0:1787826737.234256:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143613056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826737.234433:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826737.234643:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143613056 00000100:00100000:0.0:1787826737.234651:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143613056 00000100:00100000:0.0:1787826737.234716:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787826737.234727:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143613056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826737.234758:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826737.234819:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143613056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826737.234826:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787826737.234931:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143613056:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1787826737.236519:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000001:00100000:1.0:1787826737.237586:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000001:00080000:1.0:1787826737.237598:0:9469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1787826737.237610:0:9469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787826737.361584:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826738.385551:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826739.409364:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826740.114581:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826740.114764:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132480 00000100:00100000:1.0:1787826740.114776:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132480 00000100:00100000:1.0:1787826740.114845:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 212 00000100:00100000:1.0:1787826740.114857:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+8:6151:x1874672134132480:12345-192.168.203.6@tcp:101: 00010000:00010000:1.0:1787826740.114878:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826740.114920:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d6000/0xc0fefc09a7953584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34672f2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826740.114969:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d6000/0xc0fefc09a7953584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672f2 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826740.114982:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d6000/0xc0fefc09a7953584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672f2 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826740.114992:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6000, rc 0) 00000100:00100000:1.0:1787826740.115081:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134132480:12345-192.168.203.6@tcp:101: Request processed in 218us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826740.115090:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 212 00000100:00100000:2.0:1787826740.116758:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826740.116916:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132608 00000100:00100000:0.0:1787826740.116930:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132608 00000100:00100000:0.0:1787826740.116999:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 213 00000100:00100000:0.0:1787826740.117010:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134132608:12345-192.168.203.6@tcp:501: 00000100:00100000:0.0:1787826740.117328:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134132608:12345-192.168.203.6@tcp:501: Request processed in 160us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826740.117354:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 213 00000100:00100000:3.0:1787826740.118769:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826740.118980:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132736 00000100:00100000:0.0:1787826740.118990:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132736 00000100:00100000:0.0:1787826740.119069:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 214 00000100:00100000:0.0:1787826740.119090:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134132736:12345-192.168.203.6@tcp:503: 00000100:00100000:0.0:1787826740.119420:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134132736:12345-192.168.203.6@tcp:503: Request processed in 331us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826740.119429:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 214 00000100:00100000:2.0:1787826740.124470:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826740.124736:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132864 00000100:00100000:1.0:1787826740.124749:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132864 00000100:00100000:1.0:1787826740.124840:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 215 00000100:00100000:1.0:1787826740.124853:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+9:6648:x1874672134132864:12345-192.168.203.6@tcp:502: 00000100:00100000:1.0:1787826740.125049:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+9:6648:x1874672134132864:12345-192.168.203.6@tcp:502: Request processed in 199us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826740.125059:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 215 00000100:00100000:2.0:1787826740.128109:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826740.128251:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134132992 00000100:00100000:1.0:1787826740.128262:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134132992 00000100:00100000:1.0:1787826740.128330:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 216 00000100:00100000:1.0:1787826740.128344:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+9:6648:x1874672134132992:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787826740.128553:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+9:6648:x1874672134132992:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 213us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826740.128561:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 216 00000100:00100000:3.0:1787826740.131335:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826740.132161:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134133120 00000100:00100000:1.0:1787826740.132174:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134133120 00000100:00100000:1.0:1787826740.132323:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 217 00000100:00100000:1.0:1787826740.132336:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134133120:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826740.132357:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826740.132379:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d6600/0xc0fefc09a795358b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34672f9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826740.132415:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d6600/0xc0fefc09a795358b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672f9 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826740.132429:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d6600/0xc0fefc09a795358b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672f9 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826740.132439:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6600, rc 0) 00000100:00100000:1.0:1787826740.132534:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133120:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 201us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826740.132542:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 217 00000100:00100000:2.0:1787826740.137758:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826740.137847:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134133248 00000100:00100000:0.0:1787826740.137870:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134133248 00000100:00100000:0.0:1787826740.138025:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 218 00000100:00100000:0.0:1787826740.138038:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133248:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826740.138255:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133248:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 Request processed in 218us (511us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826740.138264:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 218 00010000:00010000:2.0:1787826740.433423:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826740.999089:0:10357:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9b7c4d40 20000000:00000080:3.0:1787826740.999102:0:10357:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d547f870000 uarg=0000000000000000 20000000:01000000:3.0:1787826740.999136:0:10357:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787826740.999144:0:10357:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787826740.999147:0:10357:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787826740.999476:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787826740.999574:0:10357:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787826741.003041:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787826741.003109:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787826741.003129:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787826741.003142:0:10357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787826741.003160:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003178:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5482177600/0xc0fefc09a7953220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003186:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795326d expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003205:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003245:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003257:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003265:0:10357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003302:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003318:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 9 pid: 9479 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826741.003333:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613184:192.168.203.6@tcp:104: 00010000:00010000:0.0:1787826741.003440:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003450:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 23 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826741.003460:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613312:0@lo:104: 00000100:00100000:0.0:1787826741.003500:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826741.003529:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003544:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 23 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826741.003553:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613440:0@lo:104: 00000100:00100000:0.0:1787826741.003576:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826741.003607:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a795326d expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826741.003608:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143613312 00010000:00010000:0.0:1787826741.003617:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a795326d expref: 23 pid: 6480 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826741.003621:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143613312 00000100:00100000:0.0:1787826741.003630:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613568:0@lo:104: 00000100:00100000:3.0:1787826741.003656:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143613440 00000100:00100000:3.0:1787826741.003658:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143613440 00000100:00100000:3.0:1787826741.003671:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826741.003684:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.003688:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:10357:x1874672143613312:12345-0@lo:104: 00010000:00010000:3.0:1787826741.003700:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003712:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5482177600/0xc0fefc09a7953220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003723:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5482177600/0xc0fefc09a7953220 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 23 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826741.003733:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613696:0@lo:104: 00010000:00010000:3.0:1787826741.003748:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826741.003756:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:10357:x1874672143613312:12345-0@lo:104: Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.003764:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.003768:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826741.003778:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475600780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826741.003786:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143613568 00000100:00100000:3.0:1787826741.003791:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143613568 00000100:00100000:0.0:1787826741.003801:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613312:0@lo:104: 00000100:00100000:3.0:1787826741.003805:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143613696 00000100:00100000:3.0:1787826741.003809:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143613696 00000100:00100000:3.0:1787826741.003824:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826741.003830:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10357:x1874672143613440:12345-0@lo:104: 00010000:00010000:3.0:1787826741.003838:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826741.003847:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787826741.003858:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10357:x1874672143613568:12345-0@lo:104: 00010000:00010000:0.0:1787826741.003868:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.003879:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787826741.003889:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:10357:x1874672143613440:12345-0@lo:104: Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.003897:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826741.003908:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787826741.003919:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:10357:x1874672143613696:12345-0@lo:104: 00010000:00010000:3.0:1787826741.003925:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.003928:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787826741.003936:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:10357:x1874672143613568:12345-0@lo:104: Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.003944:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1787826741.003953:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787826741.003958:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:10357:x1874672143613696:12345-0@lo:104: Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.003962:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787826741.003979:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1787826741.003983:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613440:0@lo:104: 00000100:00100000:0.0:1787826741.003993:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613568:0@lo:104: 00010000:00010000:3.0:1787826741.003994:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004003:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81600 already unused, calling callback (ffffffffc13fec20) 00000100:00100000:0.0:1787826741.004007:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613696:0@lo:104: 10000000:00010000:3.0:1787826741.004008:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004020:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826741.004025:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826741.004028:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787826741.004049:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004054:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826741.004090:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004107:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79533d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79533d9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004120:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826741.004129:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004134:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148fa00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:3.0:1787826741.004137:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004142:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826741.004146:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826741.004151:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787826741.004169:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004174:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826741.004191:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004197:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a79532cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79532d6 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004207:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826741.004239:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004245:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148ea00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:3.0:1787826741.004247:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004253:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826741.004260:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826741.004267:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787826741.004281:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004286:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826741.004291:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004341:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a795326d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953274 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826741.004354:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826741.004356:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826741.004360:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826741.004362:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004363:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826741.004373:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544167c200 already unused, calling callback (ffffffffc13fec20) 00000100:00100000:3.0:1787826741.004375:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:1.0:1787826741.004377:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826741.004386:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826741.004387:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143613824:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1787826741.004400:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826741.004406:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826741.004425:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826741.004433:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787826741.004434:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826741.004442:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826741.004450:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544167c200/0xc0fefc09a7953219 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953220 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826741.004457:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826741.004465:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826741.004468:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826741.004476:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826741.004483:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143613952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826741.004484:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143614208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826741.004485:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826741.004497:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143613824 00000100:00100000:1.0:1787826741.004502:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143613824 00010000:00010000:1.0:1787826741.004525:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 24 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826741.004535:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.004537:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826741.004583:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826741.004593:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143614080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826741.004607:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143613952 00000100:00100000:3.0:1787826741.004618:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143613952 00000100:00100000:2.0:1787826741.004620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826741.004636:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 25 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826741.004651:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614208 00000100:00100000:3.0:1787826741.004654:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614080 00000100:00100000:2.0:1787826741.004657:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614208 00000100:00100000:3.0:1787826741.004659:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614080 00010000:00010000:2.0:1787826741.004681:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5482177600/0xc0fefc09a7953220 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 27 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004687:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795326d expref: 27 pid: 6480 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826741.004705:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826741.004714:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787826741.004716:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f62d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+27:3618:x1874672143613824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826741.004729:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826741.004735:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5447d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+27:3616:x1874672143613952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826741.004737:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 27 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826741.004739:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787826741.004750:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+27:3618:x1874672143614208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826741.004752:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826741.004758:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826741.004761:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 27 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004765:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5482177600/0xc0fefc09a7953220 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 27 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826741.004778:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 27 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004804:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5482177600/0xc0fefc09a7953220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 27 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004814:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5482177600/0xc0fefc09a7953220 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953219 expref: 27 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004822:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826741.004845:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+26:3618:x1874672143614208:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.004850:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787826741.004863:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826741.004869:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143614080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826741.004881:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826741.004884:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a795326d expref: 25 pid: 6480 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004891:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a795326d expref: 25 pid: 6480 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004898:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544167da00/0xc0fefc09a7953274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a795326d expref: 25 pid: 6480 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826741.004904:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 25 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826741.004914:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826741.004921:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79532d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79532cf expref: 24 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826741.004934:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826741.004938:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143614080:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.004943:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826741.004964:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143614208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826741.004977:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5447d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143613952:12345-0@lo:103:ldlm_bl.0 Request processed in 245us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.004985:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1787826741.005005:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031e00/0xc0fefc09a79533d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79533d2 expref: 21 pid: 6479 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826741.005007:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143614080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826741.005024:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143613952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826741.005025:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826741.005063:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f62d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:3618:x1874672143613824:12345-0@lo:103:ldlm_bl.0 Request processed in 349us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.005079:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143613824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826741.005084:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787826741.006840:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1874672143613184:192.168.203.6@tcp:104: 00010000:00010000:0.0:1787826741.006871:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826741.007094:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826741.007135:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134133376 00000100:00100000:0.0:1787826741.007141:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134133376 00010000:00010000:0.0:1787826741.007165:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 10 pid: 9479 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826741.007199:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 34 00000100:00100000:0.0:1787826741.007208:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668c91cd-9397-44b8-9716-665203a7cec4+10:2390:x1874672134133376:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826741.007242:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826741.007248:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 10 pid: 9479 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007260:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 10 pid: 9479 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007276:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a79534a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672ba expref: 10 pid: 9479 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007295:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007304:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007317:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007324:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007331:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007337:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007343:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:0.0:1787826741.007347:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007354:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007369:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.007378:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826741.007421:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668c91cd-9397-44b8-9716-665203a7cec4+9:2390:x1874672134133376:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 214us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.007435:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 34 00010000:00010000:2.0:1787826741.007496:0:10357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826741.007514:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826741.007522:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c80e00/0xc0fefc09a7953592 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826741.249311:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826741.249423:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134133504 00000100:00100000:0.0:1787826741.249434:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134133504 00000100:00100000:0.0:1787826741.249529:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 219 00000100:00100000:0.0:1787826741.249540:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134133504:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826741.249556:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826741.249576:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467300 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.249603:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.249610:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826741.249616:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80a00, rc 0) 00000100:00100000:0.0:1787826741.249684:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133504:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 135us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.249691:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 219 00000100:00100000:3.0:1787826741.251149:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826741.251209:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134133632 00000100:00100000:0.0:1787826741.251248:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134133632 00000100:00100000:0.0:1787826741.251286:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 220 00000100:00100000:0.0:1787826741.251292:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133632:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826741.251398:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133632:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.251403:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 220 00000100:00100000:3.0:1787826741.253038:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826741.253129:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134133760 00000100:00100000:1.0:1787826741.253137:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134133760 00000100:00100000:1.0:1787826741.253187:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 221 00000100:00100000:1.0:1787826741.253195:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133760:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826741.253914:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134133760:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 Request processed in 717us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.253928:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 221 00000100:00100000:1.0:1787826741.258017:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826741.258097:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134133888 00000100:00100000:2.0:1787826741.258107:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134133888 00000100:00100000:2.0:1787826741.258162:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 222 00000100:00100000:2.0:1787826741.258172:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:6705:x1874672134133888:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787826741.258342:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:6705:x1874672134133888:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 171us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826741.258350:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 222 00000100:00100000:3.0:1787826741.262905:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826741.262982:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134016 00000100:00100000:1.0:1787826741.262992:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134016 00000100:00100000:1.0:1787826741.263050:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 223 00000100:00100000:1.0:1787826741.263060:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:6705:x1874672134134016:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787826741.263519:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:6705:x1874672134134016:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 185us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.263531:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 223 00000100:00100000:0.0:1787826741.329356:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143614336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826741.329356:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143614464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826741.329434:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826741.329450:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143614592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.329491:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.329506:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143614976:0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.329547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.329570:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143615488:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.329591:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143615104:0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.329594:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.329619:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143616000:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.329627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826741.329648:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143615616:0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.329654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826741.329681:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.329703:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143614720:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.329708:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143616128:0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.329719:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143615488 00000100:00100000:2.0:1787826741.329727:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143615488 00000100:00100000:3.0:1787826741.329745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826741.329746:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.329777:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143615232:0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.329790:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616000 00000100:00100000:2.0:1787826741.329795:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616000 00000100:00100000:1.0:1787826741.329798:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614464 00000100:00100000:1.0:1787826741.329803:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614464 00000100:00100000:3.0:1787826741.329808:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826741.329816:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143615616 00000100:00100000:2.0:1787826741.329821:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143615616 00000100:00100000:3.0:1787826741.329835:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143615744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.329838:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787826741.329842:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616128 00000100:00100000:2.0:1787826741.329846:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616128 00000100:00100000:1.0:1787826741.329850:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143614464:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826741.329867:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826741.329876:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143615488:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787826741.329881:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826741.329881:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826741.329908:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826741.329911:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826741.329918:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143616000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.329922:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143614848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.329932:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143614464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.329950:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787826741.329955:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143615488:12345-0@lo:400:kworker.0 Request processed in 79us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826741.329965:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787826741.329978:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826741.329985:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143616000:12345-0@lo:400:kworker.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.329985:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614976 00000100:00100000:2.0:1787826741.329990:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787826741.329991:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614976 00000100:00100000:0.0:1787826741.330001:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826741.330004:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143615360:0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330008:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143615616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330019:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614720 00000100:00100000:1.0:1787826741.330022:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614720 00000100:00100000:0.0:1787826741.330027:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826741.330040:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143616128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.330042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826741.330045:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143615232 00000100:00100000:1.0:1787826741.330050:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143615232 00000100:00100000:3.0:1787826741.330079:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143615872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330081:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143615744 00000100:00100000:2.0:1787826741.330084:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143615616:12345-0@lo:400:kworker.0 Request processed in 65us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.330088:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143615744 00000100:00100000:2.0:1787826741.330096:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826741.330103:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143616128:12345-0@lo:400:kworker.0 Request processed in 67us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.330112:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826741.330119:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143615360 00000100:00100000:1.0:1787826741.330122:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143615360 00000100:00100000:3.0:1787826741.330123:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826741.330124:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826741.330133:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826741.330138:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826741.330140:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143615872 00000100:00080000:2.0:1787826741.330142:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826741.330143:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143615872 00000100:00100000:2.0:1787826741.330163:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826741.330173:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787826741.330182:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826741.330187:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143614976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330192:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143614720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330247:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787826741.330260:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143615232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.330273:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143614976:12345-0@lo:400:kworker.0 Request processed in 90us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.330275:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143614720:12345-0@lo:400:kworker.0 Request processed in 87us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.330288:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787826741.330297:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787826741.330311:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143615232:12345-0@lo:400:kworker.0 Request processed in 53us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.330315:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826741.330330:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826741.330335:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143615744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330340:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826741.330344:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143615360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330364:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787826741.330375:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143615872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330394:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143615360:12345-0@lo:400:kworker.0 Request processed in 55us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.330394:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143615744:12345-0@lo:400:kworker.0 Request processed in 60us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.330412:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826741.330421:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787826741.330426:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143615872:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826741.330435:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787826741.330436:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143615104 00000100:00100000:1.0:1787826741.330440:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143615104 00000100:00100000:3.0:1787826741.330455:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614848 00000100:00100000:3.0:1787826741.330461:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614848 00000100:00100000:1.0:1787826741.330471:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826741.330475:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614336 00000100:00100000:2.0:1787826741.330481:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614336 00000100:00100000:1.0:1787826741.330482:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.330491:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787826741.330502:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143614848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330510:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787826741.330520:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143614336:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826741.330532:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143615104:12345-0@lo:400:kworker.0 Request processed in 46us (897us total) trans 0 rc 0/0 00002000:00000024:2.0:1787826741.330540:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826741.330548:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143614848:12345-0@lo:400:kworker.0 Request processed in 47us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.330552:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787826741.330562:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826741.330588:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143614336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826741.330596:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787826741.330616:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826741.330636:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143614592 00000100:00100000:1.0:1787826741.330639:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143614592 00000100:00100000:3.0:1787826741.330647:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143614976:0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330659:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143616384:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787826741.330668:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b2d00 x1874672143615488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826741.330679:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787826741.330684:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143615488:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330691:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:3617:x1874672143614592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330695:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826741.330703:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b30c0 x1874672143616000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826741.330713:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143616000:0@lo:400:kworker.0 00010000:00080000:3.0:1787826741.330730:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5453268780 x1874672143614464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826741.330739:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c1a40 x1874672143614336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826741.330739:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787826741.330743:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:3617:x1874672143614592:12345-0@lo:400:kworker.0 Request processed in 54us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.330760:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787826741.330762:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143614464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826741.330768:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143614336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826741.330790:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826741.330799:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143616256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826741.330804:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143616512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826741.330808:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143614592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330824:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143615104:0@lo:400:kworker.0 00000100:00100000:2.0:1787826741.330831:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787826741.330843:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b1a40 x1874672143615616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826741.330849:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787826741.330856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826741.330866:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143615616:0@lo:400:kworker.0 00000100:00100000:0.0:1787826741.330884:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143614848:0@lo:400:kworker.0 00010000:00080000:1.0:1787826741.330890:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b21c0 x1874672143616128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826741.330900:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143616128:0@lo:400:kworker.0 00010000:00080000:0.0:1787826741.330905:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b0f00 x1874672143615360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826741.330909:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616384 00000100:00100000:3.0:1787826741.330916:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616384 00000100:00100000:0.0:1787826741.330917:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143615360:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330928:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616256 00000100:00100000:1.0:1787826741.330934:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616256 00010000:00080000:0.0:1787826741.330935:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b12c0 x1874672143615872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826741.330939:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616512 00000100:00100000:3.0:1787826741.330945:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616512 00000100:00100000:0.0:1787826741.330952:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143615872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826741.330968:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787826741.330974:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143614720:0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.330975:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826741.330981:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143616256:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826741.330990:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143616384:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826741.330996:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143615232:0@lo:400:kworker.0 00000004:00000024:1.0:1787826741.331002:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00002000:00000024:3.0:1787826741.331003:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826741.331010:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143615744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826741.331056:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143616384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.331061:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143616256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826741.331078:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826741.331090:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826741.331096:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787826741.331097:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143616512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826741.331108:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826741.331137:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143616256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826741.331151:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143616512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (296us total) trans 0 rc 0/0 00010000:00080000:2.0:1787826741.331157:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356580 x1874672143616384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826741.331162:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787826741.331167:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c3480 x1874672143616512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826741.331183:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143616384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826741.331186:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143616512:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826741.458432:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826741.649990:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826741.650025:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826741.650039:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134144 00000100:00100000:0.0:1787826741.650049:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134144 00000100:00100000:1.0:1787826741.650058:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826741.650094:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826741.650119:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 225 00000100:00100000:1.0:1787826741.650123:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826741.650134:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2393:x1874672134134144:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826741.650146:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134656 00000100:00100000:1.0:1787826741.650151:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134656 00000100:00100000:1.0:1787826741.650192:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134528 00000100:00100000:1.0:1787826741.650196:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134528 00000100:00100000:0.0:1787826741.650205:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2393:x1874672134134144:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.650236:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 225 00000100:00100000:0.0:1787826741.650274:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:0.0:1787826741.650282:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134134656:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826741.650309:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134134656:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.650314:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00080000:0.0:1787826741.650440:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826741.650452:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134400 00000100:00100000:0.0:1787826741.650456:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134400 00000100:00100000:0.0:1787826741.650489:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134272 00000100:00100000:0.0:1787826741.650492:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134272 00000100:00100000:0.0:1787826741.650518:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00100000:0.0:1787826741.650524:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134134400:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826741.650561:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134134400:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.650568:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00100000:0.0:1787826741.650581:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:0.0:1787826741.650586:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2393:x1874672134134272:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826741.650602:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2393:x1874672134134272:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 17us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826741.650612:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00080000:0.0:1787826741.650693:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826741.650696:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826741.650960:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:1.0:1787826741.650970:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134134528:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826741.651004:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134134528:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826741.651011:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00080000:0.0:1787826741.651038:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1787826742.033338:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826742.033345:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d534260c000 from 4 10000000:01000000:0.0:1787826742.033350:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826742.033398:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.033410:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.033421:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826742.033445:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143616640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.033512:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826742.033579:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616640 00000100:00100000:1.0:1787826742.033587:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616640 00000100:00100000:0.0:1787826742.033591:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826742.033644:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787826742.033654:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143616640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826742.033667:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826742.033679:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79535a0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.033720:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 21 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.033732:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 21 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.033742:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6400, rc 0) 00000100:00100000:1.0:1787826742.033796:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143616640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826742.033803:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787826742.034267:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143616640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826742.034281:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.034292:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826742.034352:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143616768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.034380:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.034419:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826742.034458:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616768 00000100:00100000:2.0:1787826742.034470:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616768 00000100:00100000:2.0:1787826742.034505:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787826742.034513:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143616768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826742.034630:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143616768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826742.034637:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787826742.034665:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143616768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.034689:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143616896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.034723:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.034740:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826742.034766:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143616896 00000100:00100000:2.0:1787826742.034771:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143616896 00000100:00100000:2.0:1787826742.034800:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787826742.034806:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143616896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826742.034885:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143616896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826742.034891:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787826742.034997:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143616896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826742.035369:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10466:1874672143617024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826742.035406:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826742.035437:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826742.035495:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617024 00000100:00100000:0.0:1787826742.035500:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617024 00000100:00100000:0.0:1787826742.035567:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787826742.035575:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10466:x1874672143617024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826742.035658:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10466:x1874672143617024:12345-0@lo:502:llog_process_th.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.035665:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787826742.035700:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10466:1874672143617024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787826742.035726:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826742.035736:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826742.035738:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787826742.035745:0:10466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d534260c000 00000020:00000080:1.0:1787826742.035748:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787826742.035827:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10466:1874672143617152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826742.035865:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826742.036098:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826742.036987:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617152 00000100:00100000:0.0:1787826742.036995:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617152 00000100:00100000:0.0:1787826742.037035:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787826742.037042:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10466:x1874672143617152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826742.037154:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:10466:x1874672143617152:12345-0@lo:502:llog_process_th.0 Request processed in 112us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.037161:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787826742.037192:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10466:1874672143617152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787826742.037239:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826742.037246:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826742.037248:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787826742.037252:0:10466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787826742.037568:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787826742.037591:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787826742.037600:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.037611:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826742.037630:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826742.037633:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d547d072000 from 4 10000000:01000000:0.0:1787826742.037636:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826742.037661:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.037668:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.037677:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826742.037693:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.037724:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.037767:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d2729c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826742.037820:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617280 00000100:00100000:1.0:1787826742.037824:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617280 00000100:00100000:1.0:1787826742.037852:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787826742.037864:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143617280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826742.037871:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826742.037880:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79535ae expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.037901:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.037911:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.037919:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7a00, rc 0) 00000100:00100000:1.0:1787826742.037955:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143617280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826742.037961:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787826742.038027:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826742.038036:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.038042:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826742.038098:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.038118:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.038129:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d2729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826742.038138:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617408 00000100:00100000:0.0:1787826742.038141:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617408 00000100:00100000:0.0:1787826742.038164:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787826742.038168:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143617408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.038261:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143617408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.038268:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787826742.038302:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.038327:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.038355:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.038375:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d2729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826742.038390:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617536 00000100:00100000:2.0:1787826742.038396:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617536 00000100:00100000:2.0:1787826742.038422:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787826742.038431:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143617536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826742.038523:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143617536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826742.038529:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787826742.038550:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.039347:0:10468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10468:1874672143617664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826742.039398:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.039423:0:10468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826742.040985:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617664 00000100:00100000:0.0:1787826742.040996:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617664 00000100:00100000:0.0:1787826742.041046:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787826742.041054:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10468:x1874672143617664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826742.041198:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10468:x1874672143617664:12345-0@lo:502:llog_process_th.0 Request processed in 145us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.041204:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787826742.041260:0:10468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10468:1874672143617664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826742.041458:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826742.041469:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826742.041472:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787826742.041479:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547d072000 00000020:00000080:3.0:1787826742.041487:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787826742.041589:0:10468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10468:1874672143617792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826742.041634:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.041663:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617792 00000100:00100000:3.0:1787826742.041666:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617792 00000100:00100000:3.0:1787826742.041691:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787826742.041697:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10468:x1874672143617792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826742.041767:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:10468:x1874672143617792:12345-0@lo:502:llog_process_th.0 Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826742.041773:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787826742.042093:0:10468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826742.042109:0:10468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10468:1874672143617792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826742.042132:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826742.042137:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826742.042139:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787826742.042143:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787826742.042202:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787826742.042534:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826742.042545:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.042557:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826742.042572:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787826742.042575:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d54789ce800 from 4 10000000:01000000:3.0:1787826742.042578:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826742.042611:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.042631:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.042643:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826742.042659:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.042694:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.042877:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826742.042980:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143617920 00000100:00100000:0.0:1787826742.042986:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143617920 00000100:00100000:0.0:1787826742.043020:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787826742.043027:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143617920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826742.043037:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826742.043049:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79535bc expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.043081:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.043103:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826742.043112:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c81800, rc 0) 00000100:00100000:0.0:1787826742.043149:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143617920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.043155:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787826742.043263:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143617920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826742.043277:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.043286:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826742.043335:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.043378:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.043406:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826742.043414:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618048 00000100:00100000:1.0:1787826742.043419:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618048 00000100:00100000:1.0:1787826742.043482:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787826742.043491:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143618048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826742.043614:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143618048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826742.043622:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787826742.043887:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.043920:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.043967:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.043991:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826742.044019:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618176 00000100:00100000:0.0:1787826742.044024:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618176 00000100:00100000:0.0:1787826742.044057:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787826742.044078:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143618176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.044171:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143618176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.044179:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787826742.044247:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.045034:0:10470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10470:1874672143618304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826742.045092:0:10470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.045121:0:10470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826742.045171:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618304 00000100:00100000:1.0:1787826742.045176:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618304 00000100:00100000:1.0:1787826742.045233:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787826742.045241:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10470:x1874672143618304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826742.045485:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10470:x1874672143618304:12345-0@lo:502:llog_process_th.0 Request processed in 244us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826742.045500:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787826742.045749:0:10470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10470:1874672143618304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826742.045776:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826742.045785:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826742.045787:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787826742.045794:0:10470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d54789ce800 00000020:00000080:0.0:1787826742.045796:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787826742.045913:0:10470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10470:1874672143618432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826742.045951:0:10470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.046017:0:10470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826742.046371:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618432 00000100:00100000:1.0:1787826742.046376:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618432 00000100:00100000:1.0:1787826742.046417:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787826742.046425:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10470:x1874672143618432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826742.046632:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:10470:x1874672143618432:12345-0@lo:502:llog_process_th.0 Request processed in 207us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826742.046639:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787826742.046717:0:10470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10470:1874672143618432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826742.046740:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826742.046745:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826742.046746:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787826742.046750:0:10470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787826742.046829:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787826742.046859:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826742.046869:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.046880:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826742.046890:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787826742.046891:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5448400800 from 4 10000000:01000000:3.0:1787826742.046894:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826742.046928:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.046937:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.046958:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826742.046974:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.047000:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.047028:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826742.047038:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618560 00000100:00100000:1.0:1787826742.047044:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618560 00000100:00100000:1.0:1787826742.047089:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787826742.047097:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143618560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826742.047106:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826742.047125:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79535ca expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.047147:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.047158:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826742.047166:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6e00, rc 0) 00000100:00100000:1.0:1787826742.047234:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143618560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826742.047243:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787826742.047275:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826742.047291:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.047368:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826742.047421:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.047466:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.047496:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826742.047626:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618688 00000100:00100000:0.0:1787826742.047636:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618688 00000100:00100000:0.0:1787826742.047676:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787826742.047685:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143618688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.047771:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143618688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.047776:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787826742.047803:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.047833:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826742.047871:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826742.047894:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826742.047935:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618816 00000100:00100000:1.0:1787826742.047945:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618816 00000100:00100000:1.0:1787826742.047976:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787826742.047981:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143618816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826742.048077:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143618816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826742.048089:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787826742.048097:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143618816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826742.048708:0:10471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10471:1874672143618944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826742.048752:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.048816:0:10471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826742.048849:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143618944 00000100:00100000:3.0:1787826742.048853:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143618944 00000100:00100000:3.0:1787826742.048930:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787826742.048939:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:10471:x1874672143618944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826742.049275:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:10471:x1874672143618944:12345-0@lo:502:llog_process_th.0 Request processed in 335us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826742.049283:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787826742.049291:0:10471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10471:1874672143618944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826742.049322:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826742.049330:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826742.049338:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787826742.049346:0:10471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5448400800 00000020:00000080:2.0:1787826742.049349:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787826742.049472:0:10471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10471:1874672143619072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826742.049522:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826742.049542:0:10471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826742.049808:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619072 00000100:00100000:3.0:1787826742.049814:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619072 00000100:00100000:3.0:1787826742.049851:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787826742.049972:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:10471:x1874672143619072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826742.050075:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:10471:x1874672143619072:12345-0@lo:502:llog_process_th.0 Request processed in 216us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826742.050083:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787826742.050106:0:10471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:10471:1874672143619072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826742.050139:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826742.050144:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826742.050145:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787826742.050149:0:10471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787826742.050210:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787826742.050255:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826742.050264:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826742.050287:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826742.354534:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826742.354557:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143619200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826742.354633:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826742.354668:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619200 00000100:00100000:0.0:1787826742.354676:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619200 00000100:00100000:0.0:1787826742.354732:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787826742.354802:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143619200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826742.354836:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826742.354881:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143619200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826742.354886:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787826742.354936:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143619200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826742.481402:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826743.360501:0:10657:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787826743.506134:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826744.530364:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826745.203434:0:10900:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing yml_node 00010000:00010000:1.0:1787826745.554030:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826746.449425:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143619584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826746.449443:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143619328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826746.449449:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143619456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826746.449500:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826746.449501:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826746.449569:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143620096:0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.449572:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143619840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826746.449631:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826746.449631:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826746.449664:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619328 00000100:00100000:0.0:1787826746.449666:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143620352:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.449670:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143620608:0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.449673:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619328 00000100:00100000:0.0:1787826746.449709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826746.449724:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826746.449726:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619840 00000100:00100000:3.0:1787826746.449731:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619840 00000100:00100000:0.0:1787826746.449738:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143620864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.449752:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143621120:0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.449758:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826746.449770:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826746.449774:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143619328:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826746.449795:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826746.449801:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00002000:00000024:3.0:1787826746.449806:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826746.449812:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143619968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.449824:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787826746.449838:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143619712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826746.449859:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826746.449882:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143619328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.449887:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826746.449896:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826746.449898:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143620480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.449909:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143620224:0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.449916:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619712 00000100:00100000:3.0:1787826746.449921:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619712 00000100:00100000:0.0:1787826746.449934:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826746.449949:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787826746.449958:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826746.449959:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826746.449964:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143620992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.449964:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143619840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826746.449989:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826746.449991:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143620736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.450002:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826746.450042:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826746.450048:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620096 00010000:00080000:0.0:1787826746.450051:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c3480 x1874672143619328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826746.450054:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143619840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826746.450055:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620096 00000100:00100000:1.0:1787826746.450065:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143621248:0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.450073:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787826746.450087:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143619328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826746.450088:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619456 00000100:00100000:3.0:1787826746.450095:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619456 00000100:00100000:2.0:1787826746.450098:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620608 00000100:00100000:2.0:1787826746.450103:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620608 00000100:00100000:1.0:1787826746.450115:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787826746.450125:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356580 x1874672143619840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826746.450126:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787826746.450132:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620864 00000100:00100000:2.0:1787826746.450137:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620864 00000100:00100000:3.0:1787826746.450141:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143619712:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826746.450151:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143619840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826746.450154:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619584 00002000:00000024:3.0:1787826746.450154:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826746.450160:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619584 00000100:00100000:2.0:1787826746.450160:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620480 00000100:00100000:2.0:1787826746.450170:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620480 00000100:00100000:0.0:1787826746.450186:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143619968 00000100:00100000:0.0:1787826746.450192:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143619968 00000100:00100000:2.0:1787826746.450196:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620224 00000100:00100000:2.0:1787826746.450201:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620224 00000100:00100000:1.0:1787826746.450203:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620352 00000100:00100000:1.0:1787826746.450208:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620352 00000100:00100000:3.0:1787826746.450209:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143619712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826746.450243:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787826746.450247:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620992 00000100:00100000:2.0:1787826746.450253:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620992 00000100:00100000:1.0:1787826746.450259:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787826746.450265:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826746.450273:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787826746.450273:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143619584:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826746.450278:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143619456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826746.450283:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787826746.450289:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143619968:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787826746.450295:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826746.450298:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143620096:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1787826746.450304:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787826746.450347:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143619456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826746.450353:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826746.450364:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143619968:12345-0@lo:400:kworker.0 Request processed in 79us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826746.450370:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143620096:12345-0@lo:400:kworker.0 Request processed in 75us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.450372:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143619584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826746.450385:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787826746.450388:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826746.450396:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787826746.450397:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787826746.450410:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143620352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.450424:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826746.450433:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787826746.450437:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143620608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.450445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826746.450447:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143620864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.450459:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143620480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.450461:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143620352:12345-0@lo:400:kworker.0 Request processed in 52us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826746.450473:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787826746.450486:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143620608:12345-0@lo:400:kworker.0 Request processed in 52us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.450495:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826746.450502:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143620864:12345-0@lo:400:kworker.0 Request processed in 58us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826746.450511:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787826746.450516:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d3570c0 x1874672143619456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826746.450523:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143620480:12345-0@lo:400:kworker.0 Request processed in 64us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.450523:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787826746.450535:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826746.450540:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143620224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.450546:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787826746.450549:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143619456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826746.450551:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143620992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.450581:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143620224:12345-0@lo:400:kworker.0 Request processed in 45us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.450589:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787826746.450592:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356d00 x1874672143619712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826746.450601:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143619968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.450612:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143619712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826746.450618:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143621120 00000100:00100000:0.0:1787826746.450623:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143620480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.450630:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143621120 00000100:00100000:3.0:1787826746.450634:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143620224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.450645:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143620352:0@lo:400:kworker.0 00010000:00080000:3.0:1787826746.450658:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d6d00 x1874672143620608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826746.450667:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143620864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.450667:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143620736 00000100:00100000:3.0:1787826746.450672:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143620608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.450673:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143620736 00000100:00100000:1.0:1787826746.450706:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143621248 00000100:00100000:3.0:1787826746.450706:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143620096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.450712:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143621248 00000100:00100000:3.0:1787826746.450731:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143619584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826746.450735:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826746.450744:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787826746.450750:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143621120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826746.450757:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143620736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.450801:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143621120:12345-0@lo:400:kworker.0 Request processed in 56us (1005us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826746.450801:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826746.450809:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826746.450814:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826746.450814:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143620736:12345-0@lo:400:kworker.0 Request processed in 59us (769us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826746.450815:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826746.450820:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826746.450822:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143620992:12345-0@lo:400:kworker.0 Request processed in 274us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.450830:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787826746.450835:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787826746.450839:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787826746.450850:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143621248:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826746.450852:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d4f00 x1874672143620736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826746.450865:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143620736:0@lo:400:kworker.0 00010000:00080000:3.0:1787826746.450881:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d6940 x1874672143621120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826746.450890:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143621248:12345-0@lo:400:kworker.0 Request processed in 42us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826746.450891:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143621120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826746.450905:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787826746.450916:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d43c0 x1874672143620992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826746.450923:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d5680 x1874672143621248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826746.450932:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143620992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826746.450937:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143621248:0@lo:400:kworker.0 00010000:00010000:2.0:1787826746.577365:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826746.769117:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826746.769171:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826746.769172:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134784 00000100:00100000:2.0:1787826746.769181:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134784 00000100:00100000:0.0:1787826746.769205:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135040 00000100:00100000:0.0:1787826746.769209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135040 00000100:00100000:2.0:1787826746.769259:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 247 00000100:00100000:2.0:1787826746.769273:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2390:x1874672134134784:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826746.769281:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826746.769304:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:1.0:1787826746.769308:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826746.769324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2390:x1874672134135040:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826746.769331:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135296 00000100:00100000:1.0:1787826746.769336:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135296 00000100:00100000:2.0:1787826746.769365:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2390:x1874672134134784:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826746.769368:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2390:x1874672134135040:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.769375:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:2.0:1787826746.769381:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 247 00000100:00100000:0.0:1787826746.769387:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:1.0:1787826746.769388:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2390:x1874672134135296:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826746.769410:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134134912 00000100:00100000:0.0:1787826746.769414:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134134912 00000100:00100000:1.0:1787826746.769423:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2390:x1874672134135296:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.769431:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:0.0:1787826746.769453:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:0.0:1787826746.769464:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2390:x1874672134134912:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787826746.769484:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826746.769490:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826746.769493:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826746.769498:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2390:x1874672134134912:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826746.769508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:2.0:1787826746.769696:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826746.769944:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135168 00000100:00100000:1.0:1787826746.769948:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135168 00000100:00100000:1.0:1787826746.769991:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00080000:2.0:1787826746.769993:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826746.770000:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2390:x1874672134135168:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826746.770046:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2390:x1874672134135168:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826746.770053:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 17 00000001:02000400:1.0:1787826747.002091:0:11083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.68 00000100:00100000:0.0:1787826747.473445:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143621376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826747.473513:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826747.473596:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143621376 00000100:00100000:0.0:1787826747.473604:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143621376 00000100:00100000:0.0:1787826747.473645:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787826747.473667:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143621376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826747.473697:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826747.473745:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143621376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826747.473752:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826747.473790:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143621376:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826747.601560:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826747.955400:0:11180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.68 00010000:00010000:1.0:1787826748.625418:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826749.057291:0:11277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.68 00010000:00010000:3.0:1787826749.649306:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826749.701648:0:11326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: replay-ost-single ============----- Thu Aug 27 06:32:29 EDT 2026 00010000:00010000:1.0:1787826750.673784:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826751.569438:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143621504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826751.569517:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.569598:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143621504 00000100:00100000:0.0:1787826751.569608:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143621504 00000100:00080000:2.0:1787826751.569650:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826751.569663:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787826751.569672:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143621504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826751.569697:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826751.569737:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143621504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.569743:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787826751.569783:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343ac4b40 x1874672143621504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826751.569801:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143621504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826751.569901:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826751.569910:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143621632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826751.569942:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826751.569981:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143621632 00000100:00100000:1.0:1787826751.569985:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143621632 00000100:00100000:1.0:1787826751.570032:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826751.570039:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143621632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826751.570055:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826751.570096:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143621632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826751.570102:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787826751.570120:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787826751.570138:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7f21c0 x1874672143621632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826751.570151:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143621632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826751.570313:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143621760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826751.570344:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826751.570375:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143621760 00000100:00100000:1.0:1787826751.570378:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143621760 00000100:00100000:1.0:1787826751.570405:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787826751.570413:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143621760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826751.570434:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787826751.570656:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143622144:0@lo:400:kworker.0 00000100:00100000:1.0:1787826751.570695:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143621760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 284us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826751.570702:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787826751.570726:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143621888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.570780:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.570800:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143622656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.570823:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.570843:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143623168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826751.570862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.570890:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787826751.570895:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143622272:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.570928:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.570946:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143622784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.570967:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.570983:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143623296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826751.571018:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.571044:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622272 00000100:00100000:0.0:1787826751.571047:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622272 00000100:00100000:0.0:1787826751.571082:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787826751.571091:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143622272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571136:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143622272:12345-0@lo:400:kworker.0 Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.571143:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787826751.571163:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143622272:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571164:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622144 00000100:00100000:0.0:1787826751.571167:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622144 00000100:00100000:0.0:1787826751.571198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622656 00000100:00100000:0.0:1787826751.571201:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622656 00000100:00100000:3.0:1787826751.571201:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622784 00000100:00100000:3.0:1787826751.571203:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622784 00000100:00100000:0.0:1787826751.571249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787826751.571259:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826751.571260:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143622144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.571266:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143622656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143622144:12345-0@lo:400:kworker.0 Request processed in 43us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826751.571298:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143622656:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.571304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787826751.571309:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826751.571321:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826751.571327:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143622784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.571346:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143622144:0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.571357:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143622656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571359:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143622784:12345-0@lo:400:kworker.0 Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.571364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787826751.571377:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5453268780 x1874672143622784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826751.571386:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143622016:0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.571386:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143622784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571413:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826751.571432:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622016 00000100:00100000:0.0:1787826751.571434:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143622528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.571435:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622016 00000100:00100000:0.0:1787826751.571457:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826751.571462:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622528 00000100:00100000:3.0:1787826751.571465:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622528 00000100:00100000:3.0:1787826751.571485:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826751.571486:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143623040:0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.571492:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143622016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571510:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826751.571521:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143622016:12345-0@lo:400:kworker.0 Request processed in 31us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826751.571526:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787826751.571540:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826751.571544:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143622016:0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.571547:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143622528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571572:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623040 00000100:00100000:0.0:1787826751.571575:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623040 00000100:00100000:3.0:1787826751.571581:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143622528:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826751.571586:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826751.571604:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826751.571613:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143623040:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826751.571613:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343ac5a40 x1874672143622528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826751.571622:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143622528:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571654:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143623040:12345-0@lo:400:kworker.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.571661:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787826751.571661:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d3570c0 x1874672143623040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826751.571677:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143623040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.571717:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143621760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826751.571735:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623168 00000100:00100000:0.0:1787826751.571737:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623168 00000100:00100000:0.0:1787826751.571752:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623296 00000100:00100000:0.0:1787826751.571753:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623296 00000100:00100000:0.0:1787826751.571767:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826751.571772:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143623168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826751.571784:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826751.571830:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143623168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.571838:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826751.571853:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787826751.571860:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143623296:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787826751.571863:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d4f00 x1874672143623168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1787826751.571870:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826751.571875:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143623168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826751.571900:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143623296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (882us total) trans 0 rc 0/0 00010000:00080000:3.0:1787826751.571902:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d6d00 x1874672143623296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826751.571906:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787826751.571915:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143623296:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787826751.571932:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826751.571937:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826751.571945:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826751.571948:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826751.572072:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826751.572108:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143622400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.572110:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143621888 00000100:00100000:0.0:1787826751.572113:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143621888 00000100:00100000:1.0:1787826751.572136:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.572150:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787826751.572153:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143622912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.572157:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143621888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826751.572177:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826751.572189:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143621888:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.572196:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787826751.572202:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143621888:0@lo:400:kworker.0 00000100:00100000:1.0:1787826751.572243:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622912 00000100:00100000:1.0:1787826751.572247:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622912 00000100:00100000:1.0:1787826751.572279:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787826751.572287:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143622912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.572326:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143622400 00000100:00100000:1.0:1787826751.572329:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143622912:12345-0@lo:400:kworker.0 Request processed in 45us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826751.572330:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143622400 00000100:00100000:1.0:1787826751.572336:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787826751.572362:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826751.572370:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787826751.572377:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356d00 x1874672143622912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826751.572382:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143622400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826751.572399:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143622912:0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.572428:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143622400:12345-0@lo:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.572430:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143622400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826751.572438:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787826751.697452:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826751.889624:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826751.889675:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826751.889707:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826751.889723:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135680 00000100:00100000:1.0:1787826751.889723:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135424 00000100:00100000:0.0:1787826751.889734:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135680 00000100:00100000:1.0:1787826751.889734:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135424 00000100:00100000:2.0:1787826751.889746:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826751.889793:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 249 00000100:00100000:0.0:1787826751.889798:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135552 00000100:00100000:0.0:1787826751.889803:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135552 00000100:00100000:1.0:1787826751.889810:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2392:x1874672134135424:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826751.889811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826751.889835:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 51 00000100:00100000:0.0:1787826751.889843:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134135680:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826751.889854:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135936 00000100:00100000:2.0:1787826751.889860:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135936 00000100:00100000:1.0:1787826751.889898:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2392:x1874672134135424:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.889900:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134135680:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826751.889906:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134135808 00000100:00100000:2.0:1787826751.889912:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134135808 00000100:00100000:1.0:1787826751.889916:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 249 00000100:00100000:0.0:1787826751.889917:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 51 00000100:00100000:0.0:1787826751.889942:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 52 00000100:00100000:0.0:1787826751.889950:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2392:x1874672134135552:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826751.889956:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00080000:1.0:1787826751.889961:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826751.889967:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826751.889969:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134135936:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787826751.889972:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826751.889978:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826751.889980:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2392:x1874672134135552:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826751.890012:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 52 00000100:00100000:1.0:1787826751.890022:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:2.0:1787826751.890025:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134135936:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 59us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826751.890038:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134135808:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826751.890038:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:1.0:1787826751.890073:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134135808:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826751.890080:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:1.0:1787826752.594340:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826752.594361:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143623424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826752.594436:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826752.594484:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623424 00000100:00100000:2.0:1787826752.594492:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623424 00000100:00100000:2.0:1787826752.594548:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787826752.594558:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143623424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826752.594590:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826752.594640:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143623424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826752.594648:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787826752.594683:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143623424:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826752.721422:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826753.745362:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826754.769315:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826755.653047:0:12051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 00010000:00010000:1.0:1787826755.793376:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826756.294029:0:12099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === replay-ost-single: start setup 06:32:35 (1787826755) === 00000100:00100000:1.0:1787826756.689353:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143623680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826756.689356:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143623552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826756.689383:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143623936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826756.689428:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826756.689435:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.689438:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143623808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826756.689472:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.689495:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143624320:0@lo:400:kworker.0 00000100:00100000:1.0:1787826756.689505:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143624192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826756.689505:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143624064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826756.689519:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.689543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143624832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826756.689546:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826756.689562:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826756.689570:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143624576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826756.689577:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826756.689599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.689605:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143625344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826756.689612:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826756.689622:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143624704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826756.689642:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143624448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826756.689644:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826756.689665:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143625088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826756.689673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.689678:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826756.689687:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143625216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826756.689699:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624320 00000100:00100000:2.0:1787826756.689705:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624320 00000100:00100000:3.0:1787826756.689724:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.689735:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623552 00000100:00100000:1.0:1787826756.689738:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623680 00000100:00100000:0.0:1787826756.689740:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623552 00000100:00100000:1.0:1787826756.689744:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623680 00000100:00100000:2.0:1787826756.689746:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624832 00000100:00100000:2.0:1787826756.689750:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624832 00000100:00100000:2.0:1787826756.689776:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624576 00000100:00100000:2.0:1787826756.689778:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624576 00000100:00100000:0.0:1787826756.689782:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623808 00000100:00100000:0.0:1787826756.689786:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623808 00000100:00100000:1.0:1787826756.689787:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624704 00000100:00100000:1.0:1787826756.689792:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624704 00000100:00100000:2.0:1787826756.689795:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625344 00000100:00100000:2.0:1787826756.689804:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625344 00000100:00100000:0.0:1787826756.689805:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624064 00000100:00100000:0.0:1787826756.689809:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624064 00000100:00100000:1.0:1787826756.689822:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826756.689833:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143623936 00000100:00100000:2.0:1787826756.689833:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826756.689838:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143623936 00000100:00100000:1.0:1787826756.689838:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143623680:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826756.689846:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143624320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826756.689857:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826756.689863:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143623552:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1787826756.689871:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00002000:00000024:0.0:1787826756.689879:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826756.689903:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143624320:12345-0@lo:400:kworker.0 Request processed in 59us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826756.689911:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826756.689928:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143623552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826756.689935:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826756.689944:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143623680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826756.689945:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143624832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826756.689968:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787826756.689972:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826756.689996:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787826756.690000:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787826756.690005:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143624832:12345-0@lo:400:kworker.0 Request processed in 62us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826756.690007:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143623808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826756.690014:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143624704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826756.690022:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00002000:00000024:0.0:1787826756.690030:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826756.690040:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787826756.690047:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143624576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826756.690076:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143624704:12345-0@lo:400:kworker.0 Request processed in 66us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826756.690079:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143623808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826756.690087:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826756.690089:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787826756.690096:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143624576:12345-0@lo:400:kworker.0 Request processed in 48us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826756.690102:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826756.690106:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826756.690115:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143624064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826756.690121:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787826756.690122:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624192 00002000:00000024:0.0:1787826756.690123:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826756.690127:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624192 00000100:00100000:2.0:1787826756.690138:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143625344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826756.690155:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143624064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826756.690158:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787826756.690166:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826756.690170:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143624192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826756.690172:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143625344:12345-0@lo:400:kworker.0 Request processed in 42us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826756.690181:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787826756.690194:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143623936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826756.690194:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787826756.690204:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143624192:12345-0@lo:400:kworker.0 Request processed in 36us (645us total) trans 0 rc 0/0 00002000:00000024:0.0:1787826756.690206:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826756.690233:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787826756.690253:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143623936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826756.690259:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787826756.690265:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625088 00000100:00100000:1.0:1787826756.690273:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625088 00000100:00100000:0.0:1787826756.690302:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826756.690306:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787826756.690312:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143625088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826756.690328:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826756.690334:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826756.690337:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826756.690343:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143624832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826756.690354:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143625088:12345-0@lo:400:kworker.0 Request processed in 39us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826756.690356:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.690357:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143625344:0@lo:400:kworker.0 00000100:00100000:1.0:1787826756.690371:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787826756.690374:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d369680 x1874672143623808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826756.690387:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625216 00000100:00100000:2.0:1787826756.690387:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143624960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826756.690394:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625216 00000100:00100000:0.0:1787826756.690409:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143623808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826756.690423:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787826756.690429:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826756.690432:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143624320:0@lo:400:kworker.0 00000100:00100000:1.0:1787826756.690435:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143625216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826756.690459:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143625472:0@lo:400:kworker.0 00010000:00080000:0.0:1787826756.690486:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0c3c0 x1874672143625088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826756.690491:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143625216:12345-0@lo:400:kworker.0 Request processed in 58us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826756.690502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826756.690509:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787826756.690514:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143625088:0@lo:400:kworker.0 00010000:00080000:0.0:1787826756.690531:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d369e00 x1874672143624064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826756.690541:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d1392c0 x1874672143623936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826756.690544:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143624064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826756.690563:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143623936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826756.690569:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143624576:0@lo:400:kworker.0 00010000:00080000:0.0:1787826756.690586:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d7c00 x1874672143623552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826756.690599:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143623552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826756.690626:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624960 00000100:00100000:3.0:1787826756.690631:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624960 00000100:00100000:0.0:1787826756.690651:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143624448 00000100:00100000:0.0:1787826756.690656:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143624448 00000100:00100000:3.0:1787826756.690667:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625472 00000100:00100000:3.0:1787826756.690672:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625472 00000100:00100000:0.0:1787826756.690687:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826756.690696:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143624448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826756.690711:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787826756.690722:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143624960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826756.690738:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143624448:12345-0@lo:400:kworker.0 Request processed in 44us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826756.690744:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787826756.690771:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143624960:12345-0@lo:400:kworker.0 Request processed in 51us (341us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826756.690780:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0e940 x1874672143625216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826756.690783:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787826756.690793:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143625216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826756.690796:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787826756.690808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143625472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826756.690835:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143624192:0@lo:400:kworker.0 00000100:00100000:2.0:1787826756.690844:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143625472:12345-0@lo:400:kworker.0 Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826756.690849:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787826756.690854:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143624704:0@lo:400:kworker.0 00000100:00080000:2.0:1787826756.690865:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826756.690875:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143623680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826756.690886:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143624448:0@lo:400:kworker.0 00010000:00080000:2.0:1787826756.690901:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0c780 x1874672143624960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826756.690910:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143624960:0@lo:400:kworker.0 00010000:00080000:2.0:1787826756.690922:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0de00 x1874672143625472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826756.690930:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143625472:0@lo:400:kworker.0 00010000:00010000:0.0:1787826756.817325:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826757.010739:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826757.010783:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136064 00000100:00100000:2.0:1787826757.010786:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826757.010793:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136064 00000100:00100000:2.0:1787826757.010825:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826757.010828:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136320 00000100:00100000:0.0:1787826757.010833:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136320 00000100:00100000:3.0:1787826757.010851:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 251 00000100:00100000:3.0:1787826757.010865:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134136064:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826757.010869:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136192 00000100:00100000:2.0:1787826757.010881:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136192 00000100:00100000:0.0:1787826757.010891:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00100000:0.0:1787826757.010901:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2391:x1874672134136320:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826757.010929:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 60 00000100:00100000:3.0:1787826757.010931:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134136064:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826757.010941:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 251 00000100:00100000:2.0:1787826757.010947:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134136192:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826757.010962:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2391:x1874672134136320:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826757.010971:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00080000:0.0:1787826757.010997:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826757.011002:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826757.011006:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2391:x1874672134136192:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826757.011017:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 60 00000100:00100000:0.0:1787826757.012171:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826757.012203:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826757.012254:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136448 00000100:00100000:1.0:1787826757.012256:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136576 00000100:00100000:1.0:1787826757.012260:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136576 00000100:00100000:2.0:1787826757.012260:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136448 00000100:00100000:1.0:1787826757.012310:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:1.0:1787826757.012319:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2389:x1874672134136576:12345-192.168.203.6@tcp:9:kworker.0 00000020:00000080:1.0:1787826757.012356:0:10061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79534ce 00000100:00080000:1.0:1787826757.012368:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d547f767800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787826757.012396:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:2.0:1787826757.012405:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2389:x1874672134136448:12345-192.168.203.6@tcp:9:kworker.0 00000100:00080000:0.0:1787826757.012407:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826757.012412:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1787826757.012415:0:10061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000020:00000080:2.0:1787826757.012424:0:8401:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79534c7 00000100:00080000:2.0:1787826757.012431:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8d5343518000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826757.012447:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826757.012462:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787826757.012465:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787826757.012703:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:623ddf66-2f94-46d4-a38e-7bde7caf88c3+2:2389:x1874672134136576:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 385us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826757.012703:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+2:2389:x1874672134136448:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 299us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826757.012712:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:1.0:1787826757.012719:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:2.0:1787826757.713485:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826757.713518:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143625600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826757.713623:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826757.713698:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625600 00000100:00100000:0.0:1787826757.713708:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625600 00000100:00100000:0.0:1787826757.713772:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826757.713783:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143625600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826757.713826:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826757.713885:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143625600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826757.713893:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826757.713939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143625600:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826757.841446:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826758.218688:0:12292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787826758.865431:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826759.889397:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826760.841756:0:12606:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826760.841901:0:12606:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787826760.913329:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787826761.526438:0:12704:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826761.526633:0:12704:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787826761.809403:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143625984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826761.809417:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826761.809434:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143625856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826761.809474:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826761.809540:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826761.809555:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143626496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826761.809589:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143625728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826761.809616:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826761.809649:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826761.809651:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143626496 00000100:00100000:2.0:1787826761.809662:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143626496 00000100:00100000:1.0:1787826761.809663:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143627008:0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.809679:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625984 00000100:00100000:0.0:1787826761.809687:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625984 00000100:00100000:1.0:1787826761.809709:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826761.809724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627008 00000100:00100000:0.0:1787826761.809728:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625856 00000100:00100000:2.0:1787826761.809729:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627008 00000100:00100000:0.0:1787826761.809734:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625856 00000100:00100000:1.0:1787826761.809741:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143627520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.809764:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143625728 00000100:00100000:0.0:1787826761.809768:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143625728 00000100:00100000:2.0:1787826761.809769:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787826761.809775:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826761.809784:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143626496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.809793:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787826761.809805:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143625984:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787826761.809818:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826761.809823:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826761.809828:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787826761.809830:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826761.809845:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826761.809853:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143626496:12345-0@lo:400:kworker.0 Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826761.809868:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787826761.809872:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143626752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.809890:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143625984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826761.809896:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627520 00000100:00100000:3.0:1787826761.809898:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143626368:0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.809900:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826761.809904:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627520 00000100:00100000:1.0:1787826761.809918:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826761.809946:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143626240 00000100:00100000:0.0:1787826761.809951:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143626240 00000100:00100000:1.0:1787826761.809951:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143627264:0@lo:400:kworker.0 00000100:00100000:2.0:1787826761.809958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143626752 00000100:00100000:2.0:1787826761.809963:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143626752 00000100:00100000:0.0:1787826761.809986:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787826761.809992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787826761.809999:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143625856:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826761.810006:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143627008:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787826761.810015:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826761.810026:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826761.810035:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826761.810089:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143626880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826761.810094:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787826761.810097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143627008:12345-0@lo:400:kworker.0 Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826761.810102:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143625856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826761.810116:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143626112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826761.810127:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787826761.810127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787826761.810151:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826761.810158:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787826761.810168:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143625728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826761.810171:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143626624:0@lo:400:kworker.0 00000100:00100000:2.0:1787826761.810173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787826761.810184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143627520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826761.810197:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787826761.810198:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826761.810268:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143626368 00000100:00100000:1.0:1787826761.810276:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143627136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826761.810277:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143626368 00000100:00100000:2.0:1787826761.810285:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143627520:12345-0@lo:400:kworker.0 Request processed in 99us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826761.810297:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143625728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826761.810297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787826761.810321:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826761.810325:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826761.810329:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787826761.810346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143626752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826761.810353:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787826761.810354:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826761.810356:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143627648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826761.810372:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143626368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.810376:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143626240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826761.810397:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826761.810403:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826761.810409:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143626752:12345-0@lo:400:kworker.0 Request processed in 68us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826761.810418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787826761.810438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627136 00000100:00100000:2.0:1787826761.810443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627136 00000100:00100000:1.0:1787826761.810461:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143626752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.810483:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143626240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826761.810483:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143626368:12345-0@lo:400:kworker.0 Request processed in 109us (453us total) trans 0 rc 0/0 00010000:00080000:1.0:1787826761.810489:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d36ad00 x1874672143626240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826761.810491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826761.810512:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143627136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826761.810528:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787826761.810529:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826761.810566:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826761.810575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143627136:12345-0@lo:400:kworker.0 Request processed in 68us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826761.810595:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143626112 00000100:00100000:2.0:1787826761.810595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787826761.810600:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143626112 00010000:00080000:1.0:1787826761.810604:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81e580 x1874672143627136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826761.810612:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143627136:0@lo:400:kworker.0 00000100:00080000:2.0:1787826761.810628:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826761.810634:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143626624 00000100:00080000:2.0:1787826761.810634:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826761.810637:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143626624 00000100:00100000:1.0:1787826761.810644:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627264 00000100:00100000:1.0:1787826761.810648:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627264 00000100:00100000:0.0:1787826761.810658:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787826761.810668:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143626112:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826761.810673:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143627008:0@lo:400:kworker.0 00000100:00100000:1.0:1787826761.810688:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627648 00000004:00000024:0.0:1787826761.810693:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787826761.810694:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627648 00010000:00080000:2.0:1787826761.810699:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81f480 x1874672143627520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826761.810702:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826761.810714:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143627520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826761.810730:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826761.810730:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143626496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826761.810747:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143627264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.810751:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143626112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (597us total) trans 0 rc 0/0 00010000:00080000:2.0:1787826761.810758:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7f3840 x1874672143625984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826761.810762:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787826761.810783:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143627392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.810784:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143626880 00000100:00100000:2.0:1787826761.810784:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143625984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826761.810792:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143626880 00000100:00100000:1.0:1787826761.810799:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143627264:12345-0@lo:400:kworker.0 Request processed in 55us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826761.810808:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826761.810821:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826761.810830:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143626624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826761.810837:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826761.810848:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826761.810858:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143627648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.810874:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143626624:12345-0@lo:400:kworker.0 Request processed in 45us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826761.810886:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787826761.810905:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d368f00 x1874672143625856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826761.810913:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787826761.810917:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143627648:12345-0@lo:400:kworker.0 Request processed in 63us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826761.810946:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143626880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826761.810958:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826761.810980:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143625856:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787826761.811006:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0cb40 x1874672143625728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826761.811013:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143626880:12345-0@lo:400:kworker.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826761.811044:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787826761.811049:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143625728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826761.811098:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143626368:0@lo:400:kworker.0 00000100:00100000:0.0:1787826761.811109:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143626112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826761.811136:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143626624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826761.811153:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143626880:0@lo:400:kworker.0 00010000:00080000:0.0:1787826761.811163:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81cb40 x1874672143627648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826761.811179:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143627648:0@lo:400:kworker.0 00010000:00080000:0.0:1787826761.811200:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81e1c0 x1874672143627264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826761.811201:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627392 00000100:00100000:3.0:1787826761.811210:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627392 00000100:00100000:0.0:1787826761.811249:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143627264:0@lo:400:kworker.0 00000100:00080000:0.0:1787826761.811323:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826761.811324:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787826761.811342:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143627392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826761.811416:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143627392:12345-0@lo:400:kworker.0 Request processed in 80us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826761.811424:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787826761.812070:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143627392:0@lo:400:kworker.0 00010000:00010000:1.0:1787826761.937358:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826762.129136:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826762.129175:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826762.129189:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136832 00000100:00100000:0.0:1787826762.129199:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136832 00000100:00100000:3.0:1787826762.129203:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826762.129239:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136704 00000100:00100000:2.0:1787826762.129244:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136704 00000100:00100000:1.0:1787826762.129271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134136960 00000100:00100000:1.0:1787826762.129277:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134136960 00000100:00080000:3.0:1787826762.129286:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826762.129292:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826762.129305:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 253 00000100:00100000:0.0:1787826762.129307:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:2.0:1787826762.129318:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:2393:x1874672134136704:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826762.129322:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2392:x1874672134136832:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826762.129339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:1.0:1787826762.129352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134136960:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826762.129389:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:2393:x1874672134136704:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826762.129392:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2392:x1874672134136832:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826762.129392:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2393:x1874672134136960:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826762.129404:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 253 00000100:00100000:0.0:1787826762.129408:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:1.0:1787826762.129418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 68 00000020:00000004:0.0:1787826762.219853:0:12801:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826762.220077:0:12801:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826762.833374:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143627776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826762.833436:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826762.833491:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627776 00000100:00100000:2.0:1787826762.833499:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627776 00000100:00100000:2.0:1787826762.833559:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787826762.833570:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143627776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826762.833609:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826762.833673:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143627776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826762.833682:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826762.833756:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143627776:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826762.962301:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787826762.990592:0:12898:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826762.990766:0:12898:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:3.0:1787826763.346687:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:3.0:1787826763.346696:0:8395:0:(genops.c:885:class_export_put()) final put ffff8d534351c000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:2.0:1787826763.346756:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534351c000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 for lustre-OST0000 00000001:00100000:0.0:1787826763.346776:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:0.0:1787826763.346782:0:9469:0:(genops.c:885:class_export_put()) final put ffff8d547f760000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:2.0:1787826763.346841:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343518000 for lustre-OST0000 00000020:00000080:2.0:1787826763.346850:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f760000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 for lustre-OST0001 00000020:00000080:2.0:1787826763.346896:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d547f767800 for lustre-OST0001 00000020:00000004:3.0:1787826763.723474:0:12995:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826763.723671:0:12995:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826763.985402:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826764.992586:0:13140:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787826765.009291:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826766.033380:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787826766.159826:0:13287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffd7abfd0 20000000:00000080:1.0:1787826766.159841:0:13287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d5343859000 uarg=0000000000000000 20000000:01000000:1.0:1787826766.159883:0:13287:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787826766.159887:0:13287:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787826766.159904:0:13287:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787826766.160480:0:13288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787826766.160551:0:13287:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787826766.165700:0:13287:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787826766.165730:0:13287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165750:0:13287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165759:0:13287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165765:0:13287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165771:0:13287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165779:0:13287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165804:0:13287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165845:0:13287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.165858:0:13287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 23 pid: 6480 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.165871:0:13287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143627904:0@lo:104: 00000100:00100000:2.0:1787826766.165954:0:13287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826766.166023:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143627904 00010000:00010000:2.0:1787826766.166034:0:13287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826766.166039:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143627904 00010000:00010000:2.0:1787826766.166045:0:13287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 23 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.166058:0:13287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628032:0@lo:104: 00000100:00100000:2.0:1787826766.166094:0:13287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826766.166140:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787826766.166150:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00010000:00010000:2.0:1787826766.166150:0:13287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826766.166165:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143628032 00010000:00010000:2.0:1787826766.166166:0:13287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 23 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826766.166174:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826766.166174:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143628032 00000100:00100000:2.0:1787826766.166190:0:13287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628160:0@lo:104: 00000100:00100000:1.0:1787826766.166195:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:13287:x1874672143627904:12345-0@lo:104: 00000100:00100000:2.0:1787826766.166258:0:13287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826766.166263:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826766.166278:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143628160 00000100:00100000:3.0:1787826766.166286:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f855850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:13287:x1874672143628032:12345-0@lo:104: 00000100:00100000:0.0:1787826766.166288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143628160 00010000:00010000:2.0:1787826766.166299:0:13287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826766.166321:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1787826766.166323:0:13287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 23 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.166334:0:13287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628288:0@lo:104: 00000100:00100000:0.0:1787826766.166340:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:13287:x1874672143628160:12345-0@lo:104: 00000100:00100000:2.0:1787826766.166360:0:13287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826766.166378:0:13287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.166387:0:13287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 9 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.166396:0:13287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628416:192.168.203.6@tcp:104: 00000100:00100000:2.0:1787826766.166442:0:13287:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826766.166480:0:8416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 4 min 2 max 56 00000100:00100000:2.0:1787826766.166487:0:8416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_004' 00010000:00010000:1.0:1787826766.166551:0:6469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826766.166557:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166619:0:6469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826766.166625:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:13287:x1874672143627904:12345-0@lo:104: Request processed in 437us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826766.166628:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143628288 00000100:00100000:2.0:1787826766.166634:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143628288 00000100:00100000:1.0:1787826766.166641:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787826766.166662:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826766.166671:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:13287:x1874672143628288:12345-0@lo:104: 00010000:00010000:3.0:1787826766.166678:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787826766.166681:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826766.166682:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826766.166693:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f855850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+5:13287:x1874672143628032:12345-0@lo:104: Request processed in 414us (593us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826766.166700:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826766.166723:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787826766.166731:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030200 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826766.166738:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.166755:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787826766.166761:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.166763:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:13287:x1874672143628288:12345-0@lo:104: Request processed in 92us (401us total) trans 0 rc 0/0 10000000:00010000:1.0:1787826766.166777:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.166782:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 10000000:01000000:1.0:1787826766.166783:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826766.166816:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166821:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826766.166834:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166839:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5440030200/0xc0fefc09a79535ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166848:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826766.166850:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166854:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030400 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826766.166857:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166861:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826766.166864:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826766.166875:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826766.166880:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826766.166885:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166903:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166918:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826766.166919:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81600 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826766.166925:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166928:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.166940:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.166941:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5440030400/0xc0fefc09a79535bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535c3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826766.166949:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826766.166966:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826766.166974:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826766.166977:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826766.166979:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826766.166987:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826766.166987:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.166995:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826766.167001:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143628544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826766.167021:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.167030:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c81600/0xc0fefc09a79535a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535a7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826766.167038:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826766.167047:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826766.167051:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826766.167054:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826766.167067:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143628800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826766.167069:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826766.167079:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143628672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826766.167114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.167138:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143628544 00000100:00100000:1.0:1787826766.167142:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143628544 00000100:00100000:2.0:1787826766.167165:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143628800 00010000:00010000:1.0:1787826766.167167:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 24 pid: 6480 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.167172:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143628800 00010000:00010000:2.0:1787826766.167195:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 25 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826766.167210:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826766.167247:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143628544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826766.167259:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826766.167264:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 25 pid: 6480 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.167272:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826766.167285:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3618:x1874672143628800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826766.167288:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 25 pid: 6480 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.167296:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826766.167303:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826766.167303:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 25 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.167315:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 25 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.167329:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826766.167334:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143628544:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.167343:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787826766.167370:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143628800:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (258us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826766.167374:0:13287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d6e00/0xc0fefc09a79535d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79535ca expref: 24 pid: 6480 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.167388:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787826766.167392:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826766.167414:0:13287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143627904:0@lo:104: 00000100:00100000:2.0:1787826766.167418:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143628672 00000100:00100000:2.0:1787826766.167424:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143628672 00000100:00100000:3.0:1787826766.167444:0:13287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628032:0@lo:104: 00010000:00010000:2.0:1787826766.167447:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 23 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826766.167455:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143628544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826766.167468:0:13287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d6400/0xc0fefc09a79535a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79535a0 expref: 23 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.167480:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787826766.167484:0:13287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628288:0@lo:104: 00000100:00100000:2.0:1787826766.167497:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143628672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826766.167507:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826766.167513:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 22 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.167523:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 22 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.167542:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c81800/0xc0fefc09a79535c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79535bc expref: 22 pid: 9479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826766.167550:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143628800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826766.167577:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826766.167590:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826766.167623:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143628672:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826766.167631:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1787826766.167643:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826766.167652:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:13287:x1874672143628160:12345-0@lo:104: Request processed in 1316us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826766.167661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787826766.167682:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826766.167686:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167690:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80e00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826766.167692:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167697:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826766.167701:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826766.167705:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787826766.167725:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167733:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826766.167747:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167751:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c80e00/0xc0fefc09a79535ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79535b5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167765:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826766.167767:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826766.167768:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826766.167775:0:13287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628160:0@lo:104: 00000100:00100000:2.0:1787826766.167777:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143628928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826766.167812:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.167823:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143628672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826766.167851:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143628928 00000100:00100000:0.0:1787826766.167855:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143628928 00010000:00010000:0.0:1787826766.167867:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 21 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826766.167886:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787826766.167900:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54599fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143628928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826766.167907:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826766.167912:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 21 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167922:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 21 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167934:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a79535b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79535ae expref: 21 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826766.167944:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826766.167975:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54599fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:3619:x1874672143628928:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826766.167990:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826766.168004:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143628928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826766.168503:0:13287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13287:1874672143628416:192.168.203.6@tcp:104: 00010000:00010000:2.0:1787826766.168533:0:13287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826766.168806:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826766.168845:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137088 00000100:00100000:1.0:1787826766.168851:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137088 00010000:00010000:1.0:1787826766.168871:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 10 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826766.168913:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:1.0:1787826766.168921:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668c91cd-9397-44b8-9716-665203a7cec4+10:2390:x1874672134137088:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826766.168931:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826766.168936:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 10 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.168946:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 10 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.168957:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c80a00/0xc0fefc09a7953599 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467300 expref: 10 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.168980:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.168986:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.168996:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.169000:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.169004:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.169008:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.169012:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350ea00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826766.169014:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.169018:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.169030:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826766.169038:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826766.169050:0:13287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.169057:0:13287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826766.169063:0:13287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350ea00/0xc0fefc09a79535d8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826766.169076:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668c91cd-9397-44b8-9716-665203a7cec4+9:2390:x1874672134137088:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 155us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.169092:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:0.0:1787826766.929371:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143629440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826766.929371:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143629056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826766.929462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826766.929470:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143629184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826766.929508:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629440 00000100:00100000:2.0:1787826766.929510:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.929520:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629440 00000100:00100000:1.0:1787826766.929582:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629184 00000100:00100000:1.0:1787826766.929586:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629184 00000100:00100000:1.0:1787826766.929606:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826766.929624:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143629440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826766.929660:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826766.929719:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143629440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.929728:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787826766.929732:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787826766.929747:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d13ad00 x1874672143629440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826766.929756:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826766.929767:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143629184:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826766.929775:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143629440:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826766.929780:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826766.929813:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143629184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.929820:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787826766.929848:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74de00 x1874672143629184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826766.929863:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143629184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826766.929900:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.929927:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143629312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826766.929928:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629056 00000100:00100000:0.0:1787826766.929935:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629056 00000100:00100000:1.0:1787826766.929962:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826766.929967:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826766.929975:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629312 00000100:00100000:0.0:1787826766.929980:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629312 00000100:00100000:1.0:1787826766.930012:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787826766.930023:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143629056:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787826766.930030:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787826766.930042:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826766.930082:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143629056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.930090:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787826766.930103:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81ed00 x1874672143629056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826766.930120:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143629056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826766.930121:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826766.930134:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143629312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826766.930145:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826766.930171:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143629312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.930179:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787826766.930191:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d138780 x1874672143629312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826766.930205:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143629312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826766.930325:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143629824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826766.930365:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826766.930382:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143629568:0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.930395:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143630336:0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.930425:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.930438:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629824 00000100:00100000:1.0:1787826766.930443:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629824 00000100:00100000:0.0:1787826766.930457:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143630080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.930473:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826766.930481:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143629824:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826766.930488:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826766.930511:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143630592:0@lo:400:kworker.0 00000004:00000024:1.0:1787826766.930512:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787826766.930539:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.930558:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143629824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.930565:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787826766.930575:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787826766.930579:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630080 00000100:00100000:0.0:1787826766.930584:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143629952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.930585:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630080 00000100:00100000:1.0:1787826766.930608:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826766.930617:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.930626:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143630080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.930639:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143630464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.930672:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143630080:12345-0@lo:400:kworker.0 Request processed in 47us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826766.930677:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826766.930684:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826766.930713:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143630080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.930717:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629568 00000100:00100000:1.0:1787826766.930723:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629568 00000100:00100000:0.0:1787826766.930742:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630592 00000100:00100000:0.0:1787826766.930747:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630592 00000100:00100000:1.0:1787826766.930751:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629952 00000100:00100000:1.0:1787826766.930755:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629952 00000100:00100000:1.0:1787826766.930767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630464 00000100:00100000:1.0:1787826766.930768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630464 00000100:00100000:0.0:1787826766.930787:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787826766.930795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787826766.930799:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143629568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.930807:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143629952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.930852:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143629568:12345-0@lo:400:kworker.0 Request processed in 57us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826766.930861:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787826766.930865:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143629952:12345-0@lo:400:kworker.0 Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.930872:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787826766.930875:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143629952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.930884:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787826766.930902:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787826766.930908:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143630592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826766.930910:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143629568:0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.930913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143630464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.930962:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143630592:12345-0@lo:400:kworker.0 Request processed in 56us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.930962:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143630464:12345-0@lo:400:kworker.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826766.930974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787826766.930981:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787826766.930981:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143630464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.931002:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787826766.931003:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81cb40 x1874672143630592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826766.931015:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143630592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.931019:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630336 00000100:00100000:0.0:1787826766.931025:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630336 00000100:00100000:1.0:1787826766.931037:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143629824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826766.931056:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826766.931060:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826766.931066:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143629696:0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.931071:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143630336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826766.931096:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826766.931112:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143630336:12345-0@lo:400:kworker.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826766.931119:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826766.931132:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143630208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826766.931136:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143629696 00000100:00080000:0.0:1787826766.931141:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826766.931142:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143629696 00000100:00080000:0.0:1787826766.931153:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826766.931183:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826766.931183:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787826766.931193:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143629696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.931235:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630208 00000100:00100000:0.0:1787826766.931241:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630208 00010000:00080000:1.0:1787826766.931247:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81f0c0 x1874672143630336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826766.931259:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143630336:0@lo:400:kworker.0 00000100:00100000:2.0:1787826766.931264:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143629696:12345-0@lo:400:kworker.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826766.931275:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826766.931280:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787826766.931286:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143629696:0@lo:400:kworker.0 00000100:00100000:0.0:1787826766.931291:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143630208:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787826766.931323:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826766.931342:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143630208:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826766.931350:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787826766.931364:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143630208:0@lo:400:kworker.0 00010000:00010000:1.0:1787826767.057370:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826767.249475:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826767.249514:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826767.249521:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137216 00000100:00100000:1.0:1787826767.249531:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137216 00000100:00100000:2.0:1787826767.249563:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137472 00000100:00100000:2.0:1787826767.249569:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137472 00000100:00100000:1.0:1787826767.249584:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:1.0:1787826767.249595:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+9:2392:x1874672134137216:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826767.249607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826767.249636:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137344 00000100:00100000:2.0:1787826767.249640:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137344 00000100:00100000:3.0:1787826767.249647:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:3.0:1787826767.249658:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134137472:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826767.249666:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+9:2392:x1874672134137216:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826767.249675:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:2.0:1787826767.249680:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 76 00000100:00100000:2.0:1787826767.249691:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2392:x1874672134137344:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787826767.249714:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826767.249720:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826767.249727:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:2392:x1874672134137344:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826767.249735:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 76 00000100:00100000:3.0:1787826767.249743:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+5:2392:x1874672134137472:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826767.249753:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 75 10000000:01000000:3.0:1787826767.377297:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787826767.377302:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d534260c000 from 7 10000000:01000000:3.0:1787826767.377305:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826767.377352:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a79535df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.377364:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a79535df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.377376:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a79535df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826767.377400:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143630720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.377462:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826767.377509:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5471cb4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826767.377520:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630720 00000100:00100000:1.0:1787826767.377528:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630720 00000100:00100000:1.0:1787826767.377583:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787826767.377594:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+20:6482:x1874672143630720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826767.377609:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826767.377626:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7c00/0xc0fefc09a79535e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79535df expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826767.377650:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7c00/0xc0fefc09a79535e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79535df expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826767.377672:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7c00/0xc0fefc09a79535e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535df expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826767.377681:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7c00, rc 0) 00000100:00100000:1.0:1787826767.377740:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143630720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826767.377748:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787826767.377844:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143630720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826767.377873:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a79535df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535e6 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.377894:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a79535df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79535e6 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826767.377979:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143630848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.378013:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826767.378088:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5471cb4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826767.378120:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630848 00000100:00100000:1.0:1787826767.378124:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630848 00000100:00100000:1.0:1787826767.378163:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787826767.378171:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143630848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.378304:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143630848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826767.378312:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787826767.378331:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143630848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.378369:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143630976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.378414:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826767.378453:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5471cb4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826767.378466:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143630976 00000100:00100000:2.0:1787826767.378472:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143630976 00000100:00100000:2.0:1787826767.378515:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787826767.378523:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143630976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826767.378620:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143630976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826767.378627:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787826767.378651:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143630976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826767.379350:0:13469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787826767.379428:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787826767.379455:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826767.379463:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a79535df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535e6 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.379472:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5440030e00/0xc0fefc09a79535df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535e6 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826767.379481:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787826767.379483:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d547d072000 from 7 10000000:01000000:2.0:1787826767.379486:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826767.379510:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.379517:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.379524:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826767.379538:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826767.379575:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826767.379602:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3faa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826767.380112:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143631104 00000100:00100000:3.0:1787826767.380118:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143631104 00000100:00100000:3.0:1787826767.380149:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787826767.380155:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:6482:x1874672143631104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826767.380166:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826767.380179:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79535f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79535ed expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.380197:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79535f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79535ed expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.380206:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79535f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535ed expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.380236:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030a00, rc 0) 00000100:00100000:3.0:1787826767.380276:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143631104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826767.380283:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787826767.380314:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826767.380327:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.380336:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826767.380391:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.380421:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826767.380452:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5471cb4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826767.380511:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143631232 00000100:00100000:1.0:1787826767.380525:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143631232 00000100:00100000:1.0:1787826767.380573:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787826767.380582:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143631232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.380678:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143631232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826767.380689:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787826767.380689:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.380724:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.380760:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826767.380780:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5471cb4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826767.380789:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143631360 00000100:00100000:0.0:1787826767.380794:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143631360 00000100:00100000:0.0:1787826767.380825:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787826767.380833:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143631360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826767.380928:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143631360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826767.380935:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787826767.380946:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826767.382453:0:13470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787826767.382611:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787826767.382627:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826767.382633:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.382645:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826767.382652:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787826767.382654:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d54789ce800 from 7 10000000:01000000:2.0:1787826767.382655:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826767.382674:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f000/0xc0fefc09a79535fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.382679:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350f000/0xc0fefc09a79535fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.382685:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350f000/0xc0fefc09a79535fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826767.382697:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826767.382727:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826767.382751:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3faa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826767.382761:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143631488 00000100:00100000:0.0:1787826767.382766:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143631488 00000100:00100000:0.0:1787826767.382794:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787826767.382799:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143631488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826767.382806:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826767.382813:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5471c81800/0xc0fefc09a7953602 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79535fb expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826767.382828:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5471c81800/0xc0fefc09a7953602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79535fb expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826767.382835:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5471c81800/0xc0fefc09a7953602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79535fb expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826767.382849:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c81800, rc 0) 00000100:00100000:0.0:1787826767.382892:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143631488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826767.382898:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787826767.382936:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826767.382945:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350f000/0xc0fefc09a79535fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953602 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.382950:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350f000/0xc0fefc09a79535fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953602 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826767.382990:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826767.383014:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826767.383041:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3faa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826767.383067:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143631616 00000100:00100000:1.0:1787826767.383072:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143631616 00000100:00100000:1.0:1787826767.383115:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787826767.383126:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143631616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.383252:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143631616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826767.383261:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787826767.383270:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826767.383297:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826767.383331:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826767.383354:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143631744 00000100:00100000:1.0:1787826767.383366:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143631744 00000100:00100000:2.0:1787826767.383366:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3faa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826767.383398:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787826767.383407:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143631744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.383513:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143631744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826767.383521:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787826767.383524:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d1392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787826767.384239:0:13471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826767.384307:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826767.384332:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826767.384339:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f000/0xc0fefc09a79535fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953602 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826767.384349:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350f000/0xc0fefc09a79535fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953602 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826767.384366:0:6482:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787826767.384368:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5448400800 from 7 10000000:01000000:1.0:1787826767.384374:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826767.384395:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7800/0xc0fefc09a7953609 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826767.384404:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7800/0xc0fefc09a7953609 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826767.384413:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7800/0xc0fefc09a7953609 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826767.384450:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.384485:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826767.384518:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826767.384530:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143631872 00000100:00100000:2.0:1787826767.384536:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143631872 00000100:00100000:2.0:1787826767.384567:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787826767.384573:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143631872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826767.384582:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826767.384593:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350ec00/0xc0fefc09a7953610 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953609 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.384610:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350ec00/0xc0fefc09a7953610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953609 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.384620:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350ec00/0xc0fefc09a7953610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953609 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826767.384628:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350ec00, rc 0) 00000100:00100000:2.0:1787826767.384664:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143631872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826767.384671:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787826767.384678:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143631872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826767.384693:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7800/0xc0fefc09a7953609 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953610 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826767.384702:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7800/0xc0fefc09a7953609 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953610 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826767.384756:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143632000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.384782:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826767.384801:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826767.384823:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632000 00000100:00100000:3.0:1787826767.384828:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632000 00000100:00100000:3.0:1787826767.384859:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787826767.384869:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143632000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.384983:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143632000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826767.384990:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787826767.385021:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143632000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.385048:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143632128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826767.385093:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826767.385112:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826767.385134:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632128 00000100:00100000:3.0:1787826767.385139:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632128 00000100:00100000:3.0:1787826767.385185:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787826767.385192:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143632128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826767.385345:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143632128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826767.385352:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787826767.385358:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143632128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826767.386057:0:13472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787826767.386133:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787826767.386170:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826767.386178:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7800/0xc0fefc09a7953609 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953610 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826767.386188:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7800/0xc0fefc09a7953609 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953610 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1787826767.423371:0:13486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787826767.953342:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143632256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826767.953399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826767.953431:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632256 00000100:00100000:1.0:1787826767.953439:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632256 00000100:00100000:1.0:1787826767.953497:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787826767.953508:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143632256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826767.953538:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826767.953600:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143632256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826767.953606:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787826767.953644:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143632256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826768.081372:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826768.145942:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826768.146028:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137600 00000100:00100000:1.0:1787826768.146038:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137600 00000100:00100000:1.0:1787826768.146121:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 267 00000100:00100000:1.0:1787826768.146132:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+9:6151:x1874672134137600:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826768.146148:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826768.146166:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7200/0xc0fefc09a7953617 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467307 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826768.146192:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7200/0xc0fefc09a7953617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467307 expref: 10 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826768.146205:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7200/0xc0fefc09a7953617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467307 expref: 10 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826768.146237:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7200, rc 0) 00000100:00100000:1.0:1787826768.146301:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134137600:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 170us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826768.146310:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 267 00000100:00100000:3.0:1787826768.147231:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826768.147276:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137728 00000100:00100000:0.0:1787826768.147280:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137728 00000100:00100000:0.0:1787826768.147302:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 268 00000100:00100000:0.0:1787826768.147307:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134137728:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826768.147419:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134137728:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826768.147426:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 268 00000100:00100000:2.0:1787826768.148120:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826768.148160:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137856 00000100:00100000:3.0:1787826768.148166:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137856 00000100:00100000:3.0:1787826768.148200:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 269 00000100:00100000:3.0:1787826768.148206:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134137856:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826768.148318:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+10:6151:x1874672134137856:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826768.148326:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 269 00010000:00010000:2.0:1787826769.105314:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826769.357672:0:13634:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === replay-ost-single: finish setup 06:32:48 (1787826768) === 00000100:00100000:3.0:1787826769.399483:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826769.399588:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134137984 00000100:00100000:0.0:1787826769.399598:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134137984 00000100:00080000:1.0:1787826769.399646:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826769.399666:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:0.0:1787826769.399678:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:8213:x1874672134137984:12345-192.168.203.6@tcp:37:bash.0 00000100:00100000:1.0:1787826769.401866:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:8213:x1874672134137984:12345-192.168.203.6@tcp:37:bash.0 Request processed in 2182us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826769.401892:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:3.0:1787826769.407276:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826769.407328:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134138112 00000100:00100000:0.0:1787826769.407336:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134138112 00000100:00100000:0.0:1787826769.407390:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:0.0:1787826769.407398:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:10649:x1874672134138112:12345-192.168.203.6@tcp:101:rm.0 00010000:00010000:0.0:1787826769.407416:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826769.407441:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a795361e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346730e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407518:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407532:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407546:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407577:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407583:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407588:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407619:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407623:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407628:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407632:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826769.407635:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407648:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407660:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d545a81ed00) 00010000:00010000:0.0:1787826769.407663:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826769.407666:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407670:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a7953625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407679:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407682:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407686:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407689:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826769.407691:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407694:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407698:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xceb91eaa (ffff8d54531bc700) 00010000:00010000:0.0:1787826769.407700:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826769.407701:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407711:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a795362c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407740:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a795361e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346730e expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407748:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d545a81ed00) 00010000:00010000:0.0:1787826769.407750:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826769.407752:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a795361e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346730e expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.407761:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80e00, rc 0) 00000100:00100000:0.0:1787826769.407811:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:10649:x1874672134138112:12345-192.168.203.6@tcp:101:rm.0 Request processed in 412us (549us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826769.407819:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:3.0:1787826769.418459:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826769.418509:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134138240 00000100:00100000:2.0:1787826769.418520:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134138240 00000100:00100000:2.0:1787826769.418588:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:2.0:1787826769.418600:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:10651:x1874672134138240:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1787826769.418622:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826769.418646:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467315 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418710:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418725:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418738:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418755:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418763:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418771:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418813:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418821:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418838:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418845:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350ea00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826769.418849:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418857:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418883:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d545a81ed00) 00010000:00010000:2.0:1787826769.418886:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.418891:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418898:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a795363a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418912:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418919:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418926:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418931:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350fc00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826769.418935:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418952:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418963:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d53428e3a00) 00010000:00010000:2.0:1787826769.418966:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.418970:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.418976:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953641 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.419011:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953633 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467315 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.419023:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d545a81ed00) 00010000:00010000:2.0:1787826769.419026:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.419032:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467315 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.419044:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350e800, rc 0) 00000100:00100000:2.0:1787826769.419106:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:10651:x1874672134138240:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 508us (651us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826769.419116:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:0.0:1787826769.421537:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826769.421581:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134138368 00000100:00100000:1.0:1787826769.421590:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134138368 00000100:00100000:1.0:1787826769.421650:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:0.0:1787826769.421659:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:1.0:1787826769.421661:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:10651:x1874672134138368:12345-192.168.203.6@tcp:700:lfs.0 00000100:00100000:0.0:1787826769.421673:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:1.0:1787826769.421734:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:10651:x1874672134138368:12345-192.168.203.6@tcp:700:lfs.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826769.421743:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:3.0:1787826769.422786:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826769.422828:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134138624 00000100:00100000:0.0:1787826769.422834:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134138624 00000100:00100000:0.0:1787826769.422880:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:0.0:1787826769.422889:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+6:10651:x1874672134138624:12345-192.168.203.6@tcp:36:lfs.0 00010000:00010000:0.0:1787826769.422927:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826769.422950:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d544167dc00/0xc0fefc09a79534dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672eb expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.422964:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d545a81ed00) 00010000:00010000:0.0:1787826769.422981:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826769.423045:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423056:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423064:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423074:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423081:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423087:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423636:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423646:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423652:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826769.423666:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5d3eeb7 reply state 0000000019265bbe transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423676:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423692:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:0.0:1787826769.423695:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826769.423698:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787826769.423702:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787826769.423709:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423714:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423721:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423727:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826769.423731:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423737:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423745:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:0.0:1787826769.423748:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826769.423750:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423756:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a7953648 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826769.423769:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5d3eeb7 reply state 0000000019265bbe transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423788:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.423794:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54531bcb00) 00010000:00010000:0.0:1787826769.423796:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826769.423798:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787826769.423887:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+7:10651:x1874672134138624:12345-192.168.203.6@tcp:36:lfs.0 Request processed in 998us (1099us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787826769.423896:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:0.0:1787826769.434258:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826769.434301:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134138752 00000100:00100000:2.0:1787826769.434311:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134138752 00000100:00100000:2.0:1787826769.434356:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:2.0:1787826769.434365:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+7:10655:x1874672134138752:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1787826769.434381:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826769.434405:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a795365d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346731c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.434480:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.434494:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.434503:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826769.434541:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826769.434544:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826769.434571:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.434592:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a795365d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346731c expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.434603:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346731c expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.434609:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d53428e3a00) 00010000:00010000:2.0:1787826769.434611:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826769.434613:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350fc00, rc 0) 00000100:00100000:2.0:1787826769.434684:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+8:10655:x1874672134138752:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 320us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826769.434691:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:2.0:1787826769.436482:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826769.436549:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134139008 00000100:00100000:1.0:1787826769.436556:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134139008 00000100:00100000:1.0:1787826769.436589:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:1.0:1787826769.436597:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d1392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+8:10655:x1874672134139008:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:1.0:1787826769.436612:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826769.436614:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826769.436635:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fc00/0xc0fefc09a7953664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346731c expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436649:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d53428e3a00) 00010000:00010000:1.0:1787826769.436656:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826769.436666:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a795366b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467323 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436770:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436781:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436789:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436799:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436814:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436821:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436893:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436902:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436909:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826769.436918:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787826769.436931:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436938:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436944:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436950:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826769.436954:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436961:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436981:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:1.0:1787826769.436984:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826769.436987:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.436993:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a7953680 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437008:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437014:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437020:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437025:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826769.437027:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437033:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437040:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54756aec00) 00010000:00010000:1.0:1787826769.437042:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826769.437045:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437050:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437078:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437085:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437091:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437096:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826769.437099:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437105:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437112:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54531bcb00) 00010000:00010000:1.0:1787826769.437114:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826769.437117:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437122:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a7953679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437145:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a795366b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467323 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437153:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54756aec00) 00010000:00010000:1.0:1787826769.437156:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826769.437165:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a795366b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467323 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.437179:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6400, rc 0) 00000100:00100000:1.0:1787826769.437265:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d1392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+7:10655:x1874672134139008:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 668us (788us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826769.437274:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1787826769.439312:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826769.439353:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134139136 00000100:00100000:0.0:1787826769.439359:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134139136 00000100:00100000:0.0:1787826769.439401:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:0.0:1787826769.439421:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+7:10655:x1874672134139136:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:0.0:1787826769.439436:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826769.439452:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81c00/0xc0fefc09a7953687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346732a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.439501:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80000/0xc0fefc09a795368e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.439512:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80000/0xc0fefc09a795368e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.439521:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80000/0xc0fefc09a795368e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826769.439550:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826769.439561:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826769.439577:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80000/0xc0fefc09a795368e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.439606:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81c00/0xc0fefc09a7953687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346732a expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.439620:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80000/0xc0fefc09a795368e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346732a expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.439628:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:0.0:1787826769.439631:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826769.439633:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80000, rc 0) 00000100:00100000:0.0:1787826769.439674:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+8:10655:x1874672134139136:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 258us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826769.439681:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:0.0:1787826769.441002:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826769.441046:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134139392 00000100:00100000:2.0:1787826769.441052:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134139392 00000100:00100000:2.0:1787826769.441104:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:2.0:1787826769.441113:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+8:10655:x1874672134139392:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1787826769.441126:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826769.441137:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467331 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441185:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441196:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441205:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441247:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441256:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441272:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826769.441358:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787826769.441432:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441440:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441472:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441478:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350e000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826769.441482:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441489:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441500:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:2.0:1787826769.441504:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.441507:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441514:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a795369c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441525:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441532:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441538:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441543:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350ea00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826769.441546:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441562:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441570:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54531bcb00) 00010000:00010000:2.0:1787826769.441572:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.441575:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441581:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441622:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953695 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467331 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441632:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:2.0:1787826769.441634:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826769.441638:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467331 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.441647:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350fe00, rc 0) 00000100:00100000:2.0:1787826769.441687:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+9:10655:x1874672134139392:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 575us (688us total) trans 4294967300 rc 301/301 00000100:00100000:2.0:1787826769.441694:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:2.0:1787826769.444515:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826769.444563:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134139520 00000100:00100000:0.0:1787826769.444572:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134139520 00000100:00100000:0.0:1787826769.444622:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:0.0:1787826769.444633:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+9:10655:x1874672134139520:12345-192.168.203.6@tcp:900:lfs.0 00000100:00100000:0.0:1787826769.444708:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+9:10655:x1874672134139520:12345-192.168.203.6@tcp:900:lfs.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826769.444717:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:3.0:1787826769.445964:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826769.446058:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134139776 00000100:00100000:1.0:1787826769.446063:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134139776 00000100:00100000:1.0:1787826769.446106:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:1.0:1787826769.446114:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+9:10655:x1874672134139776:12345-192.168.203.6@tcp:36:lfs.0 00010000:00010000:1.0:1787826769.446171:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.446183:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.446190:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826769.446354:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4ef82f9 reply state 0000000001734d09 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.446366:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.446374:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:1.0:1787826769.446377:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1787826769.446380:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787826769.446387:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787826769.446440:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+11:10655:x1874672134139776:12345-192.168.203.6@tcp:36:lfs.0 Request processed in 326us (478us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787826769.446453:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:3.0:1787826769.447326:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826769.447368:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134140032 00000100:00100000:2.0:1787826769.447373:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134140032 00000100:00100000:2.0:1787826769.447407:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:2.0:1787826769.447416:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+11:10655:x1874672134140032:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:2.0:1787826769.447544:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+12:10655:x1874672134140032:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 129us (218us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787826769.447553:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:2.0:1787826769.454888:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826769.454937:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134140288 00000100:00100000:0.0:1787826769.454946:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134140288 00000100:00100000:0.0:1787826769.454996:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:0.0:1787826769.455008:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+12:10658:x1874672134140288:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:0.0:1787826769.455045:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826769.455064:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80800/0xc0fefc09a79536b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467338 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455134:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455148:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455159:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455185:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455195:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455202:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826769.455322:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787826769.455382:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455387:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455391:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455402:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826769.455405:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455414:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455423:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:0.0:1787826769.455425:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826769.455428:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455433:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c81600/0xc0fefc09a79536bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455442:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455445:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455450:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455456:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826769.455459:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455465:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455482:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54531bcb00) 00010000:00010000:0.0:1787826769.455485:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826769.455488:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455494:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79536c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455521:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80800/0xc0fefc09a79536b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467338 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455539:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:0.0:1787826769.455542:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826769.455546:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80800/0xc0fefc09a79536b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467338 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826769.455556:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5471c80800, rc 0) 00000100:00100000:0.0:1787826769.455613:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+13:10658:x1874672134140288:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 607us (741us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787826769.455620:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:3.0:1787826769.457713:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826769.457771:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134140544 00000100:00100000:2.0:1787826769.457779:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134140544 00000100:00100000:2.0:1787826769.457823:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:2.0:1787826769.457830:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+13:10658:x1874672134140544:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1787826769.457844:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826769.457858:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a79536d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346733f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.457933:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.457943:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.457951:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.457961:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.457970:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.457976:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458068:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458077:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458084:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826769.458093:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787826769.458144:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458151:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458158:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458163:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350ea00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826769.458167:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458173:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458183:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:2.0:1787826769.458186:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.458189:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458204:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350ea00/0xc0fefc09a79536db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458237:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458244:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458250:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458255:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350e000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826769.458258:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458265:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458273:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54531bcb00) 00010000:00010000:2.0:1787826769.458274:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.458276:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458280:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a79536e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458507:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a79536d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458516:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826769.458526:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:2.0:1787826769.458529:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826769.458532:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350e200, rc 0) 00000100:00100000:2.0:1787826769.458580:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:623ddf66-2f94-46d4-a38e-7bde7caf88c3+15:10658:x1874672134140544:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 750us (872us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787826769.458586:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:3.0:1787826769.460188:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826769.460251:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134140800 00000100:00100000:0.0:1787826769.460260:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134140800 00000100:00100000:0.0:1787826769.460306:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:0.0:1787826769.460315:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+15:10658:x1874672134140800:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:0.0:1787826769.460444:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+16:10658:x1874672134140800:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 131us (297us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787826769.460450:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:0.0:1787826769.461372:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826769.461417:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134140928 00000100:00100000:3.0:1787826769.461428:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134140928 00000100:00100000:3.0:1787826769.461455:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1787826769.461461:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545046c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+16:10658:x1874672134140928:12345-192.168.203.6@tcp:33:lfs.0 00000004:00200000:3.0:1787826769.461518:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826769.461522:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787826769.461564:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545046c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+16:10658:x1874672134140928:12345-192.168.203.6@tcp:33:lfs.0 Request processed in 102us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826769.461571:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1787826769.462699:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826769.462753:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134141056 00000100:00100000:1.0:1787826769.462758:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134141056 00000100:00100000:1.0:1787826769.462811:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:1.0:1787826769.462819:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+16:10658:x1874672134141056:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:1.0:1787826769.462833:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826769.462847:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79536f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467346 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.462904:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.462918:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.462929:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.462939:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.462946:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.462952:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463011:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463031:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463038:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826769.463060:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826769.463062:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826769.463073:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463079:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463083:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463087:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463091:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826769.463093:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463097:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463105:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:1.0:1787826769.463106:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826769.463109:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463119:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79536fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463128:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463131:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463134:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463137:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826769.463139:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463142:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463146:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54531bcb00) 00010000:00010000:1.0:1787826769.463147:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826769.463149:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463152:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a7953705 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463175:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79536f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463182:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826769.463191:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:1.0:1787826769.463193:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826769.463194:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7400, rc 0) 00000100:00100000:1.0:1787826769.463267:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:623ddf66-2f94-46d4-a38e-7bde7caf88c3+17:10658:x1874672134141056:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 442us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826769.463275:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:0.0:1787826769.466802:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826769.466860:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134141312 00000100:00100000:1.0:1787826769.466878:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134141312 00000100:00100000:1.0:1787826769.466927:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:1.0:1787826769.466937:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+17:10658:x1874672134141312:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:1.0:1787826769.467128:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:623ddf66-2f94-46d4-a38e-7bde7caf88c3+18:10658:x1874672134141312:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 193us (331us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787826769.467134:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00000001:02000400:3.0:1787826770.012330:0:13683:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 0a: target handle mismatch (bug 5317) ========================================================== 06:32:49 (1787826769) 00010000:00010000:0.0:1787826770.129395:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826771.153338:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826772.049397:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143632384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826772.049422:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143632640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826772.049424:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143632512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826772.049484:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826772.049489:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143632768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826772.049497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826772.049533:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826772.049563:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f730b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143632896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826772.049564:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143633152:0@lo:400:kworker.0 00000100:00100000:0.0:1787826772.049573:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143633280:0@lo:400:kworker.0 00000100:00100000:1.0:1787826772.049608:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826772.049613:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826772.049622:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632640 00000100:00100000:0.0:1787826772.049628:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632640 00000100:00100000:1.0:1787826772.049631:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143633408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.049634:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632384 00000100:00100000:3.0:1787826772.049641:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632384 00000100:00100000:2.0:1787826772.049648:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143633664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826772.049667:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826772.049684:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826772.049686:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632768 00000100:00100000:0.0:1787826772.049691:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632768 00000100:00100000:3.0:1787826772.049695:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633408 00000100:00100000:3.0:1787826772.049699:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633408 00000100:00100000:1.0:1787826772.049701:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143633920:0@lo:400:kworker.0 00000100:00100000:2.0:1787826772.049712:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143634176:0@lo:400:kworker.0 00000100:00100000:0.0:1787826772.049716:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632896 00000100:00100000:0.0:1787826772.049719:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632896 00000100:00100000:3.0:1787826772.049725:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787826772.049735:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143632384:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826772.049746:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787826772.049751:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826772.049751:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826772.049759:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143632640:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1787826772.049761:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:0.0:1787826772.049777:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826772.049786:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826772.049787:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787826772.049797:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143633792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826772.049799:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143633024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.049811:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143632384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826772.049817:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143632640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826772.049825:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826772.049826:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826772.049839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826772.049866:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826772.049869:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787826772.049870:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787826772.049884:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143633408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826772.049886:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143632768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826772.049889:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143633536:0@lo:400:kworker.0 00002000:00000024:0.0:1787826772.049902:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826772.049915:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143632384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826772.049931:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143633408:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826772.049937:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826772.049941:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787826772.049946:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143633408:0@lo:400:kworker.0 00000100:00100000:0.0:1787826772.049950:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143632768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826772.049959:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826772.049966:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143634048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.049974:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634176 00000100:00100000:0.0:1787826772.049982:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787826772.049983:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634176 00000100:00100000:2.0:1787826772.049995:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826772.050000:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143632896:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826772.050020:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633792 00000100:00100000:1.0:1787826772.050025:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633792 00002000:00000024:0.0:1787826772.050026:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826772.050029:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787826772.050034:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f733480 x1874672143632640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826772.050039:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143634176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826772.050068:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787826772.050081:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143634176:12345-0@lo:400:kworker.0 Request processed in 43us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826772.050084:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143633792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826772.050085:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143632640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826772.050090:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143632896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826772.050096:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826772.050103:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787826772.050122:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633152 00010000:00080000:2.0:1787826772.050123:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356d00 x1874672143634176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826772.050127:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633152 00000100:00100000:0.0:1787826772.050130:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633664 00000100:00100000:0.0:1787826772.050135:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633664 00000100:00100000:2.0:1787826772.050140:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143634176:0@lo:400:kworker.0 00000100:00100000:1.0:1787826772.050142:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143633792:12345-0@lo:400:kworker.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826772.050151:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633920 00000100:00100000:1.0:1787826772.050155:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787826772.050156:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633920 00000100:00100000:0.0:1787826772.050159:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633536 00000100:00100000:0.0:1787826772.050164:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633536 00000100:00100000:3.0:1787826772.050177:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634048 00000100:00100000:3.0:1787826772.050181:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634048 00000100:00100000:2.0:1787826772.050185:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633024 00000100:00100000:2.0:1787826772.050190:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633024 00000100:00100000:0.0:1787826772.050195:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787826772.050206:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.050212:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787826772.050252:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f731a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143633664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826772.050275:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143633152:12345-0@lo:400:kworker.0 Request processed in 70us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826772.050285:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826772.050289:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787826772.050303:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143633024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.050304:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f731a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143633664:12345-0@lo:400:kworker.0 Request processed in 52us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826772.050309:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826772.050320:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787826772.050321:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143633920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.050348:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787826772.050354:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143633024:12345-0@lo:400:kworker.0 Request processed in 55us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826772.050360:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f730f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143633536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826772.050364:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143633920:12345-0@lo:400:kworker.0 Request processed in 45us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826772.050367:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787826772.050374:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787826772.050391:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787826772.050402:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f730780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143634048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.050407:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f730f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143633536:12345-0@lo:400:kworker.0 Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826772.050409:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826772.050416:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826772.050417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826772.050422:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787826772.050423:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826772.050428:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826772.050452:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f730780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143634048:12345-0@lo:400:kworker.0 Request processed in 53us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826772.050462:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787826772.050463:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143632512 00000100:00100000:2.0:1787826772.050468:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143632512 00000100:00100000:3.0:1787826772.050474:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826772.050490:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143633280 00010000:00080000:0.0:1787826772.050494:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d7480 x1874672143633792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826772.050495:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143633280 00000100:00100000:2.0:1787826772.050502:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787826772.050509:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143633792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826772.050516:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143632512:12345-0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787826772.050517:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81cb40 x1874672143632768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826772.050528:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143633920:0@lo:400:kworker.0 00002000:00000024:2.0:1787826772.050530:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826772.050532:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787826772.050538:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143632768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826772.050546:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143633280:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787826772.050567:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f730b40 x1874672143632896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826772.050584:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143633024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826772.050585:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f730b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143632896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826772.050586:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143632512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826772.050601:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143633280:12345-0@lo:400:kworker.0 Request processed in 59us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826772.050604:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787826772.050615:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787826772.050619:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143633536:0@lo:400:kworker.0 00010000:00080000:3.0:1787826772.050639:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c2580 x1874672143634048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826772.050647:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81f0c0 x1874672143632512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826772.050652:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143634048:0@lo:400:kworker.0 00000100:00100000:2.0:1787826772.050669:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143632512:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787826772.050673:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386e580 x1874672143633664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826772.050684:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143633664:0@lo:400:kworker.0 00000100:00100000:3.0:1787826772.050697:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143633152:0@lo:400:kworker.0 00000100:00100000:2.0:1787826772.050710:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143633280:0@lo:400:kworker.0 00010000:00010000:1.0:1787826772.177366:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826772.369133:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826772.369191:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134141440 00000100:00100000:1.0:1787826772.369199:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134141440 00000100:00100000:1.0:1787826772.369271:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 271 00000100:00100000:1.0:1787826772.369293:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:2390:x1874672134141440:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826772.369359:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:668c91cd-9397-44b8-9716-665203a7cec4+10:2390:x1874672134141440:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826772.369365:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 271 00000100:00100000:0.0:1787826773.073383:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826773.073406:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143634304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826773.073472:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826773.073517:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634304 00000100:00100000:3.0:1787826773.073525:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634304 00000100:00100000:3.0:1787826773.073574:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787826773.073584:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143634304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826773.073612:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826773.073658:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143634304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826773.073666:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787826773.073702:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143634304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826773.201371:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826774.225389:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787826775.123401:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00010000:00010000:0.0:1787826775.123491:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123504:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123511:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123518:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826775.123522:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123531:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123547:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54531bcb00) 00010000:00010000:0.0:1787826775.123550:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826775.123555:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123569:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80a00/0xc0fefc09a795364f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123589:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123595:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123601:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123606:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826775.123609:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123616:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123623:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:0.0:1787826775.123626:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826775.123628:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123635:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80e00/0xc0fefc09a7953656 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123645:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123651:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123662:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123679:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826775.123683:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123689:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123697:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:0.0:1787826775.123699:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826775.123702:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826775.123708:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7e00/0xc0fefc09a79536b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826775.249397:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826775.377864:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826775.377928:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134141568 00000100:00100000:2.0:1787826775.377937:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134141568 00000100:00100000:2.0:1787826775.377992:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 272 00000100:00100000:2.0:1787826775.378002:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134141568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826775.378065:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134141568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 65us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826775.378073:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 272 00010000:00010000:1.0:1787826776.273392:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826777.169542:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826777.169566:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143634432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826777.169642:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826777.169714:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143634816:0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.169752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.169759:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143634944:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.169789:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826777.169793:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143635328:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.169809:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143635456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.169834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.169854:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826777.169868:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143635840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.169880:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143635968:0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.169898:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826777.169930:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143634560:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.169937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826777.170007:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634432 00000100:00100000:1.0:1787826777.170015:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634432 00000100:00100000:1.0:1787826777.170064:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634944 00000100:00100000:1.0:1787826777.170068:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634944 00000100:00100000:1.0:1787826777.170093:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787826777.170103:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787826777.170104:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143634432:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826777.170118:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143634944:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1787826777.170140:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826777.170293:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635328 00000100:00100000:3.0:1787826777.170297:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635328 00000100:00100000:2.0:1787826777.170331:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.170334:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635456 00000100:00100000:3.0:1787826777.170338:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635456 00000100:00100000:3.0:1787826777.170354:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635840 00000100:00100000:3.0:1787826777.170356:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635840 00000100:00100000:2.0:1787826777.170365:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143635072:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.170372:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635968 00000100:00100000:3.0:1787826777.170376:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635968 00000100:00100000:2.0:1787826777.170387:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826777.170402:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143635584:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.170411:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826777.170419:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.170423:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f731680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143635328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.170442:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826777.170471:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f731680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143635328:12345-0@lo:400:kworker.0 Request processed in 51us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.170480:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826777.170490:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.170499:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787826777.170508:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143635456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.170516:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787826777.170525:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143634688:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.170550:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143635456:12345-0@lo:400:kworker.0 Request processed in 44us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.170559:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787826777.170560:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.170576:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787826777.170586:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143635200:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.170587:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f731e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143635840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.170617:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.170650:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f731e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143635840:12345-0@lo:400:kworker.0 Request processed in 66us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826777.170651:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143635712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.170662:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826777.170677:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787826777.170683:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.170687:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143635968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.170701:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143636224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826777.170726:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143635968:12345-0@lo:400:kworker.0 Request processed in 42us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826777.170735:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826777.170743:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787826777.170771:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634816 00000100:00100000:3.0:1787826777.170775:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634816 00000100:00100000:3.0:1787826777.170791:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635072 00000100:00100000:3.0:1787826777.170793:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635072 00000100:00100000:3.0:1787826777.170808:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635584 00000100:00100000:3.0:1787826777.170811:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635584 00000100:00100000:3.0:1787826777.170840:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634688 00000100:00100000:3.0:1787826777.170843:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634688 00000100:00100000:2.0:1787826777.170845:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636096 00000100:00100000:2.0:1787826777.170852:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636096 00000100:00100000:3.0:1787826777.170852:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635200 00000100:00100000:3.0:1787826777.170857:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635200 00000100:00100000:3.0:1787826777.170877:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143635712 00000100:00100000:3.0:1787826777.170880:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143635712 00000100:00100000:2.0:1787826777.170887:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636224 00000100:00100000:2.0:1787826777.170892:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636224 00000100:00100000:3.0:1787826777.170899:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787826777.170909:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143634816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.170915:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826777.170924:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143636096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826777.170945:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826777.170948:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143634816:12345-0@lo:400:kworker.0 Request processed in 41us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.170955:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787826777.170970:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787826777.170977:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f733c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143635072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.170990:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143636096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826777.170997:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826777.171016:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787826777.171016:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f733c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143635072:12345-0@lo:400:kworker.0 Request processed in 38us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.171026:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787826777.171028:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143636224:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826777.171044:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00002000:00000024:2.0:1787826777.171046:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826777.171054:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f733840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143635584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.171081:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143636224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826777.171089:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787826777.171096:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f733840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143635584:12345-0@lo:400:kworker.0 Request processed in 44us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.171105:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787826777.171120:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143634560 00000100:00100000:2.0:1787826777.171126:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143634560 00000100:00100000:3.0:1787826777.171129:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787826777.171138:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143634688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.171158:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787826777.171167:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143634688:12345-0@lo:400:kworker.0 Request processed in 31us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826777.171170:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143634560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.171177:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787826777.171191:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787826777.171198:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143635200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.171233:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143634560:12345-0@lo:400:kworker.0 Request processed in 46us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.171247:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143635200:12345-0@lo:400:kworker.0 Request processed in 49us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.171253:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787826777.171262:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787826777.171266:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f730b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.171288:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f730b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143635712:12345-0@lo:400:kworker.0 Request processed in 21us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.171292:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787826777.171304:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787826777.171309:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143636480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826777.171334:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826777.171355:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143636352:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787826777.171368:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b3480 x1874672143635456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826777.171383:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143635456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.171384:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826777.171402:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b0000 x1874672143635968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826777.171414:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143635968:0@lo:400:kworker.0 00010000:00080000:2.0:1787826777.171415:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b2580 x1874672143635328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826777.171428:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143635328:0@lo:400:kworker.0 00010000:00080000:2.0:1787826777.171442:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b30c0 x1874672143635840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826777.171445:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636480 00000100:00100000:2.0:1787826777.171452:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143635840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.171454:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636480 00000100:00100000:2.0:1787826777.171469:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143634816:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.171472:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636352 00000100:00100000:3.0:1787826777.171476:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636352 00000100:00100000:3.0:1787826777.171491:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787826777.171498:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143636480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826777.171508:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826777.171517:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143634688:0@lo:400:kworker.0 00010000:00080000:2.0:1787826777.171531:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5453268780 x1874672143635200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826777.171541:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143635200:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.171545:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143636480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826777.171554:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787826777.171558:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b0780 x1874672143635712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826777.171570:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143635712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.171570:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787826777.171580:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143636352:12345-0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787826777.171594:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81f0c0 x1874672143636224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1787826777.171594:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826777.171611:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143636224:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787826777.171625:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81c3c0 x1874672143636096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826777.171635:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143636352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826777.171636:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826777.171648:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787826777.171653:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143634560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826777.171667:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143635072:0@lo:400:kworker.0 00010000:00080000:3.0:1787826777.171678:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f700b40 x1874672143636480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826777.171682:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143635584:0@lo:400:kworker.0 00000100:00100000:3.0:1787826777.171702:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143636480:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787826777.171733:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f703480 x1874672143636352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826777.171744:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143636352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787826777.171764:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826777.171770:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826777.171773:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826777.171776:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826777.172399:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143634944:12345-0@lo:400:kworker.0 Request processed in 2284us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826777.172408:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787826777.172442:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143634944:0@lo:400:kworker.0 00000100:00100000:1.0:1787826777.173152:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143634432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3048us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826777.173163:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787826777.173192:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143634432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787826777.297444:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826778.194178:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143636608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826778.194278:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826778.194339:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636608 00000100:00100000:0.0:1787826778.194348:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636608 00000100:00100000:0.0:1787826778.194411:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787826778.194423:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143636608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826778.194457:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826778.194750:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143636608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 329us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826778.194758:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787826778.194845:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143636608:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826778.321417:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826779.345411:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826780.369398:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826780.564360:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826780.564425:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134141696 00000100:00100000:2.0:1787826780.564435:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134141696 00000100:00100000:2.0:1787826780.564492:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 274 00000100:00100000:2.0:1787826780.564502:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134141696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826780.564574:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:668c91cd-9397-44b8-9716-665203a7cec4+10:2391:x1874672134141696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826780.564598:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 274 00000100:00100000:0.0:1787826780.569085:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826780.569124:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826780.569164:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826780.569370:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134141824 00000100:00100000:1.0:1787826780.569371:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134142080 00000100:00100000:1.0:1787826780.569381:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134142080 00000100:00100000:2.0:1787826780.569381:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134141824 00000100:00100000:3.0:1787826780.569383:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134141952 00000100:00100000:3.0:1787826780.569401:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134141952 00000100:00100000:2.0:1787826780.569462:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:3.0:1787826780.569471:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:2.0:1787826780.569477:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668c91cd-9397-44b8-9716-665203a7cec4+12:2393:x1874672134141824:12345-192.168.203.6@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787826780.569483:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:3.0:1787826780.569488:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668c91cd-9397-44b8-9716-665203a7cec4+12:2393:x1874672134141952:12345-192.168.203.6@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787826780.569493:0:6471:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00010000:00010000:2.0:1787826780.569496:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826780.569499:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:668c91cd-9397-44b8-9716-665203a7cec4+12:2393:x1874672134142080:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826780.569500:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826780.569504:0:6471:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:1.0:1787826780.569515:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826780.569519:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d6000/0xc0fefc09a7953584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672f2 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826780.569519:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350e600/0xc0fefc09a795349d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672b3 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826780.569530:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7200/0xc0fefc09a7953617 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467307 expref: 12 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826780.569552:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826780.569552:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826780.569597:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826780.569613:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:668c91cd-9397-44b8-9716-665203a7cec4+9:2393:x1874672134142080:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 116us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826780.569614:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668c91cd-9397-44b8-9716-665203a7cec4+9:2393:x1874672134141824:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 140us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826780.569629:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668c91cd-9397-44b8-9716-665203a7cec4+9:2393:x1874672134141952:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 145us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826780.569646:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:1.0:1787826780.569654:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:3.0:1787826780.569662:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1787826780.590430:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826780.590519:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134142336 00000100:00100000:2.0:1787826780.590535:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134142336 00000100:00100000:2.0:1787826780.590586:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 275 00000100:00100000:2.0:1787826780.590593:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+7:2389:x1874672134142336:12345-192.168.203.6@tcp:251:umount.0 00000020:00000080:2.0:1787826780.590631:0:6479:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953488 00000020:00010000:2.0:1787826780.590639:0:6479:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d5343500800: total 0 00000100:00080000:2.0:1787826780.590644:0:6479:0:(import.c:65:import_set_state_nolock()) ffff8d5343504800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787826780.590679:0:6473:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d5343500800: total 0 00000100:00100000:2.0:1787826780.590712:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:668c91cd-9397-44b8-9716-665203a7cec4+3:2389:x1874672134142336:12345-192.168.203.6@tcp:251:umount.0 Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826780.590721:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 275 00010000:00010000:1.0:1787826780.590733:0:6473:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d5343500800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787826780.590767:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d6600/0xc0fefc09a795358b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34672f9 expref: 2 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826780.590779:0:6473:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d5343500800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787826780.590801:0:6473:0:(genops.c:885:class_export_put()) final put ffff8d5343500800/668c91cd-9397-44b8-9716-665203a7cec4 00010000:00010000:1.0:1787826780.590819:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826780.590822:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826780.590823:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826780.590853:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343500800/668c91cd-9397-44b8-9716-665203a7cec4 for MGS 00000020:00000080:3.0:1787826780.590891:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343504800 for MGS 00000100:00100000:1.0:1787826781.162206:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.162640:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134142464 00000100:00100000:2.0:1787826781.162654:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134142464 00000100:00100000:2.0:1787826781.162718:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 276 00000100:00100000:2.0:1787826781.162728:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1874672134142464:12345-192.168.203.6@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787826781.162764:0:6480:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 291f6693-430f-40e2-b9af-10afb9cb8617@192.168.203.6@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1787826781.162807:0:6480:0:(genops.c:1385:class_connect()) connect: client 291f6693-430f-40e2-b9af-10afb9cb8617, cookie 0xc0fefc09a7953713 00000100:00080000:2.0:1787826781.162851:0:6480:0:(import.c:65:import_set_state_nolock()) ffff8d53444b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826781.162930:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+5:2389:x1874672134142464:12345-192.168.203.6@tcp:250:mount.lustre.0 Request processed in 202us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.162939:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 276 00000100:00100000:0.0:1787826781.163940:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826781.163988:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134142592 00000100:00100000:1.0:1787826781.163998:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134142592 00000100:00100000:1.0:1787826781.164055:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 277 00000100:00100000:1.0:1787826781.164067:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+5:10852:x1874672134142592:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787826781.164087:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826781.164109:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d6a00/0xc0fefc09a795371a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346735b expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826781.164140:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d6a00/0xc0fefc09a795371a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346735b expref: 6 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826781.164153:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d6a00/0xc0fefc09a795371a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346735b expref: 6 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826781.164163:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6a00, rc 0) 00000100:00100000:1.0:1787826781.164269:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+6:10852:x1874672134142592:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 205us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826781.164278:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 277 00000100:00100000:3.0:1787826781.165003:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.165045:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134142720 00000100:00100000:0.0:1787826781.165053:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134142720 00000100:00100000:0.0:1787826781.165094:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 278 00000100:00100000:0.0:1787826781.165103:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+6:10852:x1874672134142720:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787826781.165243:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+6:10852:x1874672134142720:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 139us (243us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826781.165250:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 278 00000100:00100000:0.0:1787826781.166282:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.166332:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134142848 00000100:00100000:2.0:1787826781.166341:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134142848 00000100:00100000:2.0:1787826781.166381:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 279 00000100:00100000:2.0:1787826781.166390:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+6:10852:x1874672134142848:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787826781.166402:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826781.166421:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350ea00/0xc0fefc09a7953721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467362 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.166448:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350ea00/0xc0fefc09a7953721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467362 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.166461:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350ea00/0xc0fefc09a7953721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467362 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.166471:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350ea00, rc 0) 00000100:00100000:2.0:1787826781.166519:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+7:10852:x1874672134142848:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.166527:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 279 00000100:00100000:2.0:1787826781.167491:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.167548:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134142976 00000100:00100000:0.0:1787826781.167555:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134142976 00000100:00100000:0.0:1787826781.167595:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 280 00000100:00100000:0.0:1787826781.167604:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+7:10852:x1874672134142976:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787826781.167736:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+8:10852:x1874672134142976:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826781.167743:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 280 00000100:00100000:3.0:1787826781.168575:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826781.168630:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134143104 00000100:00100000:1.0:1787826781.168639:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134143104 00000100:00100000:1.0:1787826781.168684:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 281 00000100:00100000:1.0:1787826781.168694:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+8:10852:x1874672134143104:12345-192.168.203.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787826781.168828:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+8:10852:x1874672134143104:12345-192.168.203.6@tcp:503:mount.lustre.0 Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826781.168836:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 281 00000100:00100000:1.0:1787826781.170208:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.170652:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134143232 00000100:00100000:2.0:1787826781.170665:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134143232 00000100:00100000:2.0:1787826781.170729:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 282 00000100:00100000:2.0:1787826781.170735:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+8:10871:x1874672134143232:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787826781.170886:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+8:10871:x1874672134143232:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 149us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.170895:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 282 00000100:00100000:2.0:1787826781.181808:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826781.181876:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134143360 00000100:00100000:3.0:1787826781.181890:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134143360 00000100:00100000:3.0:1787826781.181946:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 283 00000100:00100000:3.0:1787826781.181958:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+8:10871:x1874672134143360:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787826781.182122:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+8:10871:x1874672134143360:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 166us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826781.182131:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 283 00000100:00100000:3.0:1787826781.183193:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.183402:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134143488 00000100:00100000:0.0:1787826781.183422:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134143488 00000100:00100000:0.0:1787826781.183477:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 284 00000100:00100000:0.0:1787826781.183488:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+8:10871:x1874672134143488:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787826781.183657:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+8:10871:x1874672134143488:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 170us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826781.183666:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 284 00000100:00100000:1.0:1787826781.184994:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.185055:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134143616 00000100:00100000:2.0:1787826781.185066:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134143616 00000100:00100000:2.0:1787826781.185125:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 285 00000100:00100000:2.0:1787826781.185134:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+8:10852:x1874672134143616:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787826781.185147:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826781.185165:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467393 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.185191:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.185200:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.185207:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350e600, rc 0) 00000100:00100000:2.0:1787826781.185271:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+9:10852:x1874672134143616:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.185278:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 285 00000100:00100000:2.0:1787826781.186678:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.186756:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134143744 00000100:00100000:0.0:1787826781.186765:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134143744 00000100:00100000:0.0:1787826781.186821:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 286 00000100:00100000:0.0:1787826781.186832:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+9:10852:x1874672134143744:12345-192.168.203.6@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787826781.186856:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787826781.186878:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787826781.186883:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787826781.186886:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787826781.186889:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787826781.186891:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787826781.187639:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+9:10852:x1874672134143744:12345-192.168.203.6@tcp:256:mount.lustre.0 Request processed in 809us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826781.187646:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 286 00000100:00100000:1.0:1787826781.189050:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826781.189092:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134143872 00000100:00100000:3.0:1787826781.189098:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134143872 00000100:00100000:3.0:1787826781.189126:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 287 00000100:00100000:3.0:1787826781.189139:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+9:10852:x1874672134143872:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787826781.189151:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826781.189163:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031600/0xc0fefc09a795372f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346739a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826781.189188:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031600/0xc0fefc09a795372f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346739a expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826781.189199:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031600/0xc0fefc09a795372f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346739a expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826781.189208:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031600, rc 0) 00000100:00100000:3.0:1787826781.189334:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10852:x1874672134143872:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 194us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826781.189341:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 287 00000100:00100000:2.0:1787826781.190036:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.190078:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144000 00000100:00100000:0.0:1787826781.190082:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144000 00000100:00100000:0.0:1787826781.190106:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 288 00000100:00100000:0.0:1787826781.190111:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10852:x1874672134144000:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787826781.190247:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10852:x1874672134144000:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 103us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826781.190255:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 288 00000100:00100000:2.0:1787826781.190915:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826781.190981:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144128 00000100:00100000:1.0:1787826781.190988:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144128 00000100:00100000:1.0:1787826781.191026:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 289 00000100:00100000:1.0:1787826781.191033:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:10852:x1874672134144128:12345-192.168.203.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787826781.191118:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:10852:x1874672134144128:12345-192.168.203.6@tcp:503:mount.lustre.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826781.191125:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 289 00000100:00100000:1.0:1787826781.193010:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.193058:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144256 00000100:00100000:2.0:1787826781.193064:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144256 00000100:00100000:2.0:1787826781.193098:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 290 00000100:00100000:2.0:1787826781.193106:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:10875:x1874672134144256:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787826781.193207:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:10875:x1874672134144256:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 102us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.193238:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 290 00000100:00100000:2.0:1787826781.194016:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826781.194060:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144384 00000100:00100000:1.0:1787826781.194066:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144384 00000100:00100000:1.0:1787826781.194099:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 291 00000100:00100000:1.0:1787826781.194108:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:10875:x1874672134144384:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787826781.194168:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:10875:x1874672134144384:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826781.194177:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 291 00000100:00100000:3.0:1787826781.195594:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.195652:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144512 00000100:00100000:0.0:1787826781.195659:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144512 00000100:00100000:3.0:1787826781.195674:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.195697:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144768 00000100:00100000:0.0:1787826781.195701:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144768 00000100:00100000:0.0:1787826781.195725:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:2.0:1787826781.195736:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:0.0:1787826781.195737:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1874672134144512:12345-192.168.203.6@tcp:38:mount.lustre.0 00000100:00100000:2.0:1787826781.195748:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2389:x1874672134144768:12345-192.168.203.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787826781.195765:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 156 last 0 00010000:00080000:2.0:1787826781.195771:0:10060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1787826781.195828:0:6485:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a7953736 00000020:00000080:2.0:1787826781.195839:0:10060:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a795373d 00000004:00100000:0.0:1787826781.195847:0:6485:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:2.0:1787826781.195858:0:10060:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787826781.195945:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d547f840800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787826781.195953:0:10060:0:(import.c:65:import_set_state_nolock()) ffff8d53444b5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826781.195998:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134144512:12345-192.168.203.6@tcp:38:mount.lustre.0 Request processed in 266us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826781.196004:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:2.0:1787826781.196010:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134144768:12345-192.168.203.6@tcp:38:mount.lustre.0 Request processed in 261us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.196020:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:0.0:1787826781.196960:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.197008:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144896 00000100:00100000:2.0:1787826781.197014:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144896 00000100:00080000:0.0:1787826781.197060:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826781.197063:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:2.0:1787826781.197074:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:0:x1874672134144896:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787826781.197104:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826781.197176:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:0:x1874672134144896:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.197183:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1787826781.197243:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.197275:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145024 00000100:00100000:2.0:1787826781.197280:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145024 00000100:00080000:0.0:1787826781.197311:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826781.197321:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:2.0:1787826781.197335:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145024:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787826781.197352:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826781.197417:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145024:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.197423:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:0.0:1787826781.197432:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.197454:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134144640 00000100:00100000:2.0:1787826781.197458:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134144640 00000100:00100000:2.0:1787826781.197484:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:2.0:1787826781.197490:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:0:x1874672134144640:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787826781.197508:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826781.197540:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:0:x1874672134144640:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.197544:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:0.0:1787826781.198050:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.198093:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145152 00000100:00100000:2.0:1787826781.198097:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145152 00000100:00100000:2.0:1787826781.198119:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:2.0:1787826781.198124:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145152:12345-192.168.203.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787826781.198160:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145152:12345-192.168.203.6@tcp:40:mount.lustre.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.198165:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:3.0:1787826781.199131:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.199174:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145280 00000100:00100000:0.0:1787826781.199179:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145280 00000100:00100000:3.0:1787826781.199181:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826781.199208:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:0.0:1787826781.199230:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134145280:12345-192.168.203.6@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787826781.199243:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145536 00000100:00100000:2.0:1787826781.199248:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145536 00010000:00080000:0.0:1787826781.199253:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 156 last 0 00000100:00100000:3.0:1787826781.199277:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000020:00000080:0.0:1787826781.199282:0:8399:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a7953744 00000100:00100000:2.0:1787826781.199288:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00002000:00100000:0.0:1787826781.199296:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d547f847800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1787826781.199308:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145536:12345-192.168.203.6@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787826781.199320:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145408 00000100:00100000:3.0:1787826781.199326:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145408 00002000:00100000:0.0:1787826781.199327:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787826781.199356:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:2.0:1787826781.199363:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145536:12345-192.168.203.6@tcp:900:mount.lustre.0 Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826781.199364:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134145408:12345-192.168.203.6@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787826781.199378:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00010000:00080000:3.0:1787826781.199389:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 156 last 0 00002000:00080000:0.0:1787826781.199394:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:3.0:1787826781.199413:0:10061:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a795374b 00002000:00100000:3.0:1787826781.199420:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d534351b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00080000:0.0:1787826781.199423:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd6000 : changing import state from RECOVER to FULL 00010000:02000000:0.0:1787826781.199437:0:8399:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=211, val=2147483648*** 00002000:00100000:3.0:1787826781.199439:0:10061:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787826781.199482:0:10061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787826781.199499:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d5343518800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826781.199540:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134145408:12345-192.168.203.6@tcp:8:mount.lustre.0 Request processed in 176us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826781.199547:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:3.0:1787826781.200178:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826781.200238:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145664 00000100:00100000:1.0:1787826781.200244:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145664 00000100:00100000:1.0:1787826781.200277:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:1.0:1787826781.200289:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145664:12345-192.168.203.6@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787826781.200354:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787826781.200405:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10852:x1874672134145664:12345-192.168.203.6@tcp:33:mount.lustre.0 Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826781.200413:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00010000:00020000:0.0:1787826781.202064:0:8399:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8d5343ac52c0 x1874672134145280/t0(0) o8->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:0/0 lens 520/416 e 0 to 0 dl 1787826801 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826781.210571:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134145280:12345-192.168.203.6@tcp:8:mount.lustre.0 Request processed in 11346us (11434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826781.210584:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:1.0:1787826781.257283:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.257371:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145792 00000100:00100000:2.0:1787826781.257380:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145792 00000100:00100000:2.0:1787826781.257477:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:2.0:1787826781.257488:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10892:x1874672134145792:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1787826781.257506:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826781.257525:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673cb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.257585:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a7953759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.257598:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a7953759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.257610:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a7953759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826781.257656:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826781.257660:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826781.257678:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a7953759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.257701:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673cb expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.257739:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a7953759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673cb expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826781.257747:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:2.0:1787826781.257750:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826781.257754:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350e000, rc 0) 00000100:00100000:2.0:1787826781.257813:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:10892:x1874672134145792:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 328us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.257818:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:2.0:1787826781.260325:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826781.260381:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134145920 00000100:00100000:3.0:1787826781.260389:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134145920 00000100:00100000:3.0:1787826781.260429:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:3.0:1787826781.260435:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f702d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10892:x1874672134145920:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787826781.260459:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826781.260592:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f702d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10892:x1874672134145920:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 155us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826781.260599:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:3.0:1787826781.262168:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826781.262239:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146048 00000100:00100000:2.0:1787826781.262245:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146048 00000100:00100000:2.0:1787826781.262306:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:2.0:1787826781.262315:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10892:x1874672134146048:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826781.262333:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826781.262390:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:10892:x1874672134146048:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826781.262396:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00080000:0.0:1787826781.262461:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787826781.393412:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826782.289416:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143637120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826782.289441:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143636736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826782.289441:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143636864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826782.289536:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826782.289544:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826782.289557:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143636992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826782.289610:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826782.289622:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143637248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826782.289643:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143637120 00000100:00100000:2.0:1787826782.289652:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143637120 00000100:00100000:1.0:1787826782.289674:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826782.289677:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143637504:0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.289719:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143637760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.289721:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636992 00000100:00100000:2.0:1787826782.289728:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636992 00000100:00100000:3.0:1787826782.289744:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826782.289761:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143637248 00000100:00100000:2.0:1787826782.289766:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143637248 00000100:00100000:3.0:1787826782.289797:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143638016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.289799:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826782.289834:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787826782.289847:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f702940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143637120:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826782.289854:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143638272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826782.289863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787826782.289873:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826782.289901:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787826782.289911:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826782.289919:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143637376:0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.289959:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787826782.289973:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143637632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.289975:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f702940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143637120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826782.289990:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826782.289994:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787826782.290023:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787826782.290040:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826782.290041:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143636992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826782.290049:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143637888:0@lo:400:kworker.0 00002000:00000024:2.0:1787826782.290063:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826782.290082:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143638144:0@lo:400:kworker.0 00000100:00100000:3.0:1787826782.290124:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826782.290150:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143636992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826782.290167:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787826782.290168:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143638400:0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.290175:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826782.290201:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787826782.290260:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143637248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826782.290274:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826782.290283:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826782.290330:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636736 00000100:00100000:2.0:1787826782.290341:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143637248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (672us total) trans 0 rc 0/0 00010000:00080000:3.0:1787826782.290352:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b30c0 x1874672143636992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826782.290355:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636736 00000100:00100000:2.0:1787826782.290355:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787826782.290383:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143636992:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787826782.290393:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826782.290401:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826782.290416:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143637504 00000100:00100000:2.0:1787826782.290420:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143637504 00000100:00100000:1.0:1787826782.290431:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143637760 00000100:00100000:1.0:1787826782.290437:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143637760 00000100:00100000:3.0:1787826782.290442:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143637376 00000100:00100000:2.0:1787826782.290447:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638016 00000100:00100000:3.0:1787826782.290449:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143637376 00000100:00100000:2.0:1787826782.290452:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638016 00000100:00100000:1.0:1787826782.290476:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787826782.290491:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143636736:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826782.290494:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638272 00000100:00100000:2.0:1787826782.290501:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638272 00000100:00100000:3.0:1787826782.290507:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787826782.290521:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143637376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.290535:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143637632 00000004:00000024:1.0:1787826782.290540:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826782.290541:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143637632 00000100:00100000:3.0:1787826782.290573:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143637376:12345-0@lo:400:kworker.0 Request processed in 56us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826782.290574:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143637888 00000100:00100000:2.0:1787826782.290579:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143637888 00000100:00100000:3.0:1787826782.290584:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787826782.290600:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638144 00000100:00100000:2.0:1787826782.290603:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638144 00000100:00100000:3.0:1787826782.290623:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787826782.290631:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787826782.290636:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143637504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.290643:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143638016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.290679:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143636736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826782.290690:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787826782.290695:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143637504:12345-0@lo:400:kworker.0 Request processed in 61us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826782.290702:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143638016:12345-0@lo:400:kworker.0 Request processed in 61us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826782.290709:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787826782.290717:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826782.290718:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787826782.290733:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143637760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826782.290738:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787826782.290745:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787826782.290751:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143638272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.290755:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143637632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.290811:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143637760:12345-0@lo:400:kworker.0 Request processed in 81us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826782.290820:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787826782.290826:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143638272:12345-0@lo:400:kworker.0 Request processed in 78us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826782.290828:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143637632:12345-0@lo:400:kworker.0 Request processed in 75us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826782.290840:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787826782.290853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787826782.290861:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826782.290866:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143637888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.290868:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787826782.290881:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143638144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826782.290890:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638400 00000100:00100000:3.0:1787826782.290896:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638400 00000100:00100000:1.0:1787826782.290918:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143637888:12345-0@lo:400:kworker.0 Request processed in 56us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826782.290927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787826782.290933:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143638144:12345-0@lo:400:kworker.0 Request processed in 53us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826782.290941:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787826782.290944:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787826782.290954:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143638400:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826782.290975:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826782.290979:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143637632:0@lo:400:kworker.0 00000100:00080000:2.0:1787826782.290981:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826782.290987:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826782.290995:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143638144:0@lo:400:kworker.0 00000100:00100000:3.0:1787826782.291001:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143638400:12345-0@lo:400:kworker.0 Request processed in 50us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826782.291005:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787826782.291009:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5444f0b840 x1874672143638272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826782.291016:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826782.291022:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143638272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.291036:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143637760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826782.291062:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143636736:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787826782.291065:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7003c0 x1874672143637120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826782.291067:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143637376:0@lo:400:kworker.0 00010000:00080000:1.0:1787826782.291076:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b2580 x1874672143637248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826782.291087:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143637120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826782.291090:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143637248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826782.291094:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143637888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.291111:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143636864 00010000:00080000:3.0:1787826782.291115:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5444f0a580 x1874672143638400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826782.291124:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143636864 00000100:00100000:3.0:1787826782.291130:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143638400:0@lo:400:kworker.0 00010000:00080000:3.0:1787826782.291146:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5444f09e00 x1874672143638016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826782.291155:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787826782.291157:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143638016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.291165:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143636864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826782.291176:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826782.291177:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143637504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826782.291238:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143636864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826782.291244:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787826782.291253:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f700780 x1874672143636864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826782.291268:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143636864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787826782.417517:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826783.313543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143638528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826783.313624:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826783.313825:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638528 00000100:00100000:1.0:1787826783.313834:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638528 00000100:00100000:1.0:1787826783.313882:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787826783.313893:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143638528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826783.313932:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826783.314023:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143638528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826783.314030:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787826783.314095:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143638528:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826783.441413:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826783.641468:0:13947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 0b: empty replay =============== 06:33:02 (1787826782) 00000020:01000004:1.0:1787826784.365431:0:14044:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787826784.365491:0:14044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.365506:0:14044:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.365513:0:14044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.365520:0:14044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.365556:0:14044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787826784.365562:0:14044:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787826784.365587:0:14044:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826784.365591:0:14044:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787826784.365596:0:14044:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1787826784.365606:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826784.365615:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826784.365619:0:14044:0:(import.c:65:import_set_state_nolock()) ffff8d534260e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787826784.365629:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c81e00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826784.365634:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.365644:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826784.365652:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826784.365658:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787826784.365661:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787826784.365663:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787826784.365690:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.365698:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826784.365723:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.365742:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c81e00/0xc0fefc09a7953522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953529 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826784.365746:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143638784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826784.365761:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826784.365775:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826784.365778:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826784.365813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826784.365819:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143638656:0@lo:39:umount.0 00000100:00100000:3.0:1787826784.365858:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826784.365874:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638784 00000100:00100000:1.0:1787826784.365882:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638784 00000100:00100000:2.0:1787826784.365921:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638656 00000100:00100000:2.0:1787826784.365926:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638656 00000100:00100000:1.0:1787826784.365943:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787826784.365956:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143638784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826784.365969:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1787826784.365979:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787826784.365987:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953522 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.366001:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826784.366044:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3618:x1874672143638784:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826784.366053:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826784.366070:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143638784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826784.366071:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787826784.366088:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143638656:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787826784.366108:0:10060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79532f9 00000100:00080000:2.0:1787826784.366124:0:10060:0:(import.c:65:import_set_state_nolock()) ffff8d5476636800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826784.366161:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826784.366188:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143638656:12345-0@lo:39:umount.0 Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826784.366196:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000020:00000080:2.0:1787826784.366204:0:10060:0:(genops.c:885:class_export_put()) final put ffff8d5476632800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:3.0:1787826784.366233:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534260e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787826784.366242:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143638656:0@lo:39:umount.0 00000100:00080000:1.0:1787826784.366321:0:14044:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826784.366325:0:14044:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787826784.366329:0:14044:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826784.366354:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5476632800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826784.366475:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5476636800 for lustre-MDT0000 00000100:00080000:1.0:1787826784.367147:0:14044:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826784.367150:0:14044:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787826784.367153:0:14044:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787826784.367162:0:14044:0:(import.c:65:import_set_state_nolock()) ffff8d547d17e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787826784.367209:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143638912:0@lo:39:umount.0 00000100:00100000:3.0:1787826784.367270:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826784.367335:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143638912 00000100:00100000:1.0:1787826784.367348:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143638912 00000100:00080000:3.0:1787826784.367391:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826784.367394:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826784.367405:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143638912:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826784.367421:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795330e 00000100:00080000:1.0:1787826784.367436:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8d5476634800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787826784.367489:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143638912:12345-0@lo:39:umount.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826784.367496:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:00000080:1.0:1787826784.367506:0:6487:0:(genops.c:885:class_export_put()) final put ffff8d5476636000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00080000:3.0:1787826784.367507:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5341f61a40 x1874672143638912/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826784.367519:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d547d17e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787826784.367535:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143638912:0@lo:39:umount.0 00000020:00000080:0.0:1787826784.367547:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5476636000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:1.0:1787826784.367563:0:14044:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:2.0:1787826784.367563:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826784.367567:0:14044:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787826784.367570:0:14044:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826784.367610:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5476634800 for lustre-MDT0001 00010000:00010000:1.0:1787826784.368340:0:14044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.368351:0:14044:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.368359:0:14044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.368366:0:14044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.368389:0:14044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826784.368396:0:14044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.368403:0:14044:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368417:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826784.368418:0:14044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826784.368426:0:14044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368428:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368439:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5471c80600 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:1.0:1787826784.368442:0:14044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1787826784.368444:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826784.368447:0:14044:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1787826784.368458:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787826784.368479:0:14044:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787826784.368484:0:14044:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:1.0:1787826784.368489:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787826784.368495:0:14044:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 10000000:00010000:2.0:1787826784.368537:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826784.368546:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787826784.368549:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787826784.368552:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787826784.368587:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368595:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826784.368620:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368625:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5471c80600/0xc0fefc09a7953530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826784.368637:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f702580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143639040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826784.368641:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826784.368646:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368652:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350f400 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826784.368656:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368664:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826784.368671:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826784.368680:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787826784.368692:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787826784.368695:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787826784.368698:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787826784.368718:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368725:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826784.368746:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826784.368754:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d534350f400/0xc0fefc09a79535ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79535f4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826784.368762:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639040 00010000:00010000:2.0:1787826784.368780:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826784.368782:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826784.368785:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826784.368786:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639040 00000100:00100000:2.0:1787826784.368796:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143639168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826784.368829:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826784.368830:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826784.368845:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143639040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826784.368857:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826784.368873:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639168 00000100:00100000:2.0:1787826784.368878:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639168 00010000:00010000:0.0:1787826784.368880:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953530 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826784.368897:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826784.368913:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826784.368924:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54599f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143639168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826784.368934:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826784.368940:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143639040:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (261us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826784.368948:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79535f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a79535ed expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826784.368952:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787826784.368967:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826784.369010:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54599f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143639168:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826784.369011:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f702580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143639040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826784.369024:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787826784.369050:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826784.369094:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143639168:0@lo:103:ldlm_bl.0 00002000:00000080:1.0:1787826784.369733:0:14044:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1787826784.369750:0:14044:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00100000:3.0:1787826784.370906:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:1.0:1787826784.370987:0:14044:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1787826784.370995:0:14044:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d547f847800 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826784.371001:0:14044:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5343595800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967299 stale:0 00000020:00080000:1.0:1787826784.371005:0:14044:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5478967000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:1.0:1787826784.371010:0:14044:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5450e8cd28) has exports, disconnecting them 00000020:00080000:1.0:1787826784.371014:0:14044:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d547f847800), last request at 1787826781 00000020:00000080:1.0:1787826784.371020:0:14044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953744 00000100:00080000:1.0:1787826784.371029:0:14044:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826784.371050:0:14044:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d547f847800): rc 0 00000020:00000080:1.0:1787826784.371053:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d547f847800/2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:0.0:1787826784.371071:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787826784.371110:0:14044:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5343595800), last request at 1787826782 00000020:00000080:1.0:1787826784.371115:0:14044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795345e 00000100:00080000:1.0:1787826784.371119:0:14044:0:(import.c:65:import_set_state_nolock()) ffff8d5343592000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826784.371141:0:14044:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5343595800): rc 0 00000020:00000080:1.0:1787826784.371144:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d5343595800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787826784.371167:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826784.371168:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f847800/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:3.0:1787826784.371202:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5442bd6000 for lustre-OST0000 00000020:00080000:1.0:1787826784.371275:0:14044:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5478967000), last request at 1787826782 00000020:00000080:1.0:1787826784.371280:0:14044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79533b6 00000020:00000080:3.0:1787826784.371284:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343595800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000100:00080000:1.0:1787826784.371286:0:14044:0:(import.c:65:import_set_state_nolock()) ffff8d5478963000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826784.371298:0:14044:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5478967000): rc 0 00000020:00000080:1.0:1787826784.371300:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d5478967000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1787826784.371312:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826784.371325:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343592000 for lustre-OST0000 00000020:00080000:1.0:1787826784.371329:0:14044:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5450e8cd28) has no exports 00000020:00000080:3.0:1787826784.371332:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478967000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787826784.371356:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5478963000 for lustre-OST0000 00000020:01000000:1.0:1787826784.373047:0:14044:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d53435d8840 - data ffff8d5469b18000/ffff8d547d2d2c00 00000020:01000000:1.0:1787826784.373196:0:14044:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5342579660 - data ffff8d5469a01bd0/ffff8d54513bd000 00100000:10000000:1.0:1787826784.388006:0:14044:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787826784.392478:0:14044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79532c8 00000020:00000080:0.0:1787826784.392495:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d5478923800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787826784.392513:0:14044:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547d072000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787826784.392518:0:14044:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547d072000 2 00000020:01000004:0.0:1787826784.392527:0:14044:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d547d072000 from lustre-OST0000 00000020:00000080:2.0:1787826784.392528:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478923800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787826784.392565:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826784.392577:0:14044:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787826784.392581:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d547d179000/lustre-OST0000_UUID 00000020:00000080:0.0:1787826784.392584:0:14044:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547d179000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787826784.392592:0:14044:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787826784.392657:0:14044:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1787826784.392661:0:14044:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787826784.392665:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826784.392677:0:14044:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826784.392684:0:14044:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d545139c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826784.392699:0:14044:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d5460440000) has exports, disconnecting them 00000020:00080000:0.0:1787826784.392704:0:14044:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d545139c000), last request at 1787826717 00000020:00000080:0.0:1787826784.392713:0:14044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79532f2 00000020:00080000:0.0:1787826784.392724:0:14044:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d545139c000): rc 0 00000020:00000080:0.0:1787826784.392730:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d545139c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787826784.392750:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d545139c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787826784.394266:0:14044:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787826784.394272:0:14044:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826784.394277:0:14044:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826784.394282:0:14044:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826784.394313:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d534260e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787826784.394471:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826784.394480:0:14044:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787826784.394484:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d534260f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787826784.394487:0:14044:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534260f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787826784.394501:0:14044:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787826784.394577:0:14044:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787826784.394586:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826784.394592:0:14044:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787826784.394598:0:14044:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d547d17f800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826784.394604:0:14044:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d5342780000) has exports, disconnecting them 00000020:00080000:1.0:1787826784.394608:0:14044:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d547d17f800), last request at 1787826717 00000020:00000080:1.0:1787826784.394612:0:14044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953307 00000020:00080000:1.0:1787826784.394628:0:14044:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d547d17f800): rc 0 00000020:00000080:1.0:1787826784.394640:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d547d17f800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787826784.394667:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547d17f800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787826784.395496:0:14044:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787826784.395500:0:14044:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826784.395503:0:14044:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826784.395507:0:14044:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826784.395537:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d547d17e800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787826784.395685:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826784.395693:0:14044:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787826784.395701:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d534260b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787826784.395704:0:14044:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534260b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787826784.395710:0:14044:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787826784.395791:0:14044:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547d072000 1 00000020:00000080:0.0:1787826784.395796:0:14044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953290 00000020:00000080:0.0:1787826784.395805:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d5476371800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787826784.395816:0:14044:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787826784.395820:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826784.395822:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5476371800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787826784.395825:0:14044:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826784.395830:0:14044:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d5450eecd28) has no exports 00000020:00000080:0.0:1787826784.411809:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826784.411825:0:14044:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787826784.411830:0:14044:0:(genops.c:885:class_export_put()) final put ffff8d547d075000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787826784.411835:0:14044:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547d075000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787826784.411844:0:14044:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787826784.411952:0:14044:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d547d073800 00000020:02000400:0.0:1787826784.411998:0:14044:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787826784.465344:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826785.489350:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826786.514978:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826786.705525:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826786.705615:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826786.705648:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826786.705682:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826786.705716:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146560 00000100:00100000:0.0:1787826786.705717:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146304 00000100:00100000:1.0:1787826786.705726:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146560 00000100:00100000:0.0:1787826786.705735:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146304 00000100:00100000:0.0:1787826786.705821:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146432 00000100:00100000:0.0:1787826786.705824:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146432 00000100:00100000:1.0:1787826786.705830:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:1.0:1787826786.705845:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53434761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134146560:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826786.705849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 95 00000100:00100000:0.0:1787826786.705861:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2393:x1874672134146304:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826786.705912:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2393:x1874672134146304:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 54us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826786.705917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 95 00000100:00100000:0.0:1787826786.705933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 96 00000100:00100000:0.0:1787826786.705941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343476d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134146432:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826786.706288:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146176 00000100:00100000:3.0:1787826786.706294:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146176 00000100:00100000:3.0:1787826786.706323:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 293 00000100:00100000:3.0:1787826786.706330:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134146176:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826786.706658:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53434761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134146560:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 817us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826786.706666:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343476d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134146432:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 723us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826786.706669:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:0.0:1787826786.706681:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 96 00000100:00080000:1.0:1787826786.706696:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826786.706701:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826786.706705:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826786.707075:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134146176:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 743us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826786.707083:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 293 00000001:00100000:1.0:1787826786.900102:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:3.0:1787826786.900543:0:6464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:1.0:1787826786.900758:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000100:00100000:1.0:1787826787.409553:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143639424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826787.409582:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143639296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826787.409629:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826787.409631:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.409687:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143639680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826787.409697:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143640064:0@lo:400:kworker.0 00000100:00100000:1.0:1787826787.409739:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.409753:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826787.409753:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639424 00000100:00100000:3.0:1787826787.409762:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639424 00000100:00100000:1.0:1787826787.409776:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143640448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.409796:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143640192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826787.409808:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787826787.409810:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826787.409820:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143639424:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1787826787.409829:0:8404:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826787.409835:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826787.409837:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143640960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.409863:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143640704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826787.409878:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826787.409883:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143639424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (257us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826787.409895:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826787.409899:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826787.409922:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639296 00000100:00100000:3.0:1787826787.409927:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639296 00000100:00100000:2.0:1787826787.409944:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143641216:0@lo:13:osp-pre-0-0.0 00000100:02020000:1.0:1787826787.409952:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1787826787.409952:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640064 00000100:00100000:3.0:1787826787.409957:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640064 00000100:00100000:2.0:1787826787.409974:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826787.409979:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787826787.409987:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143639296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826787.410014:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826787.410020:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641216 00000100:00100000:2.0:1787826787.410025:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641216 00000100:00100000:2.0:1787826787.410046:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787826787.410052:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143641216:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826787.410054:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143639296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (426us total) trans 0 rc 0/0 00000020:00080000:2.0:1787826787.410063:0:8403:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826787.410067:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787826787.410081:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787826787.410089:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143640064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.410107:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143641216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (135us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826787.410114:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787826787.410129:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143640064:12345-0@lo:400:kworker.0 Request processed in 39us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826787.410135:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640192 00000100:00100000:2.0:1787826787.410140:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640192 00000100:00100000:3.0:1787826787.410148:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787826787.410168:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640704 00000100:00100000:2.0:1787826787.410172:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640704 00000100:00100000:3.0:1787826787.410174:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639680 00000100:00100000:3.0:1787826787.410179:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639680 00000100:00100000:2.0:1787826787.410210:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826787.410247:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143640192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.410290:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143640192:12345-0@lo:400:kworker.0 Request processed in 45us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826787.410298:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826787.410312:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787826787.410320:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143640704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.410330:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143639296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826787.410338:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143639808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.410354:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143640704:12345-0@lo:400:kworker.0 Request processed in 34us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826787.410361:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826787.410376:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.410382:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787826787.410392:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143639680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.410399:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143640320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.410429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.410439:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143639680:12345-0@lo:400:kworker.0 Request processed in 48us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826787.410446:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787826787.410450:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143640832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.410477:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.410479:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639808 00000100:00100000:2.0:1787826787.410484:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639808 00000100:00100000:2.0:1787826787.410515:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640832 00000100:00100000:0.0:1787826787.410518:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143639552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826787.410520:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640832 00000100:00100000:0.0:1787826787.410547:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.410553:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787826787.410564:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143639808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.410578:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143639936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826787.410610:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.410618:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143639808:12345-0@lo:400:kworker.0 Request processed in 54us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826787.410625:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143640576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.410637:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787826787.410645:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.410658:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787826787.410666:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143641088:0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.410669:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143640832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.410689:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.410716:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143640832:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826787.410722:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640448 00000100:00100000:2.0:1787826787.410726:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787826787.410728:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640448 00000100:00100000:2.0:1787826787.410760:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639552 00000100:00100000:0.0:1787826787.410764:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640960 00000100:00100000:2.0:1787826787.410765:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639552 00000100:00100000:0.0:1787826787.410770:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640960 00000100:00100000:0.0:1787826787.410783:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640576 00000100:00100000:0.0:1787826787.410785:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640576 00000100:00100000:2.0:1787826787.410793:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639936 00000100:00100000:2.0:1787826787.410798:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639936 00000100:00100000:0.0:1787826787.410803:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641088 00000100:00100000:0.0:1787826787.410808:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641088 00000100:00100000:2.0:1787826787.410822:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826787.410829:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787826787.410834:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143639552:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826787.410842:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143640576:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787826787.410854:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826787.410884:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143640576:12345-0@lo:400:kworker.0 Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826787.410893:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787826787.410893:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143639552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826787.410902:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826787.410913:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787826787.410920:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787826787.410924:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143641088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.410929:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143639936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826787.410939:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826787.410961:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143641088:12345-0@lo:400:kworker.0 Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826787.410968:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143639936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826787.410972:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787826787.410977:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787826787.410994:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826787.411000:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874672143640448:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787826787.411005:0:8399:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:02020000:2.0:1787826787.411008:0:3616:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787826787.411011:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826787.411021:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826787.411024:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787826787.411249:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143639808:0@lo:400:kworker.0 00010000:00080000:3.0:1787826787.411271:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d54533e5a40 x1874672143640832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826787.411282:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143640832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826787.411319:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826787.411323:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874672143640960:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787826787.411328:0:8401:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826787.411364:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1874672143640960:12345-0@lo:400:kworker.0 Request processed in 39us (1487us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826787.411373:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826787.411400:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143640320 00000100:00100000:3.0:1787826787.411404:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143640320 00000100:00100000:3.0:1787826787.411421:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787826787.411426:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143640320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826787.411459:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143640320:12345-0@lo:400:kworker.0 Request processed in 32us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826787.411473:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787826787.411506:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3618:x1874672143640448:12345-0@lo:400:kworker.0 Request processed in 41us (1234us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826787.411512:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787826787.411537:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d36d2c0 x1874672143639552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826787.411550:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143639552:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787826787.411560:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d36c3c0 x1874672143639936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826787.411570:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143639936:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787826787.411578:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534386f840 x1874672143640576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826787.411624:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143640320:0@lo:400:kworker.0 00000100:00080000:3.0:1787826787.411671:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826787.411675:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826787.411677:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826787.411795:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143640576:0@lo:400:kworker.0 00010000:00080000:0.0:1787826787.411809:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d54533e4000 x1874672143641088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826787.411816:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143641088:0@lo:400:kworker.0 00000100:00080000:1.0:1787826787.413579:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826787.413586:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826787.413590:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1787826787.413603:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1787826787.413607:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826787.413611:0:3618:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 100 00000100:00080000:1.0:1787826787.413618:0:3618:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826787.413646:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53439c2940 x1874672143641344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826787.413694:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143640064:0@lo:400:kworker.0 00000100:00080000:1.0:1787826787.413705:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826787.413707:0:3618:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1787826787.413711:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143640448:0@lo:400:kworker.0 00000100:00080000:1.0:1787826787.413720:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1787826787.413783:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143641344:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1787826787.413831:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826787.413877:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641344 00000100:00100000:3.0:1787826787.414022:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641344 00000100:00100000:3.0:1787826787.414060:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787826787.414066:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143641344:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:3.0:1787826787.414096:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826787.414139:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143641344:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 72us (307us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826787.414148:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787826787.414170:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826787.414177:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826787.414181:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143641344:0@lo:8:ptlrpcd_00_02.0 00000004:00080000:2.0:1787826787.427575:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1787826787.427640:0:3618:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1787826787.427640:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826787.427653:0:3616:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 100 00000100:00100000:1.0:1787826787.427656:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143640960:0@lo:400:kworker.0 00000100:00080000:2.0:1787826787.427664:0:3616:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826787.427722:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f703840 x1874672143641472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826787.427784:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143639680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.427797:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143641472:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:2.0:1787826787.427805:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143640192:0@lo:400:kworker.0 00000100:00100000:2.0:1787826787.427819:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143640704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826787.427861:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826787.427900:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641472 00000100:00100000:2.0:1787826787.427908:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641472 00000100:00100000:2.0:1787826787.427943:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787826787.427951:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143641472:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1787826787.427972:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826787.428018:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143641472:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 67us (157us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826787.428026:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787826787.428048:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826787.428055:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826787.428059:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143641472:0@lo:8:ptlrpcd_00_00.0 00010000:00010000:2.0:1787826787.538190:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826788.433471:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826788.433489:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143641600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826788.433554:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826788.433605:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641600 00000100:00100000:3.0:1787826788.433613:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641600 00000100:00100000:3.0:1787826788.433665:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787826788.433676:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143641600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826788.433709:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826788.433780:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143641600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826788.433788:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787826788.433856:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143641600:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826788.561792:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826789.585479:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826790.609705:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826791.633387:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826791.826875:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826791.826930:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826791.826981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826791.826995:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146944 00000100:00100000:3.0:1787826791.827009:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146944 00000100:00100000:2.0:1787826791.827019:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146688 00000100:00100000:2.0:1787826791.827029:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146688 00000100:00100000:0.0:1787826791.827053:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147200 00000100:00100000:0.0:1787826791.827059:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147200 00000100:00100000:2.0:1787826791.827102:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 295 00000100:00100000:0.0:1787826791.827111:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:1.0:1787826791.827125:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826791.827126:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134146688:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826791.827136:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134147200:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:3.0:1787826791.827147:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134146816 00000100:00100000:3.0:1787826791.827152:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134146816 00010000:00020000:0.0:1787826791.827165:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826791.827186:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826791.827193:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 101 00000100:00100000:3.0:1787826791.827206:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134146944:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826791.827283:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134146688:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826791.827299:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134147200:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 165us (312us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826791.827308:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 295 00000100:00100000:0.0:1787826791.827311:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1787826791.827338:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147072 00000100:00100000:3.0:1787826791.827343:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134146944:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 135us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826791.827345:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147072 00000100:00100000:3.0:1787826791.827359:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 101 00000100:00100000:3.0:1787826791.827403:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 102 00000100:00100000:0.0:1787826791.827408:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:3.0:1787826791.827423:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134146816:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826791.827429:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134147072:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787826791.827455:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826791.827477:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826791.827479:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826791.827485:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134147072:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826791.827499:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:3.0:1787826791.827632:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134146816:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 219us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826791.827654:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 102 00000100:00100000:1.0:1787826792.529471:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143641728:0@lo:400:kworker.0 00000100:00080000:2.0:1787826792.529519:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826792.529527:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826792.529532:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826792.529542:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 162 00000100:00100000:0.0:1787826792.529546:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143641856:0@lo:400:kworker.0 00000100:00080000:2.0:1787826792.529551:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826792.529563:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826792.529593:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f703840 x1874672143642496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826792.529631:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826792.529651:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826792.529671:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826792.529675:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826792.529679:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826792.529686:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 162 00000100:00080000:2.0:1787826792.529691:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826792.529696:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826792.529730:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f74f480 x1874672143643008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826792.529742:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143642368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826792.529742:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143642240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.529792:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826792.529819:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143642112:0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.529833:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143642240 00000100:00100000:1.0:1787826792.529856:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143642240 00000100:00100000:0.0:1787826792.529880:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641856 00000100:00100000:0.0:1787826792.529886:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641856 00000100:00100000:2.0:1787826792.529913:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826792.529930:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787826792.529937:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143642112 00000100:00100000:0.0:1787826792.529943:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143642112 00000100:00100000:1.0:1787826792.529947:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143642240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826792.529978:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143642752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826792.529980:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787826792.529995:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143641856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826792.530032:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143642496:0@lo:8:kworker.0 00000100:00100000:1.0:1787826792.530047:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143642240:12345-0@lo:400:kworker.0 Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826792.530049:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826792.530068:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787826792.530134:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826792.530152:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143641856:12345-0@lo:400:kworker.0 Request processed in 157us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826792.530162:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143643392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826792.530163:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787826792.530179:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826792.530193:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143642752 00000100:00100000:0.0:1787826792.530199:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143642752 00000100:00100000:1.0:1787826792.530210:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143641856:0@lo:400:kworker.0 00000100:00100000:2.0:1787826792.530258:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826792.530277:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143643136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826792.530282:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143643008:0@lo:8:kworker.0 00000100:00100000:0.0:1787826792.530289:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787826792.530310:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826792.530311:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143642112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826792.530328:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143641984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.530337:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826792.530383:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826792.530388:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143642112:12345-0@lo:400:kworker.0 Request processed in 84us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826792.530397:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787826792.530410:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143642368 00000100:00100000:2.0:1787826792.530410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826792.530419:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143642368 00000100:00100000:0.0:1787826792.530434:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787826792.530448:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143642752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826792.530457:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143642496 00000100:00100000:2.0:1787826792.530461:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143642624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.530465:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641984 00000100:00100000:3.0:1787826792.530466:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143642496 00000100:00100000:1.0:1787826792.530473:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641984 00000100:00100000:0.0:1787826792.530499:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143642752:12345-0@lo:400:kworker.0 Request processed in 56us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826792.530503:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826792.530510:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643136 00000100:00100000:3.0:1787826792.530517:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643136 00000100:00100000:1.0:1787826792.530528:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143642368:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826792.530530:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787826792.530530:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1787826792.530565:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00080000:0.0:1787826792.530572:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826792.530577:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143643264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826792.530581:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643008 00000100:00080000:0.0:1787826792.530582:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826792.530587:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643008 00000100:00100000:0.0:1787826792.530601:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143642624 00000100:00100000:0.0:1787826792.530608:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143642624 00000100:00100000:3.0:1787826792.530621:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787826792.530644:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143643136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.530646:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143642368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826792.530663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826792.530664:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787826792.530677:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787826792.530682:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143642624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.530730:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826792.530743:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143641984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826792.530757:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143642112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826792.530763:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143643136:12345-0@lo:400:kworker.0 Request processed in 128us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826792.530774:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143642624:12345-0@lo:400:kworker.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826792.530783:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826792.530792:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143642752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826792.530796:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787826792.530804:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143641984:12345-0@lo:400:kworker.0 Request processed in 60us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826792.530819:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787826792.530823:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826792.530841:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826792.530842:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143642496:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787826792.530854:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143643008:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826792.530855:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143641984:0@lo:400:kworker.0 00010000:00020000:3.0:1787826792.530867:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787826792.530888:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f81cb40 x1874672143642624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:0.0:1787826792.530895:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1787826792.530897:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d356d00 x1874672143643136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826792.530934:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143642624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.530939:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143643136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826792.530944:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143643008:12345-0@lo:8:kworker.0 Request processed in 91us (563us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826792.530954:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826792.530974:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143642368:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787826792.530984:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826792.530993:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641728 00000100:00100000:2.0:1787826792.531000:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641728 00000100:00100000:1.0:1787826792.531026:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143642240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.531036:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143642880:0@lo:400:kworker.0 00000100:00100000:2.0:1787826792.531052:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787826792.531070:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826792.531075:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143641728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826792.531109:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143642880 00000100:00100000:1.0:1787826792.531115:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143642880 00000100:00100000:2.0:1787826792.531138:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143641728:12345-0@lo:400:kworker.0 Request processed in 68us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826792.531149:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787826792.531171:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787826792.531183:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143642880:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826792.531191:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826792.531250:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143641728:0@lo:400:kworker.0 00000100:00100000:2.0:1787826792.531254:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643392 00000100:00100000:2.0:1787826792.531262:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643392 00000100:00100000:1.0:1787826792.531281:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143642880:12345-0@lo:400:kworker.0 Request processed in 98us (210us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826792.531288:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f81f0c0 x1874672143642880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826792.531293:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787826792.531298:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643264 00000100:00100000:0.0:1787826792.531307:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143642880:0@lo:400:kworker.0 00000100:00100000:2.0:1787826792.531307:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643264 00000100:00100000:2.0:1787826792.531345:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787826792.531359:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143643392:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787826792.531372:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826792.531379:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826792.531385:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143643008:0@lo:8:kworker.0 00002000:00000024:2.0:1787826792.531389:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826792.531449:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143643392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826792.531459:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787826792.531487:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5444f092c0 x1874672143643392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826792.531488:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787826792.531503:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143643264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826792.531511:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143643392:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826792.531518:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826792.531563:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143643264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826792.531571:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787826792.531575:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5444f08b40 x1874672143643264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826792.531589:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143643264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826792.542379:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143642496:12345-0@lo:8:kworker.0 Request processed in 11540us (12202us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826792.542394:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787826792.542410:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826792.542417:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826792.542434:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143642496:0@lo:8:kworker.0 00010000:00010000:1.0:1787826792.657401:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826793.553435:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143643520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826793.553522:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826793.553565:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643520 00000100:00100000:1.0:1787826793.553573:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643520 00000100:00100000:1.0:1787826793.553628:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787826793.553638:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143643520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826793.553669:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826793.553734:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143643520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826793.553741:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787826793.553779:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143643520:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826793.681392:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826794.705373:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826795.729372:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826796.753547:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826796.945096:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826796.945184:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826796.945211:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826796.945267:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826796.945284:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147328 00000100:00100000:1.0:1787826796.945293:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147328 00000100:00100000:0.0:1787826796.945299:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147456 00000100:00100000:2.0:1787826796.945304:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826796.945305:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147456 00000100:00100000:2.0:1787826796.945344:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147584 00000100:00100000:1.0:1787826796.945347:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 297 00000100:00100000:2.0:1787826796.945349:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147584 00000100:00100000:1.0:1787826796.945359:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134147328:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826796.945367:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 107 00000100:00100000:0.0:1787826796.945394:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134147456:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826796.945399:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 108 00000100:00100000:2.0:1787826796.945409:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134147584:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826796.945430:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134147328:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826796.945439:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 297 00000100:00100000:2.0:1787826796.945440:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134147584:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826796.945446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 108 00000100:00100000:0.0:1787826796.945454:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134147456:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826796.945463:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 107 00000100:00100000:1.0:1787826796.945474:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147840 00000100:00100000:1.0:1787826796.945480:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147840 00000100:00080000:0.0:1787826796.945491:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826796.945498:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826796.945502:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826796.945519:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147712 00000100:00100000:1.0:1787826796.945523:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147712 00000100:00100000:2.0:1787826796.945538:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:2.0:1787826796.945549:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134147840:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826796.945552:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:1.0:1787826796.945557:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134147712:12345-192.168.203.6@tcp:8:kworker.0 00010000:00020000:1.0:1787826796.945576:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826796.945576:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134147840:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826796.945583:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:1.0:1787826796.952668:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134147712:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 7099us (7353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826796.952706:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 31 00000020:01000004:0.0:1787826797.499606:0:14465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787826797.499609:0:14465:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787826797.499611:0:14465:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787826797.499724:0:14465:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d5442bd2800 00000020:01000004:0.0:1787826797.499737:0:14465:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787826797.499749:0:14465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787826797.499760:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d5450e8cd28) 00000020:00000080:0.0:1787826797.499774:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787826797.519983:0:14465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787826797.521628:0:14465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787826797.521849:0:14465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787826797.521960:0:14465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787826797.522070:0:14465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787826797.522232:0:14465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787826797.522389:0:14465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1787826797.523069:0:14465:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787826797.523276:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787826797.523287:0:14465:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787826797.523297:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953767 00000020:01000004:0.0:1787826797.523302:0:14465:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787826797.523319:0:14465:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787826797.523321:0:14465:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787826797.523331:0:14465:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787826797.523355:0:14465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787826797.523359:0:14465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787826797.527549:0:14465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787826797.527583:0:14465:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787826797.527588:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787826797.527590:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826797.527591:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826797.527592:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826797.527593:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826797.527595:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826797.527596:0:14465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826797.527598:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826797.527600:0:14465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826797.527603:0:14465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787826797.527605:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826797.527607:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826797.527608:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826797.527609:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826797.527610:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826797.527611:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826797.527612:0:14465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826797.527613:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826797.527614:0:14465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826797.527639:0:14465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787826797.527657:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143643648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826797.527728:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.527769:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547568a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826797.527774:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643648 00000100:00100000:2.0:1787826797.527780:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643648 00000100:00100000:2.0:1787826797.527818:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787826797.527826:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:14465:x1874672143643648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826797.527849:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787826797.527851:0:6478:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787826797.527854:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787826797.528026:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:14465:x1874672143643648:12345-0@lo:253:mount.lustre.0 Request processed in 200us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.528035:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787826797.528049:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143643648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787826797.528068:0:14465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787826797.528071:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826797.528072:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826797.528074:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826797.528075:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826797.528076:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826797.528083:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826797.528084:0:14465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826797.528085:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826797.528086:0:14465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787826797.528102:0:14465:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d5442bd2800 from lustre-OST0000 10000000:01000000:0.0:1787826797.528123:0:14465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787826797.528125:0:14465:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787826797.528137:0:14465:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:0.0:1787826797.528144:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826797.528201:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143643776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826797.528343:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.528371:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d213000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826797.528409:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643776 00000100:00100000:1.0:1787826797.528415:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643776 00000100:00100000:1.0:1787826797.528445:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787826797.528453:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:14465:x1874672143643776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826797.528519:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:14465:x1874672143643776:12345-0@lo:501:mount.lustre.0 Request processed in 67us (174us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826797.528527:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787826797.528530:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143643776:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787826797.528543:0:14465:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787826797.528557:0:14465:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787826797.528561:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.528567:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826797.528585:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d5442bd2800 10000000:01000000:0.0:1787826797.528588:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787826797.528591:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787826797.528592:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826797.528594:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787826797.528596:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787826797.528609:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.528618:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.528624:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826797.528631:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143643904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826797.528660:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.528690:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d213000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.528715:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143643904 00000100:00100000:3.0:1787826797.528721:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143643904 00000100:00100000:3.0:1787826797.528750:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787826797.528758:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:14465:x1874672143643904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826797.528773:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826797.528785:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795376e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.528806:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795376e expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.528815:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795376e expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.528822:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031400, rc 0) 00000100:00100000:3.0:1787826797.528856:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143643904:12345-0@lo:101:mount.lustre.0 Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.528863:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787826797.528872:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143643904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826797.528886:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.528896:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826797.529414:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787826797.529794:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826797.531099:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787826797.531129:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787826797.531145:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787826797.531160:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787826797.531175:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787826797.531190:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787826797.531232:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787826797.531241:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787826797.531315:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826797.531362:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.531410:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d2133c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826797.531423:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644032 00000100:00100000:2.0:1787826797.531429:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644032 00000100:00100000:2.0:1787826797.531463:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787826797.531471:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826797.531570:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644032:12345-0@lo:501:mount.lustre.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.531577:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787826797.531589:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826797.531621:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826797.531657:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.531689:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d2133c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826797.531710:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644160 00000100:00100000:2.0:1787826797.531715:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644160 00000100:00100000:2.0:1787826797.531749:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787826797.531754:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826797.531828:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644160:12345-0@lo:503:mount.lustre.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.531836:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787826797.531839:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826797.532086:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826797.532125:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826797.532151:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.532169:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d213000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826797.532197:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644288 00000100:00100000:1.0:1787826797.532203:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644288 00000100:00100000:1.0:1787826797.532260:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787826797.532269:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826797.532343:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826797.532349:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644288:12345-0@lo:502:mount.lustre.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826797.532358:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000040:00080000:0.0:1787826797.532465:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787826797.532486:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787826797.532500:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787826797.532512:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787826797.532519:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787826797.532526:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787826797.532532:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787826797.532539:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787826797.532546:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787826797.532552:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787826797.532559:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787826797.532566:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787826797.532579:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826797.532601:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.532620:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d213000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.532645:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644416 00000100:00100000:3.0:1787826797.532650:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644416 00000100:00100000:3.0:1787826797.532690:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787826797.532696:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826797.532752:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644416:12345-0@lo:502:mount.lustre.0 Request processed in 57us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.532756:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787826797.532851:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826797.532882:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787826797.532889:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787826797.533260:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787826797.533265:0:14469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787826797.533269:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826797.533271:0:14469:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787826797.533274:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787826797.533284:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5450e8b370) 00000020:00000080:0.0:1787826797.533298:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787826797.533301:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787826797.533344:0:14469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5442bd2800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787826797.533351:0:14469:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787826797.533357:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953783 00010000:00010000:0.0:1787826797.535814:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:0.0:1787826797.536133:0:14469:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 4294967299 lx: 1874672143596416 gen 0 00000001:00080000:0.0:1787826797.536160:0:14469:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294967299 srv lr: 4294967299 lx: 1874672143598336 gen 0 00000001:00080000:0.0:1787826797.536175:0:14469:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 0 srv lr: 4294967299 lx: 0 gen 0 00000001:00000004:0.0:1787826797.536190:0:14469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967299 00080000:10000000:0.0:1787826797.537260:0:14469:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787826797.537956:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787826797.537967:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826797.537973:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826797.537975:0:14469:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787826797.537978:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787826797.537980:0:14469:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787826797.537982:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826797.537983:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826797.537985:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787826797.537988:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826797.537990:0:14469:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787826797.538000:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826797.538003:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826797.538005:0:14469:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787826797.538008:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787826797.538010:0:14469:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787826797.538013:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826797.538015:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826797.538017:0:14469:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787826797.538021:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826797.538024:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826797.538026:0:14469:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787826797.538030:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787826797.538048:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826797.538052:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826797.538054:0:14469:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787826797.538057:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787826797.538232:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787826797.538262:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787826797.538277:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.538286:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826797.538292:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5442bd2800 from 1 10000000:01000000:1.0:1787826797.538293:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826797.538325:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.538344:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.538356:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826797.538378:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826797.538440:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826797.538489:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644544 00000100:00100000:1.0:1787826797.538490:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.538496:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644544 00000100:00100000:3.0:1787826797.538554:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787826797.538565:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:14465:x1874672143644544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826797.538578:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826797.538591:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440031200/0xc0fefc09a79537a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795379f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.538625:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440031200/0xc0fefc09a79537a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795379f expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.538650:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440031200/0xc0fefc09a79537a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795379f expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.538659:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031200, rc 0) 00000100:00100000:3.0:1787826797.538726:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143644544:12345-0@lo:101:mount.lustre.0 Request processed in 164us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.538734:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787826797.538821:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826797.538835:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.538844:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826797.539608:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787826797.539817:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826797.539963:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787826797.539991:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787826797.540003:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787826797.540006:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787826797.540057:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826797.540085:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.540110:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826797.540126:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644672 00000100:00100000:2.0:1787826797.540132:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644672 00000100:00100000:2.0:1787826797.540175:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787826797.540186:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143644672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826797.540309:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143644672:12345-0@lo:501:mount.lustre.0 Request processed in 125us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.540318:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787826797.540327:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826797.540357:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826797.540399:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.540424:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826797.540448:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644800 00000100:00100000:2.0:1787826797.540452:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644800 00000100:00100000:2.0:1787826797.540488:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787826797.540494:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143644800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826797.540577:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143644800:12345-0@lo:503:mount.lustre.0 Request processed in 82us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.540585:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787826797.540593:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826797.540879:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826797.540916:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826797.540947:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.540969:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826797.540990:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143644928 00000100:00100000:0.0:1787826797.540995:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143644928 00000100:00100000:0.0:1787826797.541033:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787826797.541042:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143644928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826797.541127:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143644928:12345-0@lo:502:mount.lustre.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826797.541132:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787826797.541138:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143644928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826797.541273:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787826797.541297:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787826797.541314:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787826797.541323:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787826797.541332:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000100:00100000:1.0:1787826797.541351:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826797.541386:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.541406:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826797.541417:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645056 00000100:00100000:0.0:1787826797.541422:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645056 00000100:00100000:0.0:1787826797.541445:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787826797.541451:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143645056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826797.541502:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143645056:12345-0@lo:502:mount.lustre.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826797.541507:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787826797.541522:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826797.541555:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787826797.541560:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1787826797.541895:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826797.541901:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826797.541902:0:14473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787826797.541907:0:14473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5442bd2800 00000020:00000080:1.0:1787826797.541909:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787826797.541913:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826797.541915:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826797.541916:0:14473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787826797.541923:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826797.541925:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826797.541926:0:14473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787826797.541928:0:14473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5442bd2800 00000020:00000080:1.0:1787826797.541930:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787826797.541971:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826797.541973:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826797.541974:0:14473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787826797.541977:0:14473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:0.0:1787826797.542035:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787826797.542065:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787826797.542081:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.542088:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826797.542136:0:14465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787826797.542139:0:14465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d5442bd2800 10000000:01000000:0.0:1787826797.542142:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d5442bd2800 10000000:01000000:0.0:1787826797.542156:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826797.542162:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5442bd2800 from 1 10000000:01000000:0.0:1787826797.542165:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826797.542189:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.542197:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.542207:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826797.542247:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826797.542286:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.542310:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442f279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.543198:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645184 00000100:00100000:3.0:1787826797.543205:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645184 00000100:00100000:3.0:1787826797.543280:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787826797.543290:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:14465:x1874672143645184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826797.543302:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826797.543316:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79537b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79537ad expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.543338:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79537b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79537ad expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.543350:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79537b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79537ad expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.543358:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030a00, rc 0) 00000100:00100000:3.0:1787826797.543402:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645184:12345-0@lo:101:mount.lustre.0 Request processed in 115us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.543411:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787826797.543428:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826797.543443:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.543451:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826797.544550:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787826797.544827:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826797.545057:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787826797.545086:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787826797.545106:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787826797.545131:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787826797.545150:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787826797.545167:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787826797.545192:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787826797.545211:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787826797.545264:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787826797.545289:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787826797.545306:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787826797.545322:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787826797.545340:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787826797.545357:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787826797.545384:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787826797.545407:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787826797.545421:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787826797.545436:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787826797.545451:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787826797.545464:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787826797.545479:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787826797.545497:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787826797.545511:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787826797.545524:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787826797.545538:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787826797.545551:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787826797.545564:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787826797.545578:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787826797.545605:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787826797.545620:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787826797.545633:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787826797.545645:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787826797.545658:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787826797.545686:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787826797.545705:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787826797.545720:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787826797.545734:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787826797.545754:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787826797.545758:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787826797.545848:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826797.545894:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.545935:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.545941:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645312 00000100:00100000:3.0:1787826797.545949:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645312 00000100:00100000:3.0:1787826797.545989:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787826797.546000:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826797.546118:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645312:12345-0@lo:501:mount.lustre.0 Request processed in 120us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.546127:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787826797.546143:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826797.546174:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826797.546238:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826797.546265:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645440 00000100:00100000:3.0:1787826797.546269:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645440 00000100:00100000:1.0:1787826797.546274:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.546307:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787826797.546318:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826797.546399:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645440:12345-0@lo:503:mount.lustre.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.546406:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787826797.546418:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826797.546761:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826797.546813:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826797.546852:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.546878:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.546896:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645568 00000100:00100000:3.0:1787826797.546901:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645568 00000100:00100000:3.0:1787826797.546940:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787826797.546948:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826797.547031:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645568:12345-0@lo:502:mount.lustre.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.547038:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787826797.547043:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826797.547170:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787826797.547194:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787826797.547211:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787826797.547304:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787826797.547324:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787826797.547355:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787826797.547373:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787826797.547388:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787826797.547401:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787826797.547415:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787826797.547430:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787826797.547445:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787826797.547458:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787826797.547475:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787826797.547492:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787826797.547507:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787826797.547516:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787826797.547527:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787826797.547535:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787826797.547542:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787826797.547550:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787826797.547573:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787826797.547586:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787826797.547595:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787826797.547604:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787826797.547614:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787826797.547624:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787826797.547634:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787826797.547643:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787826797.547653:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787826797.547660:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787826797.547692:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787826797.547711:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787826797.547728:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787826797.547739:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787826797.547748:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787826797.547758:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787826797.547775:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787826797.547784:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787826797.547791:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787826797.547799:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787826797.547807:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787826797.547814:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787826797.547822:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787826797.547831:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787826797.547845:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787826797.547858:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787826797.547871:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787826797.547901:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826797.547940:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.547967:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826797.547973:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645696 00000100:00100000:2.0:1787826797.547978:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645696 00000100:00100000:2.0:1787826797.548020:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787826797.548029:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826797.548123:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645696:12345-0@lo:502:mount.lustre.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.548130:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787826797.548135:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826797.548286:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787826797.548302:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787826797.548316:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826797.548347:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.548372:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826797.548387:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645824 00000100:00100000:2.0:1787826797.548392:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645824 00000100:00100000:2.0:1787826797.548422:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787826797.548430:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826797.548497:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143645824:12345-0@lo:502:mount.lustre.0 Request processed in 69us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.548504:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787826797.548513:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143645824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826797.548545:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787826797.548551:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787826797.549000:0:14476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787826797.549013:0:14476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d5342780000) 00000020:00000080:2.0:1787826797.549033:0:14476:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787826797.549101:0:14476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5442bd2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826797.549105:0:14476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5442bd2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826797.549108:0:14476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd2800 3 00010000:00080000:2.0:1787826797.549132:0:14476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d54438ab800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826797.550784:0:14476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:2.0:1787826797.550961:0:14476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826797.550995:0:14476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826797.551015:0:14476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a79537c2 00000100:00080000:2.0:1787826797.551024:0:14476:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826797.551029:0:14476:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d54438ab800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826797.551060:0:14476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e16d680 x1874672143645952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826797.551095:0:14476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787826797.551140:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143645952:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826797.551195:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551249:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143645952 00000100:00100000:1.0:1787826797.551256:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143645952 00000100:00100000:1.0:1787826797.551290:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787826797.551297:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1874672143645952:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787826797.551314:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000100:00080000:2.0:1787826797.551336:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826797.551341:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826797.551343:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826797.551349:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 167 00000100:00080000:2.0:1787826797.551352:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826797.551356:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000020:00000080:1.0:1787826797.551361:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a79537c9 00000100:00100000:2.0:1787826797.551374:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e16e1c0 x1874672143646592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:1.0:1787826797.551376:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826797.551412:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d5476632800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787826797.551413:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1787826797.551416:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143646208:0@lo:400:kworker.0 00000100:00080000:2.0:1787826797.551422:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826797.551425:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826797.551430:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 167 00000100:00080000:2.0:1787826797.551433:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826797.551436:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826797.551450:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e16da40 x1874672143647104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826797.551468:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143645952:12345-0@lo:38:llog_process_th.0 Request processed in 169us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.551475:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551484:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826797.551487:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143646080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826797.551513:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143646848:0@lo:400:kworker.0 00000100:00100000:2.0:1787826797.551523:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551552:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646080 00000100:00100000:2.0:1787826797.551556:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143646720:0@lo:400:kworker.0 00000100:00100000:1.0:1787826797.551558:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646080 00000100:00100000:3.0:1787826797.551565:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551593:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646848 00000100:00100000:2.0:1787826797.551597:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551598:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646848 00000100:00100000:3.0:1787826797.551601:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787826797.551611:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143646336:0@lo:400:kworker.0 00000100:00100000:2.0:1787826797.551628:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787826797.551629:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787826797.551638:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143646464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826797.551639:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143646080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826797.551660:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826797.551704:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143646976:0@lo:400:kworker.0 00000100:00100000:2.0:1787826797.551705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551714:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143646080:12345-0@lo:400:kworker.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826797.551727:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787826797.551733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143647232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826797.551744:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646336 00000100:00100000:3.0:1787826797.551746:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551750:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646336 00000100:00100000:2.0:1787826797.551771:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.551775:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646976 00000100:00100000:1.0:1787826797.551779:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646976 00000100:00100000:3.0:1787826797.551786:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646208 00000100:00100000:3.0:1787826797.551792:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646208 00000100:00100000:1.0:1787826797.551808:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787826797.551810:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143646080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826797.551820:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143646848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826797.551829:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646464 00000100:00100000:3.0:1787826797.551834:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646464 00000100:00100000:2.0:1787826797.551857:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646720 00000100:00100000:2.0:1787826797.551862:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646720 00000100:00100000:3.0:1787826797.551865:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787826797.551876:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143646848:12345-0@lo:400:kworker.0 Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.551878:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143646208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826797.551891:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787826797.551895:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143647232 00000100:00100000:2.0:1787826797.551900:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143647232 00000100:00100000:1.0:1787826797.551912:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787826797.551923:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143646336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826797.551930:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143646208:12345-0@lo:400:kworker.0 Request processed in 55us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.551932:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787826797.551943:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787826797.551945:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143646720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826797.551965:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787826797.551967:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143646336:12345-0@lo:400:kworker.0 Request processed in 47us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.551976:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143646464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826797.551977:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787826797.551993:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143646720:12345-0@lo:400:kworker.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826797.552000:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787826797.552004:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787826797.552012:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143646976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826797.552025:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787826797.552030:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143646464:12345-0@lo:400:kworker.0 Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.552039:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143647232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826797.552043:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787826797.552051:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143646976:12345-0@lo:400:kworker.0 Request processed in 42us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826797.552060:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787826797.552083:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143646592:0@lo:8:kworker.0 00000100:00100000:2.0:1787826797.552085:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143647232:12345-0@lo:400:kworker.0 Request processed in 47us (314us total) trans 0 rc 0/0 00000100:00080000:1.0:1787826797.552088:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826797.552093:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826797.552096:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826797.552097:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787826797.552123:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826797.552142:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143646592 00000100:00100000:2.0:1787826797.552146:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143646592 00000100:00100000:3.0:1787826797.552153:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143647104:0@lo:8:kworker.0 00000100:00100000:2.0:1787826797.552167:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787826797.552173:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143646592:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787826797.552183:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826797.552211:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1787826797.552240:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143646592:12345-0@lo:8:kworker.0 Request processed in 63us (116us total) trans 0 rc -11/-11 00000100:00080000:3.0:1787826797.552243:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00100000:2.0:1787826797.552248:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787826797.552259:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:2.0:1787826797.552260:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143647104 00000100:00080000:3.0:1787826797.552264:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787826797.552268:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d54438ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826797.552271:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143647104 00000100:00100000:3.0:1787826797.552277:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143645952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826797.552294:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787826797.552300:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143647104:12345-0@lo:8:kworker.0 00000100:00080000:3.0:1787826797.552308:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826797.552313:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826797.552318:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143646592:0@lo:8:kworker.0 00000100:00080000:3.0:1787826797.552339:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1787826797.552342:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143647104:12345-0@lo:8:kworker.0 Request processed in 40us (158us total) trans 0 rc -11/-11 00000100:00080000:3.0:1787826797.552345:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826797.552353:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143647104:0@lo:8:kworker.0 00000100:00100000:2.0:1787826797.552357:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826797.552391:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143646336:0@lo:400:kworker.0 00000100:00100000:2.0:1787826797.552409:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143646464:0@lo:400:kworker.0 00010000:00080000:3.0:1787826797.552412:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e16cb40 x1874672143646976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826797.552424:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143646976:0@lo:400:kworker.0 00010000:00080000:2.0:1787826797.552428:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e16c000 x1874672143647232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826797.552440:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143647232:0@lo:400:kworker.0 00000100:00100000:3.0:1787826797.552446:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143646208:0@lo:400:kworker.0 00010000:00080000:2.0:1787826797.552456:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e16d2c0 x1874672143646720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826797.552466:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143646848:0@lo:400:kworker.0 00000100:00100000:2.0:1787826797.552467:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143646720:0@lo:400:kworker.0 00000020:01000004:2.0:1787826797.552613:0:14476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787826797.552633:0:14476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d53444fb370) 00000020:00000080:2.0:1787826797.552649:0:14476:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787826797.552726:0:14476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5442bd2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826797.552730:0:14476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5442bd2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826797.552734:0:14476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd2800 3 00010000:00080000:2.0:1787826797.552756:0:14476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d53444ef000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826797.554049:0:14476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:2.0:1787826797.554232:0:14476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826797.554262:0:14476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826797.554271:0:14476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a79537d7 00000100:00080000:2.0:1787826797.554279:0:14476:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826797.554284:0:14476:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d53444ef000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826797.554308:0:14476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e16f480 x1874672143647360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826797.554339:0:14476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787826797.554446:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143647360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826797.554517:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826797.554570:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143647360 00000100:00100000:2.0:1787826797.554576:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143647360 00000100:00100000:2.0:1787826797.554608:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826797.554614:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1874672143647360:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787826797.554634:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1787826797.554667:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a79537de 00000004:00100000:2.0:1787826797.554691:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826797.554728:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d53444e9800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1787826797.554759:0:14476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1787826797.554774:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143647360:12345-0@lo:38:llog_process_th.0 Request processed in 158us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.554781:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787826797.554813:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e16f480 x1874672143647360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826797.554819:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826797.554824:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787826797.554828:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787826797.554831:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787826797.554832:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444ef000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826797.554835:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143647360:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787826797.555287:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787826797.555346:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826797.555362:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826797.555379:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826797.555420:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787826797.555423:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826797.555424:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826797.555425:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826797.555426:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826797.555427:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826797.555428:0:14465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826797.555430:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826797.555431:0:14465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826797.555434:0:14465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787826797.555435:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826797.555436:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826797.555437:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826797.555438:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826797.555439:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826797.555440:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826797.555441:0:14465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826797.555442:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826797.555442:0:14465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826797.555453:0:14465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787826797.555470:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143647488:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826797.555512:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826797.555545:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143647488 00000100:00100000:2.0:1787826797.555546:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54438d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826797.555552:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143647488 00000100:00100000:3.0:1787826797.555595:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787826797.555606:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143647488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787826797.555646:0:6480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787826797.555657:0:6480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787826797.559795:0:6480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787826797.559805:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787826797.559827:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826797.559832:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826797.559851:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.559877:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.559884:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.559893:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.559901:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.559930:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.559940:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 9 pid: 9479 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826797.559950:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143647616:192.168.203.6@tcp:104: 00000100:00100000:3.0:1787826797.559994:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:14465:x1874672143647488:12345-0@lo:253:mount.lustre.0 Request processed in 4388us (4480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826797.560005:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787826797.560012:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:14465:1874672143647488:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826797.560029:0:14465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787826797.560032:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826797.560033:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826797.560035:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826797.560037:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826797.560038:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:1.0:1787826797.560041:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826797.560047:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826797.560050:0:14465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826797.560054:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:1.0:1787826797.560056:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 23 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826797.560056:0:14465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787826797.560072:0:14465:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787826797.560076:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f701a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143647744:0@lo:104: 00000100:00100000:1.0:1787826797.560110:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826797.560143:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826797.560153:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143647744 00010000:00010000:1.0:1787826797.560155:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 23 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826797.560161:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143647744 00000100:00100000:1.0:1787826797.560164:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143647872:0@lo:104: 00000100:00100000:1.0:1787826797.560182:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.560195:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826797.560205:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143647872 00000100:00100000:1.0:1787826797.560207:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143647872 00000100:00100000:1.0:1787826797.560264:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787826797.560277:0:13289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787826797.560277:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143647872:12345-0@lo:104: 00000100:00100000:0.0:1787826797.560292:0:13289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143647744:12345-0@lo:104: 00010000:00010000:1.0:1787826797.560292:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.560308:0:13289:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560347:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826797.560355:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143647872:12345-0@lo:104: Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826797.560363:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787826797.560373:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f701a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143647744:0@lo:104: 00010000:00010000:0.0:1787826797.560379:0:13289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787826797.560387:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787826797.560388:0:13289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143647744:12345-0@lo:104: Request processed in 100us (277us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826797.560396:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826797.560396:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143647872:0@lo:104: 00000100:00100000:0.0:1787826797.560401:0:13289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1787826797.560411:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350e400 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826797.560415:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560422:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.560429:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787826797.560440:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826797.560447:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826797.560449:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.560460:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350f600 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:3.0:1787826797.560464:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.560473:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560475:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826797.560481:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560482:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1787826797.560492:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826797.560499:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560508:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79534e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79534ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.560518:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560520:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826797.560523:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826797.560525:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826797.560530:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826797.560539:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143648000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826797.560561:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.560568:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79534f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79534f8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826797.560569:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143648128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826797.560575:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.560605:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826797.560633:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648000 00000100:00100000:1.0:1787826797.560637:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648000 00000100:00100000:0.0:1787826797.560651:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648128 00010000:00010000:1.0:1787826797.560654:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 24 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826797.560656:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648128 00010000:00010000:0.0:1787826797.560689:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 25 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826797.560696:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787826797.560708:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3619:x1874672143648000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826797.560719:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826797.560724:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 25 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826797.560728:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787826797.560740:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143648128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826797.560743:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 25 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.560749:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826797.560751:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826797.560754:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826797.560758:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826797.560759:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 25 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560761:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c80c00/0xc0fefc09a79534ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79534e3 expref: 25 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.560782:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 24 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.560792:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826797.560798:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5471c81000/0xc0fefc09a79534f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79534f1 expref: 24 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826797.560808:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826797.560832:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143648000:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826797.560841:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787826797.560849:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143648000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826797.560851:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143648128:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826797.560863:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787826797.560912:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143648128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826797.561455:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143647616:192.168.203.6@tcp:104: 00000100:00100000:0.0:1787826797.561457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00010000:3.0:1787826797.561482:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826797.561509:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134147968 00000100:00100000:1.0:1787826797.561513:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134147968 00010000:00010000:1.0:1787826797.561530:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 10 pid: 9479 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826797.561554:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:1.0:1787826797.561562:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134147968:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826797.561571:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826797.561576:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 10 pid: 9479 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561586:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 10 pid: 9479 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561597:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350e600/0xc0fefc09a7953728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467393 expref: 10 pid: 9479 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561607:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561620:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826797.561632:0:7428:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001800095s 00010000:00010000:1.0:1787826797.561636:0:7428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561648:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561656:0:7428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561663:0:7428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561668:0:7428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7600 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826797.561682:0:7428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561690:0:7428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561710:0:7428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826797.561719:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826797.561747:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134147968:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 186us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826797.561753:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 42 00010000:00010000:3.0:1787826797.561853:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.561862:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826797.561868:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a79537e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787826797.564730:0:14465:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294967299 00010000:00080000:1.0:1787826797.565155:0:14482:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 14482 00010000:00080000:1.0:1787826797.565165:0:14482:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1787826797.565169:0:14482:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:2.0:1787826797.565205:0:14465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826797.565255:0:14465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826797.565276:0:14465:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787826797.565288:0:14465:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787826797.566024:0:14465:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826797.566478:0:14465:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787826797.649354:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143648256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826797.649392:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826797.649408:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143648384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826797.649430:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826797.649456:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826797.649485:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648256 00000100:00100000:0.0:1787826797.649492:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648256 00000100:00100000:2.0:1787826797.649504:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648384 00000100:00100000:2.0:1787826797.649510:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648384 00000100:00100000:0.0:1787826797.649548:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826797.649559:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143648256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826797.649595:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826797.649652:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143648256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826797.649661:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787826797.649686:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d36d2c0 x1874672143648256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826797.649693:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826797.649705:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143648384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826797.649713:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143648256:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826797.649719:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826797.649764:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143648384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826797.649770:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787826797.649795:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534243da40 x1874672143648384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826797.649818:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143648384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826797.650333:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826797.650342:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143648512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826797.650376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826797.650413:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648512 00000100:00100000:2.0:1787826797.650419:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648512 00000100:00100000:2.0:1787826797.650458:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826797.650467:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143648512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826797.650490:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826797.650541:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143648512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826797.650546:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787826797.650557:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143648512:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787826797.777470:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787826797.893303:0:14531:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826797.893498:0:14531:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826798.673414:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143648640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826798.673486:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.673535:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648640 00000100:00100000:2.0:1787826798.673543:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648640 00000100:00100000:2.0:1787826798.673596:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787826798.673618:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143648640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826798.673649:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826798.673710:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143648640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.673717:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787826798.673765:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143648640:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1787826798.737282:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826798.737288:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 7 10000000:01000000:2.0:1787826798.737293:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826798.737336:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.737348:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.737360:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826798.737385:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143648768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826798.737466:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826798.737514:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648768 00000100:00100000:0.0:1787826798.737522:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648768 00000100:00100000:2.0:1787826798.737555:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826798.737583:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787826798.737597:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143648768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826798.737610:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826798.737631:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79537ec expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826798.737655:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826798.737680:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826798.737694:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1600, rc 0) 00000100:00100000:0.0:1787826798.737741:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143648768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826798.737749:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787826798.737756:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143648768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826798.737772:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826798.737780:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826798.737824:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143648896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787826798.737860:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826798.737882:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826798.737903:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143648896 00000100:00100000:2.0:1787826798.737910:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143648896 00000100:00100000:2.0:1787826798.737945:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787826798.737953:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143648896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826798.737969:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826798.737983:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826798.737986:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787826798.738089:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143648896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.738104:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787826798.738134:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143648896:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1787826798.738171:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 4, was 0): DISCONN 00010000:00080000:2.0:1787826798.738181:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:2.0:1787826798.738186:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826798.738192:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826798.738210:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e16cb40 x1874672143649024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1787826798.738256:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826798.738261:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.738267:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826798.738274:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826798.738276:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 7 10000000:01000000:2.0:1787826798.738277:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826798.738290:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.738295:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.738300:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826798.738317:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143649152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826798.738344:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.738374:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826798.738383:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143649024:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1787826798.738390:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649152 00000100:00100000:2.0:1787826798.738395:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649152 00000100:00100000:2.0:1787826798.738424:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787826798.738429:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.738438:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143649152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826798.738446:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826798.738454:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79537fa expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.738470:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826798.738477:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649024 00010000:00010000:2.0:1787826798.738482:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826798.738483:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649024 00010000:00010000:2.0:1787826798.738495:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350f800, rc 0) 00000100:00100000:3.0:1787826798.738515:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787826798.738521:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143649024:12345-0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1787826798.738529:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143649152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.738535:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00080000:3.0:1787826798.738542:0:10061:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d544532d800, cookie 0xc0fefc09a795378a 00010000:00080000:3.0:1787826798.738549:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d544532d800 cur 173 last 1787826797 00010000:02000400:3.0:1787826798.738558:0:10061:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:2.0:1787826798.738569:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143649152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826798.738581:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.738586:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826798.738622:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143649280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787826798.738647:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.738658:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826798.738683:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649280 00000100:00100000:2.0:1787826798.738686:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649280 00000100:00100000:2.0:1787826798.738709:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787826798.738714:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143649280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826798.738723:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826798.738733:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826798.738739:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787826798.738809:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143649280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.738815:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787826798.738851:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143649280:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1787826798.738880:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 4, was 0): DISCONN 00010000:00080000:2.0:1787826798.738885:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:2.0:1787826798.738889:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826798.738894:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826798.738909:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e16f840 x1874672143649408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1787826798.738944:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826798.738950:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.738957:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826798.738989:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143649408:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1787826798.739015:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826798.739044:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649408 00000100:00100000:1.0:1787826798.739049:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649408 00000100:00100000:1.0:1787826798.739077:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826798.739083:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143649408:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1787826798.739100:0:9498:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d544532a800, cookie 0xc0fefc09a7953791 00010000:00080000:1.0:1787826798.739105:0:9498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d544532a800 cur 173 last 1787826797 00010000:00080000:1.0:1787826798.739114:0:9498:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:1.0:1787826798.739128:0:9498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d544532a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787826798.739139:0:9498:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787826798.739142:0:9498:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1787826798.739598:0:9498:0:(import.c:65:import_set_state_nolock()) ffff8d546e144800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826798.739640:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143649408:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 556us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826798.739648:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787826798.739688:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16f840 x1874672143649408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826798.739707:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787826798.739717:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787826798.739721:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787826798.739724:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00080000:2.0:1787826798.739729:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 4294967299 last 0 00000100:00080000:2.0:1787826798.739733:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1787826798.739919:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143649408:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826798.739945:0:14651:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787826798.739949:0:14651:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1787826798.739954:0:14651:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1787826798.739992:0:14651:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787826798.740035:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143649536:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787826798.740066:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.740094:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649536 00000100:00100000:2.0:1787826798.740099:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649536 00000100:00100000:2.0:1787826798.740135:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787826798.740145:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143649536:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787826798.740158:0:8401:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f700780 x1874672143649536/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1787826809 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826798.740176:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143649536:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (112us total) trans 0 rc 0/-999 00010000:00080000:1.0:1787826798.740184:0:14482:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1787826798.740197:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00002000:00100000:3.0:1787826798.742019:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d544532d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787826798.742027:0:10061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787826798.742029:0:10061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1787826798.742053:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d547f8e3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826798.742112:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143649024:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 3588us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826798.742120:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787826798.742151:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16cb40 x1874672143649024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826798.742164:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787826798.742172:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787826798.742175:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787826798.742178:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:2.0:1787826798.742180:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00080000:2.0:1787826798.742183:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1787826798.742360:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143649024:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826798.742371:0:14653:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787826798.742375:0:14653:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1787826798.742380:0:14653:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1787826798.742418:0:14653:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1787826798.742466:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143649664:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826798.742498:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.742522:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649664 00000100:00100000:2.0:1787826798.742528:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649664 00000100:00100000:2.0:1787826798.742567:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787826798.742574:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143649664:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787826798.742586:0:8402:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d534243c780 x1874672143649664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1787826809 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826798.742604:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143649664:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (106us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826798.742610:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787826798.742619:0:14482:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:0.0:1787826798.801270:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00010000:1.0:1787826798.801341:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826798.801342:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148096 00000100:00100000:2.0:1787826798.801351:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148096 00000100:00100000:2.0:1787826798.801407:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 321 00000100:00100000:2.0:1787826798.801431:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+9:10866:x1874672134148096:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826798.801447:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826798.801462:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673d2 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.801499:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 10 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.801511:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 10 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826798.801520:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350fc00, rc 0) 00000100:00100000:2.0:1787826798.801565:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134148096:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 139us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.801570:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 321 00000100:00100000:1.0:1787826798.803026:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826798.803099:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148224 00000100:00100000:2.0:1787826798.803105:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148224 00000100:00100000:2.0:1787826798.803146:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 322 00000100:00100000:2.0:1787826798.803154:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134148224:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826798.803170:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787826798.803186:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826798.803189:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787826798.807521:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134148224:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 4358us (4488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.807535:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 322 00000100:00100000:0.0:1787826798.808477:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826798.808527:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148352 00000100:00100000:1.0:1787826798.808534:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148352 00000100:00100000:1.0:1787826798.808564:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:1.0:1787826798.808570:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134148352:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 00010000:00080000:1.0:1787826798.808603:0:8399:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d544532c000, cookie 0xc0fefc09a7953798 00010000:00080000:1.0:1787826798.808609:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t0 exp ffff8d544532c000 cur 173 last 1787826797 00002000:00100000:1.0:1787826798.808623:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d544532c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787826798.808634:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787826798.808798:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d546e146000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1787826798.808831:0:14482:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1787826798.808836:0:14482:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 4294967300 00000100:00100000:1.0:1787826798.808841:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134148352:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 Request processed in 270us (367us total) trans 0 rc 0/0 00010000:00080000:3.0:1787826798.808846:0:14482:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294967300 00000100:00100000:1.0:1787826798.808850:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 36 00010000:00080000:3.0:1787826798.808851:0:14482:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294967300 00000100:00100000:0.0:1787826798.809690:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826798.809727:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148480 00000100:00100000:3.0:1787826798.809732:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148480 00000100:00100000:3.0:1787826798.809760:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:3.0:1787826798.809766:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134148480:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1787826798.809776:0:10061:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d5343475a40 x1874672134148480/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:399/0 lens 224/0 e 0 to 0 dl 1787826809 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826798.809790:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134148480:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 Request processed in 26us (104us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826798.809795:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00010000:00080000:1.0:1787826798.809826:0:14482:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294967300 00010000:00080000:1.0:1787826798.809830:0:14482:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:1.0:1787826798.809841:0:14482:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787826798.809843:0:14482:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787826798.809946:0:14482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00100000:3.0:1787826798.811524:0:14466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:3.0:1787826798.811531:0:14466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787826798.811535:0:14466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787826798.811715:0:14482:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1787826798.811726:0:14482:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d547f700780 x1874672143649536/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1787826809 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826798.811801:0:14482:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d534243c780 x1874672143649664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1787826809 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826798.811841:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16f840 x1874672143649536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826814 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826798.811853:0:14482:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d5343475a40 x1874672134148480/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:399/0 lens 224/0 e 0 to 0 dl 1787826809 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826798.811858:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787826798.811873:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d546e16f840 x1874672143649536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826814 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826798.811881:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d546e16f840 x1874672143649536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826814 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826798.811887:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787826798.811900:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787826798.811908:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00010000:02000000:1.0:1787826798.811931:0:14482:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:2.0:1787826798.811972:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143649920:0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787826798.812004:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.812039:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442c86300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826798.812050:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143649792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826798.812070:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.812102:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649920 00000100:00100000:2.0:1787826798.812107:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649920 00000100:00100000:2.0:1787826798.812139:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826798.812148:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143649920:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787826798.812340:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143649792 00000100:00100000:2.0:1787826798.812345:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143649792 00000100:00100000:2.0:1787826798.812372:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787826798.812378:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143649792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826798.812392:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134217728 pending 0 free 3923533824 avail 3692011520 00000100:00100000:2.0:1787826798.812427:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143649792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.812433:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787826798.812463:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16e1c0 x1874672143649792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826798.812479:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143649792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826798.812546:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.812590:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143641216 00000100:00100000:2.0:1787826798.812593:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143641216 00000100:00100000:2.0:1787826798.812613:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787826798.812619:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143641216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826798.812630:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134217728 pending 0 free 3923533824 avail 3692011520 00000100:00100000:2.0:1787826798.812658:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143641216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.812687:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787826798.812865:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b2580 x1874672143641216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826814 ref 1 fl Rpc:RQU/202/0 rc -107/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826798.812877:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143641216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826798.814768:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143649536:0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787826798.814802:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16da40 x1874672143649664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826814 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826798.814829:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787826798.814835:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d546e16da40 x1874672143649664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826814 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826798.814843:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d546e16da40 x1874672143649664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826814 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826798.814848:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787826798.814862:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787826798.814865:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1787826798.814870:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009f8725f1): req@ffff8d547f7012c0 x1874672143639424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787826803 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826798.814885:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143649664:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1787826798.814939:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143650176:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787826798.814945:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.814971:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.814991:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442c86b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826798.814991:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143650048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826798.815007:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143639424 00000100:00100000:2.0:1787826798.815011:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143639424 00000100:00100000:3.0:1787826798.815023:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826798.815034:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650048 00000100:00100000:2.0:1787826798.815037:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650048 00000100:00100000:2.0:1787826798.815051:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787826798.815057:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143639424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826798.815069:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134217728 pending 0 free 3923533824 avail 3692011520 00000100:00100000:3.0:1787826798.815078:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650176 00000100:00100000:3.0:1787826798.815083:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650176 00000100:00100000:2.0:1787826798.815104:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3618:x1874672143639424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.815112:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787826798.815121:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787826798.815131:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9485:x1874672143650176:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787826798.815137:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787826798.815147:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143650048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826798.815157:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134217728 pending 0 free 3923533824 avail 3692011520 00000100:00100000:2.0:1787826798.815184:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143650048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.815191:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1787826798.815246:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16c000 x1874672143650048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826798.815275:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143650048:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787826798.815293:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7012c0 x1874672143639424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826814 ref 1 fl Rpc:RQU/202/0 rc -107/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826798.815300:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143639424:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1787826798.817199:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787826798.817205:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:2.0:1787826798.817280:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143649920:12345-0@lo:7:osp-pre-0-0.0 Request processed in 5132us (5274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.817290:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787826798.817344:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16d680 x1874672143649920/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826798.817357:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143649920:0@lo:7:osp-pre-0-0.0 00000004:00080000:2.0:1787826798.817368:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x21:0x0] 00002000:00080000:2.0:1787826798.817564:0:8399:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787826798.817568:0:8399:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787826798.817607:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143650176:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2479us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826798.817615:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787826798.817639:0:9485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16fc00 x1874672143650176/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826798.817652:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143650176:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787826798.817661:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00002000:00080000:1.0:1787826798.820195:0:14482:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787826798.820201:0:14482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000001:02000400:0.0:1787826799.572277:0:14822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787826799.825326:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826799.896524:0:14875:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826799.896712:0:14875:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1787826800.196862:0:14925:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826800.197021:0:14925:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787826800.849352:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826801.509981:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826801.510041:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148608 00000100:00100000:0.0:1787826801.510050:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148608 00000100:00080000:1.0:1787826801.510113:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826801.510119:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:0.0:1787826801.510131:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:11757:x1874672134148608:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787826801.510164:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826801.510256:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:11757:x1874672134148608:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 127us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826801.510283:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:2.0:1787826801.511148:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826801.511191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148736 00000100:00100000:0.0:1787826801.511196:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148736 00000100:00080000:1.0:1787826801.511237:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826801.511256:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:0.0:1787826801.511264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:11757:x1874672134148736:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787826801.511285:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826801.511333:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:11757:x1874672134148736:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826801.511340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:1.0:1787826801.512468:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826801.512535:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148864 00000100:00100000:2.0:1787826801.512539:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148864 00000100:00100000:2.0:1787826801.512573:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:2.0:1787826801.512579:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:11757:x1874672134148864:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826801.512598:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134497728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787826801.512662:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:11757:x1874672134148864:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826801.512670:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00080000:1.0:1787826801.512732:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826801.513511:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826801.513575:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134148992 00000100:00100000:3.0:1787826801.513588:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134148992 00000100:00080000:1.0:1787826801.513642:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826801.513676:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:3.0:1787826801.513689:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:11757:x1874672134148992:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826801.513733:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826801.513803:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:11757:x1874672134148992:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826801.513812:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 62 00010000:00010000:2.0:1787826801.874351:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826802.064900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826802.064952:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134149120 00000100:00100000:2.0:1787826802.064963:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134149120 00000100:00100000:2.0:1787826802.065023:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 323 00000100:00100000:2.0:1787826802.065038:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134149120:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826802.065126:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134149120:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826802.065136:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 323 00000100:00100000:1.0:1787826802.769375:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143650432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826802.769434:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143650688:0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.769447:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826802.769456:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143650560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826802.769517:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826802.769519:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826802.769526:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143650816:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.769590:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143651072:0@lo:400:kworker.0 00000100:00100000:3.0:1787826802.769601:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143650304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826802.769622:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143651200:0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.769625:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826802.769677:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826802.769681:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143651328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826802.769686:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826802.769706:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143650944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.769710:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650560 00000100:00100000:2.0:1787826802.769719:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650560 00000100:00100000:0.0:1787826802.769732:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143651712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.769734:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826802.769743:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826802.769781:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650304 00000100:00100000:2.0:1787826802.769784:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650304 00000100:00100000:0.0:1787826802.769794:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826802.769812:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143651840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826802.769812:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143651456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.769819:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787826802.769828:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143652224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.769837:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143650560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826802.769862:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826802.769879:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826802.769884:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826802.769891:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650432 00000100:00100000:1.0:1787826802.769898:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650432 00000100:00100000:3.0:1787826802.769928:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143651968:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.769933:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143650560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826802.769944:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651200 00010000:00080000:0.0:1787826802.769946:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16e940 x1874672143650560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826802.769947:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787826802.769955:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651200 00000100:00100000:0.0:1787826802.769984:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143650560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826802.769984:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787826802.769984:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826802.769994:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650944 00000100:00100000:1.0:1787826802.770002:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650944 00000100:00100000:2.0:1787826802.770008:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143650304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826802.770033:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826802.770038:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650816 00000100:00100000:1.0:1787826802.770041:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787826802.770043:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650816 00000100:00100000:3.0:1787826802.770054:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651328 00000100:00100000:1.0:1787826802.770055:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143650432:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826802.770062:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651328 00000100:00100000:2.0:1787826802.770084:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143650304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826802.770085:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651712 00000004:00000024:1.0:1787826802.770091:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826802.770097:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787826802.770100:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651712 00000100:00100000:3.0:1787826802.770105:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651456 00000100:00100000:3.0:1787826802.770115:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651456 00000100:00100000:2.0:1787826802.770136:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143650688 00000100:00100000:2.0:1787826802.770140:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143650688 00000100:00100000:0.0:1787826802.770142:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143652224 00000100:00100000:0.0:1787826802.770146:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143652224 00000100:00100000:3.0:1787826802.770152:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651968 00000100:00100000:3.0:1787826802.770158:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651968 00000100:00100000:1.0:1787826802.770170:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143650432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826802.770182:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826802.770203:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826802.770204:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787826802.770209:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787826802.770246:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787826802.770247:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143650816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826802.770248:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143651328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.770261:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143650688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.770264:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143651200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826802.770299:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143650816:12345-0@lo:400:kworker.0 Request processed in 59us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826802.770307:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787826802.770331:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143651328:12345-0@lo:400:kworker.0 Request processed in 82us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826802.770343:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143650688:12345-0@lo:400:kworker.0 Request processed in 88us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826802.770344:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787826802.770344:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787826802.770362:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143651200:12345-0@lo:400:kworker.0 Request processed in 97us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826802.770365:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143651712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.770373:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787826802.770385:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787826802.770395:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787826802.770402:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143651456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826802.770434:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143651712:12345-0@lo:400:kworker.0 Request processed in 68us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826802.770434:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787826802.770435:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826802.770450:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787826802.770450:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143651456:12345-0@lo:400:kworker.0 Request processed in 51us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826802.770473:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143651968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826802.770474:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787826802.770474:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143650944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826802.770474:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826802.770495:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143652224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.770540:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143651968:12345-0@lo:400:kworker.0 Request processed in 88us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826802.770556:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787826802.770556:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826802.770560:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143652224:12345-0@lo:400:kworker.0 Request processed in 61us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826802.770567:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143650944:12345-0@lo:400:kworker.0 Request processed in 108us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826802.770585:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787826802.770587:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787826802.770588:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651840 00000100:00100000:2.0:1787826802.770597:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651840 00000100:00080000:1.0:1787826802.770625:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826802.770630:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143650432:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787826802.770632:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826802.770649:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826802.770667:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787826802.770674:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243da40 x1874672143651712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826802.770682:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143650816:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.770684:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e155a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143651840:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826802.770702:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243f480 x1874672143651328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826802.770705:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826802.770709:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143651712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826802.770717:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143651328:0@lo:400:kworker.0 00010000:00080000:0.0:1787826802.770731:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e1552c0 x1874672143652224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826802.770742:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143652224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.770753:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143651584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.770760:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e155a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143651840:12345-0@lo:400:kworker.0 Request processed in 82us (210us total) trans 0 rc 0/0 00010000:00080000:3.0:1787826802.770765:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243c000 x1874672143651840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826802.770768:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143651200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.770781:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787826802.770794:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826802.770808:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143651840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.770825:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143652096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826802.770842:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651072 00000100:00100000:3.0:1787826802.770847:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651072 00000100:00100000:1.0:1787826802.770853:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787826802.770877:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243de00 x1874672143650304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826802.770883:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143651584 00000100:00100000:3.0:1787826802.770889:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143651584 00000100:00100000:2.0:1787826802.770895:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143652096 00000100:00100000:2.0:1787826802.770900:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143652096 00000100:00100000:1.0:1787826802.770901:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143650688:0@lo:400:kworker.0 00000100:00100000:0.0:1787826802.770902:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143650304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826802.770938:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143650944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.770951:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1787826802.770959:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243cb40 x1874672143651456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826802.770971:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143651072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826802.770971:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787826802.770977:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143651456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.770983:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787826802.770991:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143651584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826802.771001:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143652096:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787826802.771005:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356d00 x1874672143651968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826802.771011:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143651968:0@lo:400:kworker.0 00000100:00080000:0.0:1787826802.771044:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826802.771079:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143652096:12345-0@lo:400:kworker.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826802.771081:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143651072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.771088:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143651072:12345-0@lo:400:kworker.0 Request processed in 124us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826802.771091:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143651584:12345-0@lo:400:kworker.0 Request processed in 104us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826802.771112:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787826802.771117:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143651584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826802.771122:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787826802.771134:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787826802.771151:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143652096:0@lo:400:kworker.0 00010000:00010000:1.0:1787826802.897384:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826803.364170:0:15117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:1.0:1787826803.793348:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143652352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826803.793413:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826803.793455:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143652352 00000100:00100000:2.0:1787826803.793462:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143652352 00000100:00100000:2.0:1787826803.793517:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826803.793531:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143652352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826803.793574:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826803.793645:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143652352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826803.793653:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787826803.793682:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143652352:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787826803.895013:0:15165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1787826803.921324:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826804.305431:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826804.305462:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143652480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826804.305563:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826804.305604:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143652480 00000100:00100000:3.0:1787826804.305612:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143652480 00000100:00100000:0.0:1787826804.305647:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143652608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826804.305673:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826804.305699:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143652608 00000100:00080000:1.0:1787826804.305701:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826804.305722:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143652608 00000100:00100000:2.0:1787826804.305727:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826804.305739:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143652480:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787826804.305765:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787826804.305774:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134497728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787826804.305823:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143652480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826804.305829:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826804.305853:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1787826804.305859:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16fc00 x1874672143652480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826804.305864:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143652608:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826804.305881:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143652480:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826804.305881:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134497728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787826804.305927:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143652608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826804.305934:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1787826804.305942:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e15c3c0 x1874672143652608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826804.305951:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143652608:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787826804.945361:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826805.223486:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826805.223551:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134149248 00000100:00100000:0.0:1787826805.223561:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134149248 00000100:00080000:1.0:1787826805.223631:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826805.223660:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:0.0:1787826805.223671:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:12225:x1874672134149248:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787826805.223707:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826805.223783:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:12225:x1874672134149248:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826805.223792:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:0.0:1787826805.224772:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826805.224828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134149376 00000100:00100000:1.0:1787826805.224834:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134149376 00000100:00100000:1.0:1787826805.224875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00080000:0.0:1787826805.224880:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826805.224882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:12225:x1874672134149376:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787826805.224902:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826805.224936:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:12225:x1874672134149376:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826805.224951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:2.0:1787826805.226181:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826805.226261:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134149504 00000100:00100000:3.0:1787826805.226267:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134149504 00000100:00100000:3.0:1787826805.226316:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00080000:0.0:1787826805.226320:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826805.226328:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:12225:x1874672134149504:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826805.226347:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134497728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787826805.226404:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:12225:x1874672134149504:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826805.226412:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:0.0:1787826805.227102:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.227140:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134149632 00000100:00100000:2.0:1787826805.227145:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134149632 00000100:00100000:2.0:1787826805.227190:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00080000:0.0:1787826805.227197:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826805.227198:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54765b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:12225:x1874672134149632:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826805.227240:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826805.227283:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54765b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:12225:x1874672134149632:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826805.227290:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:0.0:1787826805.239306:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826805.239370:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134149760 00000100:00100000:3.0:1787826805.239380:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134149760 00000100:00100000:3.0:1787826805.239434:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:3.0:1787826805.239443:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:12241:x1874672134149760:12345-192.168.203.6@tcp:101:cp.0 00010000:00010000:3.0:1787826805.239462:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826805.239524:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a795380f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239580:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239594:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239606:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239618:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239654:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239662:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239735:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953824 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239744:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239750:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826805.239784:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826805.239788:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826805.239822:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239833:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239841:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239847:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239852:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826805.239856:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239870:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239881:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:3.0:1787826805.239884:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826805.239888:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239895:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239908:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239914:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239920:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239925:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826805.239928:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239933:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239941:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54605a1e00) 00010000:00010000:3.0:1787826805.239943:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826805.239946:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239961:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a795381d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.239991:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a795380f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d9 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.240005:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d9 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.240013:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:3.0:1787826805.240015:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826805.240017:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148ec00, rc 0) 00000100:00100000:3.0:1787826805.240070:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134149760:12345-192.168.203.6@tcp:101:cp.0 Request processed in 628us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826805.240083:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:0.0:1787826805.241634:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.241692:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134149888 00000100:00100000:2.0:1787826805.241699:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134149888 00000100:00100000:2.0:1787826805.241739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:2.0:1787826805.241749:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134149888:12345-192.168.203.6@tcp:900:cp.0 00000100:00100000:2.0:1787826805.241802:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134149888:12345-192.168.203.6@tcp:900:cp.0 Request processed in 55us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826805.241809:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:0.0:1787826805.242637:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.242689:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134150016 00000100:00100000:2.0:1787826805.242694:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134150016 00000100:00100000:2.0:1787826805.242727:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:2.0:1787826805.242735:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134150016:12345-192.168.203.6@tcp:101:cp.0 00010000:00010000:2.0:1787826805.242749:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826805.242764:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e600/0xc0fefc09a795382b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673e0 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242810:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242821:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242831:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242881:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242889:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242895:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242930:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242936:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242942:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242948:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350fe00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826805.242951:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242957:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242967:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:2.0:1787826805.242970:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826805.242974:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242980:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350fe00/0xc0fefc09a7953832 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.242997:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243003:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243008:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243013:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350e800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826805.243015:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243021:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243028:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc2861ed (ffff8d53428e3700) 00010000:00010000:2.0:1787826805.243030:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826805.243032:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243038:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e800/0xc0fefc09a7953839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243064:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e600/0xc0fefc09a795382b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673e0 expref: 8 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243072:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:2.0:1787826805.243074:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826805.243083:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e600/0xc0fefc09a795382b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673e0 expref: 8 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.243091:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d534350e600, rc 0) 00000100:00100000:2.0:1787826805.243123:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134150016:12345-192.168.203.6@tcp:101:cp.0 Request processed in 389us (487us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826805.243129:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:0.0:1787826805.244360:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826805.244974:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134150144 00000100:00100000:1.0:1787826805.244981:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134150144 00000100:00100000:1.0:1787826805.245023:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:1.0:1787826805.245032:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134150144:12345-192.168.203.6@tcp:700:cp.0 00000100:00100000:1.0:1787826805.245116:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134150144:12345-192.168.203.6@tcp:700:cp.0 Request processed in 85us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826805.245123:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:0.0:1787826805.247031:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826805.247081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134150400 00000100:00100000:1.0:1787826805.247087:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134150400 00000100:00100000:1.0:1787826805.247118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:1.0:1787826805.247123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134150400:12345-192.168.203.6@tcp:101:cp.0 00010000:00010000:1.0:1787826805.247135:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826805.247137:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826805.247155:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953824 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d9 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247169:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:1.0:1787826805.247173:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826805.247182:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7200/0xc0fefc09a7953840 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247285:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247299:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247321:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247326:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247363:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247377:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 7 pid: 6486 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826805.247390:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6514:1874672143652736:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826805.247465:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.247476:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 7 pid: 6487 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826805.247486:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6514:1874672143652864:192.168.203.6@tcp:104: 00000100:00100000:1.0:1787826805.247507:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442c86300 going to sleep for 11 seconds 00010000:00020000:1.0:1787826805.248264:0:6514:0:(ldlm_lockd.c:727:ldlm_handle_ast_error()) ### client (nid 192.168.203.6@tcp) returned error from blocking AST (req@000000007d9a59c0 x1874672143652864 status -107 rc -107), evict it ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 7 pid: 6487 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02020000:1.0:1787826805.263449:0:6514:0:(ldlm_lockd.c:665:ldlm_failed_ast()) lustre-MDT0000: A client on nid 192.168.203.6@tcp was evicted due to a lock blocking callback time out: rc -107 00000100:00100000:1.0:1787826805.268497:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6514:1874672143652864:192.168.203.6@tcp:104: 00010000:00020000:3.0:1787826805.268530:0:6475:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 0s: evicting client at 192.168.203.6@tcp ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:1.0:1787826805.268546:0:6514:0:(ldlm_lockd.c:727:ldlm_handle_ast_error()) ### client (nid 192.168.203.6@tcp) returned error from blocking AST (req@00000000e4dfb271 x1874672143652736 status -107 rc -107), evict it ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 8 pid: 6486 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02020000:1.0:1787826805.268565:0:6514:0:(ldlm_lockd.c:665:ldlm_failed_ast()) lustre-MDT0000: A client on nid 192.168.203.6@tcp was evicted due to a lock blocking callback time out: rc -107 00000100:00100000:1.0:1787826805.268571:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6514:1874672143652736:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826805.268594:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787826805.283645:0:6475:0:(genops.c:1634:class_fail_export()) disconnecting export ffff8d5343506800/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:3.0:1787826805.283661:0:6475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79534ab 00000020:00010000:3.0:1787826805.283674:0:6475:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d5343506800: total 0 00000100:00080000:3.0:1787826805.283679:0:6475:0:(import.c:65:import_set_state_nolock()) ffff8d5478965000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787826805.283707:0:6475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967306 00000020:00010000:2.0:1787826805.283750:0:6474:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d5343506800: total 0 00000020:00080000:3.0:1787826805.283812:0:6475:0:(genops.c:1651:class_fail_export()) disconnected export ffff8d5343506800/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00010000:00010000:2.0:1787826805.283813:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.283840:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:2.0:1787826805.283844:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826805.283848:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.283860:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7400/0xc0fefc09a795370c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467346 expref: 5 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.283896:0:6474:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d5343506800, canceled 1 locks, left on hash table 2. 00000020:00010000:2.0:1787826805.283899:0:6474:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d5343506800: total 0 00000020:00010000:2.0:1787826805.283902:0:6474:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d5343506800: total 0 00010000:00010000:2.0:1787826805.283918:0:6474:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d5343506800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787826805.283934:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 4 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.283945:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:2.0:1787826805.283947:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826805.283950:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.283979:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.283987:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.284026:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e200/0xc0fefc09a79536e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346733f expref: 4 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.284045:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:2.0:1787826805.284048:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826805.284053:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5471c80000/0xc0fefc09a795368e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346732a expref: 3 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284061:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.284065:0:6474:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d5343506800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787826805.284076:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.284093:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826805.284096:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826805.284098:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.284099:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826805.284111:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284120:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826805.284618:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787826805.284755:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6000/0xc0fefc09a7953855 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284769:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6000/0xc0fefc09a7953855 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284783:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6000/0xc0fefc09a7953855 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284814:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284822:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284828:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284832:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826805.284835:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284840:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284845:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54531bc200) 00010000:00010000:1.0:1787826805.284847:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826805.284850:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284854:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a7953847 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826805.284861:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078a045e0 reply state 00000000629da385 transno 4294967307 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284867:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284876:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc2861ed (ffff8d54756ae900) 00010000:00010000:1.0:1787826805.284877:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826805.284879:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826805.284904:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7200/0xc0fefc09a7953840 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673e7 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284917:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6000/0xc0fefc09a7953855 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673e7 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.284922:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8d54756ae400) 00010000:00010000:1.0:1787826805.284923:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826805.284924:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6000, rc 0) 00000100:00100000:1.0:1787826805.284998:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:12241:x1874672134150400:12345-192.168.203.6@tcp:101:cp.0 Request processed in 37872us (37970us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787826805.285007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:2.0:1787826805.287160:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826805.287206:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134150528 00000100:00100000:3.0:1787826805.287246:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134150528 00000100:00100000:3.0:1787826805.287297:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:3.0:1787826805.287318:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134150528:12345-192.168.203.6@tcp:101:cp.0 00010000:00010000:3.0:1787826805.287333:0:9498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826805.287353:0:9498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673ee expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826805.287712:0:9498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826805.287731:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=180s v=(0 0) 00010000:00010000:3.0:1787826805.287736:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826805.287754:0:9498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 6 pid: 9498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.287774:0:9498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 6 pid: 9498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.287786:0:9498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148f000, rc 0) 00000100:00100000:3.0:1787826805.287837:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134150528:12345-192.168.203.6@tcp:101:cp.0 Request processed in 521us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826805.287845:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:0.0:1787826805.289286:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.289924:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134150656 00000100:00100000:2.0:1787826805.289931:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134150656 00000100:00100000:2.0:1787826805.289970:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:2.0:1787826805.289978:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:12241:x1874672134150656:12345-192.168.203.6@tcp:101:cp.0 00010000:00010000:2.0:1787826805.289992:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826805.290006:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a795386a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673f5 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.290035:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 7 pid: 9498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.290050:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826805.290054:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826805.290059:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a795386a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.290095:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 7 pid: 9498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.290109:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 7 pid: 9498 timeout: 280 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826805.290122:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8402:1874672143652992:192.168.203.6@tcp:104: 00000100:00100000:2.0:1787826805.290177:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826805.291384:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8402:1874672143652992:192.168.203.6@tcp:104: 00010000:00010000:2.0:1787826805.291435:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a795386a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.291458:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3c00, rc 0) 00000100:00100000:0.0:1787826805.291504:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.291525:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:12241:x1874672134150656:12345-192.168.203.6@tcp:101:cp.0 Request processed in 1545us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826805.291537:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:3.0:1787826805.291585:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134150784 00000100:00100000:3.0:1787826805.291594:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134150784 00010000:00010000:3.0:1787826805.291641:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 7 pid: 9498 timeout: 280 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826805.291678:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:3.0:1787826805.291688:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134150784:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826805.291699:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826805.291793:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 7 pid: 9498 timeout: 280 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.291807:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 7 pid: 9498 timeout: 280 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.291827:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a7953863 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673ee expref: 7 pid: 9498 timeout: 280 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.291842:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826805.291846:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826805.291853:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a795386a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.291862:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a795386a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.291892:0:6472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a795386a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826805.291904:0:6472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6472:1874672143653120:192.168.203.6@tcp:105: 00000100:00100000:3.0:1787826805.291963:0:6472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3faf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826805.292965:0:6472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6472:1874672143653120:192.168.203.6@tcp:105: 00010000:00010000:3.0:1787826805.292986:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826805.293032:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134150784:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 1344us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826805.293059:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:0.0:1787826805.293400:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826805.293447:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134151040 00000100:00100000:1.0:1787826805.293454:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134151040 00000100:00100000:1.0:1787826805.293496:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:1.0:1787826805.293503:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+9:12241:x1874672134151040:12345-192.168.203.6@tcp:35:cp.0 00000100:00100000:1.0:1787826805.293742:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:12241:x1874672134151040:12345-192.168.203.6@tcp:35:cp.0 Request processed in 239us (342us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787826805.293750:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:1.0:1787826805.300954:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.301098:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134151168 00000100:00100000:2.0:1787826805.301111:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134151168 00002000:00100000:2.0:1787826805.301175:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->2122) req@ffff8d547f7f12c0 x1874672134151168/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:406/0 lens 2616/0 e 0 to 0 dl 1787826816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826805.301245:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f12c0 with x1874672134151168 ext(0->2122) 00002000:00010000:2.0:1787826805.301259:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f12c0 00000100:00100000:2.0:1787826805.301309:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:2.0:1787826805.301321:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134151168:12345-192.168.203.6@tcp:4:cp.0 00000100:00100000:2.0:1787826805.302209:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134151168:12345-192.168.203.6@tcp:4:cp.0 Request processed in 888us (1267us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787826805.302254:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 0 00002000:00100000:2.0:1787826805.302261:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->2122) req@ffff8d547f7f12c0 x1874672134151168/t8589934593(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:406/0 lens 2616/448 e 0 to 0 dl 1787826816 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826805.302269:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f12c0 with x1874672134151168 ext(0->2122) 00002000:00010000:2.0:1787826805.302272:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f12c0 00000100:00100000:0.0:1787826805.311559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826805.311919:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134151296 00000100:00100000:3.0:1787826805.311935:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134151296 00000100:00100000:3.0:1787826805.312003:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 45 00000100:00100000:3.0:1787826805.312014:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:12253:x1874672134151296:12345-192.168.203.6@tcp:101:diff.0 00010000:00010000:3.0:1787826805.312044:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826805.312079:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148f000/0xc0fefc09a7953871 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673fc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312151:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312168:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312180:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312195:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312203:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312210:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312335:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312363:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312370:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826805.312410:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826805.312414:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826805.312457:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312471:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312483:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312491:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312498:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148ea00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826805.312503:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312511:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312524:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:3.0:1787826805.312528:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826805.312532:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312549:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ea00/0xc0fefc09a7953878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312564:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312570:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312577:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312582:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148fa00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826805.312585:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312591:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312598:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff8d54605a1c00) 00010000:00010000:3.0:1787826805.312600:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826805.312603:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312609:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148fa00/0xc0fefc09a795387f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312653:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148f000/0xc0fefc09a7953871 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673fc expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312668:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d544148ec00/0xc0fefc09a7953886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673fc expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826805.312682:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826805.312685:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787826805.312688:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148ec00, rc 0) 00000100:00100000:3.0:1787826805.312757:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+11:12253:x1874672134151296:12345-192.168.203.6@tcp:101:diff.0 Request processed in 744us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826805.312765:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 45 00000100:00100000:0.0:1787826805.314604:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.314679:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134151552 00000100:00100000:2.0:1787826805.314689:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134151552 00000100:00100000:2.0:1787826805.314735:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:2.0:1787826805.314742:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+11:12253:x1874672134151552:12345-192.168.203.6@tcp:101:diff.0 00010000:00010000:2.0:1787826805.314758:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826805.314774:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a795388d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467403 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.314880:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953894 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.314891:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953894 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.314911:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953894 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826805.314920:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 2123 00010000:00010000:2.0:1787826805.315055:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a795388d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467403 expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.315071:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953894 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467403 expref: 13 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.315080:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8d54756ae400) 00010000:00010000:2.0:1787826805.315083:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826805.315086:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3000, rc 0) 00000100:00100000:2.0:1787826805.315132:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+13:12253:x1874672134151552:12345-192.168.203.6@tcp:101:diff.0 Request processed in 390us (531us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787826805.315140:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:1.0:1787826805.320936:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826805.321029:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134151808 00000100:00100000:2.0:1787826805.321042:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134151808 00000100:00100000:2.0:1787826805.321176:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:2.0:1787826805.321185:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+13:12254:x1874672134151808:12345-192.168.203.6@tcp:35:rm.0 00000100:00100000:2.0:1787826805.321538:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+14:12254:x1874672134151808:12345-192.168.203.6@tcp:35:rm.0 Request processed in 353us (611us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787826805.321546:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:0.0:1787826805.322692:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826805.322746:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134152064 00000100:00100000:1.0:1787826805.322755:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134152064 00000100:00100000:1.0:1787826805.322829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00100000:1.0:1787826805.322839:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:12254:x1874672134152064:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:1.0:1787826805.322885:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787826805.322919:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953894 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467403 expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.322959:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6000/0xc0fefc09a7953855 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673e7 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.322972:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8d54756ae400) 00010000:00010000:1.0:1787826805.322985:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826805.323011:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323025:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323035:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323049:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323056:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323062:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323138:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323151:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323158:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826805.323486:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787826805.323497:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180186281371ns, next at 181186278912ns, rc = 0 00010000:00010000:1.0:1787826805.323535:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323544:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323552:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323560:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323567:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323574:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323602:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826805.323636:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323643:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323657:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.323670:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826805.323674:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826805.323678:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323682:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323693:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.323695:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826805.323705:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323707:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8d54756aea00) 00010000:00010000:1.0:1787826805.323714:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826805.323718:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323719:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323734:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6800/0xc0fefc09a79538b0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.323736:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8d54756aea00) 00010000:00010000:2.0:1787826805.323743:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826805.323753:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323756:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.323762:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6200/0xc0fefc09a79538b7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323769:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323778:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826805.323782:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826805.323785:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826805.323786:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826805.323790:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826805.323791:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323810:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323819:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787826805.323822:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826805.323825:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323830:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6600/0xc0fefc09a79538a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826805.323840:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cad175f3 reply state 000000007f87cdcc transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323852:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826805.323859:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc2861ed (ffff8d54756ae900) 00010000:00010000:1.0:1787826805.323862:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826805.323864:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826805.323935:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:12254:x1874672134152064:12345-192.168.203.6@tcp:36:rm.0 Request processed in 1093us (1244us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787826805.323943:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 47 00010000:00010000:1.0:1787826805.969402:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826806.993906:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826807.186031:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826807.186063:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826807.186088:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134152192 00000100:00100000:0.0:1787826807.186094:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826807.186099:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134152192 00000100:00100000:3.0:1787826807.186115:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134152448 00000100:00100000:3.0:1787826807.186121:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134152448 00000100:00100000:0.0:1787826807.186134:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826807.186157:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 325 00000100:00100000:0.0:1787826807.186165:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826807.186169:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134152320 00000100:00100000:2.0:1787826807.186171:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134152192:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826807.186173:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134152320 00000100:00100000:0.0:1787826807.186193:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:1.0:1787826807.186200:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134152704 00000100:00100000:0.0:1787826807.186204:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134152448:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826807.186207:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134152704 00000100:00100000:3.0:1787826807.186237:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:3.0:1787826807.186245:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134152320:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826807.186266:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134152448:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.186274:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:3.0:1787826807.186274:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134152320:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 31us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826807.186280:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00080000:3.0:1787826807.186298:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826807.186299:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134152576 00000100:00080000:3.0:1787826807.186303:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826807.186305:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134152576 00000100:00080000:3.0:1787826807.186307:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826807.186329:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134152192:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826807.186340:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 325 00000100:00100000:1.0:1787826807.186345:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 49 00000100:00100000:1.0:1787826807.186357:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134152704:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826807.186360:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 50 00000100:00100000:3.0:1787826807.186370:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134152576:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:2.0:1787826807.186393:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826807.186405:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134152576:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826807.186417:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134152704:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 60us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826807.186417:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 50 00000100:00100000:1.0:1787826807.186428:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 49 00000001:02000400:0.0:1787826807.686275:0:15361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 1: touch ======================= 06:33:27 (1787826807) 00000100:00100000:0.0:1787826807.706416:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826807.706457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134152960 00000100:00100000:2.0:1787826807.706466:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134152960 00000100:00100000:2.0:1787826807.706565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:2.0:1787826807.706584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:12820:x1874672134152960:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826807.706612:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826807.706631:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a79538be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346740a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.706737:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.706751:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.706763:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.706819:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.706827:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.706834:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826807.707093:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787826807.707345:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79538d3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707356:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79538d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707366:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79538d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707413:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707420:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707427:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707434:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826807.707438:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707446:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707461:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826807.707465:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826807.707470:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707477:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79538c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826807.707498:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c6f4f17 reply state 00000000939b75ac transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707508:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707515:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3509f068 (ffff8d53428e3500) 00010000:00010000:2.0:1787826807.707524:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826807.707528:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826807.707560:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a79538be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346740a expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707583:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79538d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346740a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826807.707591:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8d53428e3600) 00010000:00010000:2.0:1787826807.707593:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826807.707596:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2c00, rc 0) 00000100:00100000:2.0:1787826807.707672:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+17:12820:x1874672134152960:12345-192.168.203.6@tcp:101:bash.0 Request processed in 1091us (1261us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787826807.707680:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:2.0:1787826807.712732:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826807.712785:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153088 00000100:00100000:3.0:1787826807.712793:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153088 00000100:00100000:3.0:1787826807.712848:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:3.0:1787826807.712856:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134153088:12345-192.168.203.6@tcp:101:date.0 00010000:00010000:3.0:1787826807.712871:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826807.712888:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467411 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826807.713321:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826807.713343:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=182s v=(0 0) 00010000:00010000:3.0:1787826807.713348:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826807.713358:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826807.713389:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826807.713402:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148fa00, rc 0) 00000100:00100000:3.0:1787826807.713468:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134153088:12345-192.168.203.6@tcp:101:date.0 Request processed in 612us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826807.713476:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:2.0:1787826807.714961:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826807.715004:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153216 00000100:00100000:3.0:1787826807.715010:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153216 00000100:00100000:3.0:1787826807.715049:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:3.0:1787826807.715057:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:12820:x1874672134153216:12345-192.168.203.6@tcp:101:date.0 00010000:00010000:3.0:1787826807.715068:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826807.715079:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a79538e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467418 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826807.715106:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 10 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826807.715113:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826807.715116:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826807.715119:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a79538e8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826807.715140:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 10 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826807.715151:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 10 pid: 8402 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826807.715166:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143653248:192.168.203.6@tcp:104: 00000100:00100000:3.0:1787826807.715265:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826807.716930:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143653248:192.168.203.6@tcp:104: 00010000:00010000:0.0:1787826807.716960:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a79538e8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826807.716980:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148f000, rc 0) 00000100:00100000:0.0:1787826807.717023:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:12820:x1874672134153216:12345-192.168.203.6@tcp:101:date.0 Request processed in 1965us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.717033:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:2.0:1787826807.718204:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826807.718292:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153344 00000100:00100000:0.0:1787826807.718299:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153344 00010000:00010000:0.0:1787826807.718331:0:13703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 10 pid: 8402 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826807.718410:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:0.0:1787826807.718419:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134153344:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826807.718431:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826807.718446:0:13703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 10 pid: 8402 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826807.718456:0:13703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 10 pid: 8402 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826807.718474:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f05267/0xc0fefc09a79538e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467411 expref: 10 pid: 8402 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826807.718485:0:13703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826807.718488:0:13703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826807.718495:0:13703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a79538e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 9 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826807.718507:0:13703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a79538e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 9 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826807.718542:0:13703:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a79538e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 9 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826807.718557:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13703:1874672143653376:192.168.203.6@tcp:105: 00000100:00100000:0.0:1787826807.718652:0:13703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826807.720837:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13703:1874672143653376:192.168.203.6@tcp:105: 00010000:00010000:0.0:1787826807.720860:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826807.720905:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2390:x1874672134153344:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 2487us (2702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.720913:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:2.0:1787826807.720966:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826807.721001:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153600 00000100:00100000:0.0:1787826807.721007:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153600 00000100:00100000:0.0:1787826807.721054:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:0.0:1787826807.721063:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:12820:x1874672134153600:12345-192.168.203.6@tcp:35:date.0 00000100:00100000:0.0:1787826807.721368:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:12820:x1874672134153600:12345-192.168.203.6@tcp:35:date.0 Request processed in 305us (402us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787826807.721376:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:1.0:1787826807.889463:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143653760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826807.889463:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143653632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826807.889476:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143653888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.889570:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826807.889571:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826807.889575:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826807.889629:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143653760 00000100:00100000:0.0:1787826807.889638:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143653760 00000100:00100000:2.0:1787826807.889646:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143653504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826807.889653:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143654400:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.889661:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143654144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.889687:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826807.889698:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826807.889703:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787826807.889718:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143653760:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826807.889719:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654400 00000100:00100000:2.0:1787826807.889720:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143654272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.889727:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654400 00000100:00100000:3.0:1787826807.889740:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143654912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.889758:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787826807.889766:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1787826807.889768:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787826807.889770:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143654400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826807.889785:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143653632 00000100:00100000:3.0:1787826807.889791:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143653632 00000100:00100000:2.0:1787826807.889801:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143654784:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.889836:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143654400:12345-0@lo:400:kworker.0 Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826807.889847:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826807.889848:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143653760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826807.889854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826807.889855:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143653504 00000100:00100000:3.0:1787826807.889861:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143653504 00000100:00100000:0.0:1787826807.889863:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787826807.889889:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787826807.889895:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143655296:0@lo:400:kworker.0 00000100:00080000:1.0:1787826807.889898:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826807.889901:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143653632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826807.889926:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654272 00002000:00000024:3.0:1787826807.889929:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826807.889932:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654272 00000100:00100000:2.0:1787826807.889938:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826807.889944:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143653888 00000100:00100000:1.0:1787826807.889951:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143653888 00000100:00100000:0.0:1787826807.889981:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654784 00000100:00100000:3.0:1787826807.889986:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143653632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.889988:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654784 00010000:00080000:2.0:1787826807.889995:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16fc00 x1874672143653632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826807.889996:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787826807.890002:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787826807.890013:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143653888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890029:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655296 00000100:00100000:2.0:1787826807.890030:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143653632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826807.890030:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787826807.890034:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655296 00000100:00100000:3.0:1787826807.890045:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143653504:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826807.890058:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143653888:12345-0@lo:400:kworker.0 Request processed in 51us (493us total) trans 0 rc 0/0 00002000:00000024:3.0:1787826807.890065:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826807.890069:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787826807.890074:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787826807.890083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787826807.890086:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143654272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.890098:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143654784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826807.890108:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143653504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (422us total) trans 0 rc 0/0 00000100:00080000:1.0:1787826807.890112:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826807.890118:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787826807.890139:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143654272:12345-0@lo:400:kworker.0 Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826807.890141:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826807.890149:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787826807.890152:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143654784:12345-0@lo:400:kworker.0 Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.890159:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787826807.890163:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143655296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.890170:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787826807.890171:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143654656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890203:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654144 00000100:00100000:0.0:1787826807.890208:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654144 00000100:00100000:3.0:1787826807.890244:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143655296:12345-0@lo:400:kworker.0 Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826807.890252:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787826807.890259:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787826807.890266:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826807.890266:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143654016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890273:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143654144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826807.890301:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143654272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.890313:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143655168:0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.890316:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826807.890320:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143654784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890327:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143654144:12345-0@lo:400:kworker.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.890336:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787826807.890343:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143655296:0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.890349:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143654528:0@lo:400:kworker.0 00010000:00080000:3.0:1787826807.890360:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e1543c0 x1874672143653504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826807.890365:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826807.890379:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143653504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826807.890382:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654656 00000100:00100000:0.0:1787826807.890388:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654656 00000100:00100000:2.0:1787826807.890407:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654016 00000100:00100000:2.0:1787826807.890413:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654016 00000100:00100000:0.0:1787826807.890427:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655168 00000100:00100000:1.0:1787826807.890427:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143653760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826807.890433:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655168 00000100:00100000:3.0:1787826807.890437:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787826807.890451:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787826807.890453:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143654656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.890466:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.890468:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143654144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890473:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787826807.890489:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143655168:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826807.890506:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d6580 x1874672143654656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826807.890506:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143654656:12345-0@lo:400:kworker.0 Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826807.890522:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787826807.890526:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143654016:12345-0@lo:400:kworker.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826807.890527:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143654656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890541:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143655168:12345-0@lo:400:kworker.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826807.890543:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1787826807.890549:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81c000 x1874672143655168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826807.890556:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787826807.890567:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826807.890572:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143655168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826807.890594:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143655424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826807.890625:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654912 00000100:00100000:2.0:1787826807.890630:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654912 00000100:00100000:0.0:1787826807.890644:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143655040:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.890645:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143654528 00000100:00100000:3.0:1787826807.890645:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826807.890652:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143654528 00000100:00100000:2.0:1787826807.890671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655424 00000100:00100000:2.0:1787826807.890676:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655424 00000100:00100000:3.0:1787826807.890682:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143653888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826807.890690:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826807.890701:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655040 00000100:00100000:3.0:1787826807.890705:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143654400:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.890707:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655040 00000100:00100000:2.0:1787826807.890717:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787826807.890729:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143654912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826807.890736:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787826807.890740:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143654016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.890747:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787826807.890751:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e155680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143655424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826807.890762:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143654528:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826807.890782:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826807.890788:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826807.890793:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143654912:12345-0@lo:400:kworker.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826807.890803:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787826807.890816:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787826807.890817:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e155680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143655424:12345-0@lo:400:kworker.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826807.890823:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143654528:12345-0@lo:400:kworker.0 Request processed in 65us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.890827:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143655040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826807.890832:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787826807.890841:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787826807.890869:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d70c0 x1874672143654912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826807.890870:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143655040:12345-0@lo:400:kworker.0 Request processed in 46us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826807.890883:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787826807.890894:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143654528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826807.890895:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143654912:0@lo:400:kworker.0 00000100:00100000:3.0:1787826807.890912:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143655040:0@lo:400:kworker.0 00010000:00080000:2.0:1787826807.890919:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d139680 x1874672143655424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826807.890930:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143655424:0@lo:400:kworker.0 00010000:00010000:2.0:1787826808.017410:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787826808.406373:0:15458:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787826808.406453:0:15458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.406470:0:15458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.406479:0:15458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.406503:0:15458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.406527:0:15458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787826808.406533:0:15458:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787826808.406552:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826808.406562:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826808.406567:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826808.406574:0:15458:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787826808.406575:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0a00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826808.406581:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.406591:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826808.406594:0:15458:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1787826808.406615:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826808.406623:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826808.406634:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:3.0:1787826808.406637:0:15458:0:(import.c:65:import_set_state_nolock()) ffff8d54438ab800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:0.0:1787826808.406638:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787826808.406679:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826808.406686:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e157c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143655552:0@lo:39:umount.0 00010000:00010000:0.0:1787826808.406689:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826808.406725:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.406734:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a79537ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79537b4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.406755:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826808.406758:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826808.406761:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826808.406777:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143655680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826808.406781:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826808.406825:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826808.406829:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655552 00000100:00100000:2.0:1787826808.406839:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655552 00000100:00100000:0.0:1787826808.406890:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655680 00000100:00100000:0.0:1787826808.406896:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655680 00000100:00100000:2.0:1787826808.406903:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826808.406918:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e157840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143655552:12345-0@lo:39:umount.0 00000100:00100000:0.0:1787826808.406945:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1787826808.406951:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79537c9 00000100:00100000:0.0:1787826808.406957:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143655680:12345-0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787826808.406966:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d5476632800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826808.406972:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826808.406994:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440030a00/0xc0fefc09a79537b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a79537ad expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.407009:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826808.407047:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e157840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143655552:12345-0@lo:39:umount.0 Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826808.407054:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143655680:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826808.407055:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826808.407065:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1787826808.407067:0:6485:0:(genops.c:885:class_export_put()) final put ffff8d5476636000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1787826808.407075:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826808.407103:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5476636000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1787826808.407125:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d54438ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787826808.407135:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e157c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143655552:0@lo:39:umount.0 00000100:00080000:3.0:1787826808.407152:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826808.407155:0:15458:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787826808.407159:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826808.407178:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5476632800 for lustre-MDT0000 00000100:00100000:1.0:1787826808.407197:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143655680:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787826808.407974:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787826808.407977:0:15458:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787826808.407981:0:15458:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787826808.407992:0:15458:0:(import.c:65:import_set_state_nolock()) ffff8d53444ef000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787826808.408034:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143655808:0@lo:39:umount.0 00000100:00100000:2.0:1787826808.408076:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826808.408128:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655808 00000100:00100000:3.0:1787826808.408133:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655808 00000100:00100000:3.0:1787826808.408173:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787826808.408182:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143655808:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787826808.408203:0:6486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79537de 00000100:00080000:3.0:1787826808.408585:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d53444e9800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826808.408622:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826808.408666:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143655808:12345-0@lo:39:umount.0 Request processed in 485us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826808.408688:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:00000080:3.0:1787826808.408697:0:6486:0:(genops.c:885:class_export_put()) final put ffff8d53444ee000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00080000:2.0:1787826808.408714:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e156580 x1874672143655808/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826808.408727:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444ef000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1787826808.408732:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444ee000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:2.0:1787826808.408738:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143655808:0@lo:39:umount.0 00000100:00080000:3.0:1787826808.408748:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787826808.408751:0:15458:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787826808.408755:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826808.408783:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53444e9800 for lustre-MDT0001 00010000:00010000:3.0:1787826808.409738:0:15458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409754:0:15458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409761:0:15458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409768:0:15458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409791:0:15458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826808.409798:0:15458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409806:0:15458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409813:0:15458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409821:0:15458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826808.409834:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826808.409845:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.409854:0:15458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826808.409855:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0c00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826808.409861:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826808.409861:0:15458:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1787826808.409874:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.409883:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1787826808.409884:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.409892:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826808.409894:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000004:3.0:1787826808.409897:0:15458:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 10000000:01000000:2.0:1787826808.409903:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:01000000:3.0:1787826808.409905:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 10000000:01000000:2.0:1787826808.409908:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00000080:3.0:1787826808.409913:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787826808.409918:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6c00 already unused, calling callback (ffffffffc13fec20) 00000020:02000400:3.0:1787826808.409921:0:15458:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 10000000:00010000:0.0:1787826808.409931:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.409950:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826808.409956:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826808.409960:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826808.409974:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1787826808.409976:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787826808.409980:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787826808.409983:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787826808.410002:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826808.410008:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.410009:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826808.410021:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a795376e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953775 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.410035:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826808.410042:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143655936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826808.410058:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6c00/0xc0fefc09a795379f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79537a6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826808.410059:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826808.410063:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826808.410068:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826808.410075:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826808.410077:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826808.410079:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826808.410094:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f732d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143656064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826808.410127:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826808.410141:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826808.410204:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143655936 00000100:00100000:0.0:1787826808.410211:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143655936 00000100:00100000:1.0:1787826808.410238:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656064 00000100:00100000:1.0:1787826808.410244:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656064 00000100:00100000:0.0:1787826808.410287:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826808.410302:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5442b17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143655936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826808.410321:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826808.410336:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031400/0xc0fefc09a7953775 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795376e expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.410349:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826808.410384:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5442b17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3617:x1874672143655936:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826808.410391:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826808.410436:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826808.410442:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3618:x1874672143656064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826808.410450:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826808.410460:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5440031200/0xc0fefc09a79537a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795379f expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826808.410468:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826808.410493:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143656064:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826808.410500:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826808.410771:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f732d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143656064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826808.410784:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143655936:0@lo:103:ldlm_bl.0 00002000:00000080:3.0:1787826808.411296:0:15458:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:3.0:1787826808.411325:0:15458:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:0.0:1787826808.412347:0:14466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000020:00000080:1.0:1787826808.412449:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1787826808.412460:0:15458:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d544532c000 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 8589934593 stale:0 00000020:00080000:1.0:1787826808.412468:0:15458:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d544532a800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967299 stale:0 00000020:00080000:1.0:1787826808.412474:0:15458:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d544532d800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:1.0:1787826808.412483:0:15458:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5450e8b370) has exports, disconnecting them 00000020:00080000:1.0:1787826808.412489:0:15458:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d544532c000), last request at 1787826807 00000020:00000080:1.0:1787826808.412503:0:15458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953798 00000020:00010000:1.0:1787826808.412512:0:15458:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d544532c000: total 0 00000100:00080000:1.0:1787826808.412517:0:15458:0:(import.c:65:import_set_state_nolock()) ffff8d546e146000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787826808.412561:0:7427:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d544532c000: total 0 00010000:00010000:3.0:1787826808.412566:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787826808.412615:0:15458:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d544532c000): rc 0 00000020:00080000:1.0:1787826808.412619:0:15458:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d544532a800), last request at 1787826807 00000020:00000080:1.0:1787826808.412623:0:15458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953791 00000100:00080000:1.0:1787826808.412628:0:15458:0:(import.c:65:import_set_state_nolock()) ffff8d546e144800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826808.412643:0:15458:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d544532a800): rc 0 00000020:00000080:1.0:1787826808.412646:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d544532a800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787826808.412646:0:7427:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d544532c000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787826808.412661:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787826808.412670:0:15458:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d544532d800), last request at 1787826807 00000020:00000080:1.0:1787826808.412674:0:15458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795378a 00000100:00080000:1.0:1787826808.412685:0:15458:0:(import.c:65:import_set_state_nolock()) ffff8d547f8e3800 : changing import state from FULL to CLOSED 00002000:00010000:3.0:1787826808.412692:0:7427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 2123 00002000:00010000:3.0:1787826808.412697:0:7427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787826805 00000020:00000080:2.0:1787826808.412700:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544532a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00002000:00010000:3.0:1787826808.412700:0:7427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787826805 00002000:00010000:3.0:1787826808.412706:0:7427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:1.0:1787826808.412710:0:15458:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d544532d800): rc 0 00000020:00000080:1.0:1787826808.412714:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d544532d800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1787826808.412719:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826808.412738:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a795386a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 3 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826808.412761:0:15458:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5450e8b370) has no exports 00000020:00000080:2.0:1787826808.412762:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d546e144800 for lustre-OST0000 00000020:00000080:2.0:1787826808.412773:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544532d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00010000:00010000:3.0:1787826808.412777:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006141ed5a/0xc0fefc09a79538e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 2 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826808.412794:0:7427:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d544532c000, canceled 2 locks, left on hash table 0. 00000020:00000080:2.0:1787826808.412803:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d547f8e3800 for lustre-OST0000 00000020:00000080:3.0:1787826808.420473:0:7427:0:(genops.c:885:class_export_put()) final put ffff8d544532c000/2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:3.0:1787826808.420504:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826808.420506:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826808.420509:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826808.420527:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544532c000/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:0.0:1787826808.420582:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d546e146000 for lustre-OST0000 00000020:01000000:1.0:1787826808.421084:0:15458:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5460468b40 - data ffff8d5469ac3360/ffff8d54789af400 00000020:01000000:1.0:1787826808.421294:0:15458:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5460468240 - data ffff8d5448838af8/ffff8d53437d8400 00100000:10000000:1.0:1787826808.433621:0:15458:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787826808.438144:0:15458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953783 00000020:00000080:0.0:1787826808.438158:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d5445328000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787826808.438171:0:15458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5442bd2800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787826808.438187:0:15458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd2800 2 00000020:01000004:0.0:1787826808.438190:0:15458:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d5442bd2800 from lustre-OST0000 00000020:00000080:2.0:1787826808.438193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5445328000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787826808.438251:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826808.438267:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787826808.438271:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d5478923000/lustre-OST0000_UUID 00000020:00000080:0.0:1787826808.438273:0:15458:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478923000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787826808.438281:0:15458:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787826808.438360:0:15458:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1787826808.438366:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787826808.438371:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826808.438378:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826808.438386:0:15458:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d53444e8000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826808.438392:0:15458:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d5342780000) has exports, disconnecting them 00000020:00080000:0.0:1787826808.438398:0:15458:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d53444e8000), last request at 1787826797 00000020:00000080:0.0:1787826808.438403:0:15458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79537c2 00000020:00080000:0.0:1787826808.438420:0:15458:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d53444e8000): rc 0 00000020:00000080:0.0:1787826808.438426:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d53444e8000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787826808.438442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444e8000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787826808.439317:0:15458:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787826808.439338:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826808.439348:0:15458:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826808.439355:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826808.439385:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d54438ab800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787826808.439577:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826808.439586:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787826808.439595:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d547f8e4800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787826808.439610:0:15458:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f8e4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787826808.439623:0:15458:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787826808.439720:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787826808.439724:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826808.439731:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787826808.439737:0:15458:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d53444eb000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826808.439743:0:15458:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d53444fb370) has exports, disconnecting them 00000020:00080000:1.0:1787826808.439749:0:15458:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d53444eb000), last request at 1787826797 00000020:00000080:1.0:1787826808.439752:0:15458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79537d7 00000020:00080000:1.0:1787826808.439771:0:15458:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d53444eb000): rc 0 00000020:00000080:1.0:1787826808.439775:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d53444eb000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787826808.439797:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444eb000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787826808.441027:0:15458:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787826808.441032:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826808.441036:0:15458:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826808.441045:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826808.441083:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53444ef000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787826808.441254:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826808.441262:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787826808.441267:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d53444ec000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787826808.441270:0:15458:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444ec000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787826808.441275:0:15458:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787826808.441352:0:15458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd2800 1 00000020:00000080:0.0:1787826808.441357:0:15458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953767 00000020:00000080:0.0:1787826808.441363:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d5442bd4000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787826808.441372:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787826808.441382:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826808.441387:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826808.441391:0:15458:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d5450e8cd28) has no exports 00000020:00000080:2.0:1787826808.441394:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5442bd4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787826808.454334:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826808.454345:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787826808.454349:0:15458:0:(genops.c:885:class_export_put()) final put ffff8d5442bd4800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787826808.454353:0:15458:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5442bd4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787826808.454357:0:15458:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787826808.454439:0:15458:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d5442bd0800 00000020:02000400:0.0:1787826808.454481:0:15458:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:0.0:1787826808.913310:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826808.913340:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f732d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143656192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826808.913408:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826808.913471:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656192 00000100:00100000:3.0:1787826808.913479:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656192 00000100:00100000:3.0:1787826808.913538:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787826808.913548:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143656192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826808.913583:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826808.913658:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143656192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826808.913667:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787826808.913694:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f732d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143656192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826809.041322:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826809.425364:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143656320:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787826809.425373:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 184288156359ns, next at 185288153993ns, rc = 0 00000100:00100000:2.0:1787826809.425409:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143656448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826809.425425:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826809.425456:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826809.425473:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656320 00000100:00100000:3.0:1787826809.425480:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656320 00000100:00100000:0.0:1787826809.425499:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656448 00000100:00100000:0.0:1787826809.425505:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656448 00000100:00100000:3.0:1787826809.425512:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826809.425517:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143656320:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1787826809.425524:0:8403:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826809.425560:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143656320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (136us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826809.425566:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826809.425579:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826809.425582:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3617:x1874672143656448:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:3.0:1787826809.425585:0:8403:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:02020000:1.0:1787826809.425588:0:3616:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1787826809.425624:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3617:x1874672143656448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (168us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826809.425628:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:02020000:2.0:1787826809.425665:0:3617:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787826809.425670:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826809.425675:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826809.425679:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1787826809.434030:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1787826809.434036:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826809.434043:0:3617:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1787826809.434063:0:3617:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826809.434090:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f74de00 x1874672143656576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826809.434139:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143656576:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:0.0:1787826809.434195:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826809.434248:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656576 00000100:00100000:2.0:1787826809.434253:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656576 00000100:00100000:2.0:1787826809.434281:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787826809.434286:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e39a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143656576:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:2.0:1787826809.434302:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787826809.435441:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826809.435445:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826809.435447:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1787826809.435455:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1787826809.435457:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826809.435467:0:3616:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 173 00000100:00080000:1.0:1787826809.435471:0:3616:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826809.435487:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547d369680 x1874672143656704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826809.435532:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143656704:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:0.0:1787826809.435561:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826809.435599:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656704 00000100:00100000:1.0:1787826809.435603:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656704 00000100:00100000:1.0:1787826809.435622:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787826809.435626:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143656704:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:1.0:1787826809.435634:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826809.435668:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143656704:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 42us (107us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826809.435673:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787826809.435698:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826809.435704:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826809.435708:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143656704:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:2.0:1787826809.444416:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e39a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143656576:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 10123us (10215us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826809.444431:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787826809.444481:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826809.444491:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826809.444496:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143656576:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:0.0:1787826810.065425:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826810.769443:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826810.769510:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826810.769518:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153728 00000100:00100000:0.0:1787826810.769529:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153728 00000100:00100000:3.0:1787826810.769567:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153856 00000100:00100000:3.0:1787826810.769573:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153856 00000100:00100000:0.0:1787826810.769607:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:0.0:1787826810.769613:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2393:x1874672134153728:12345-192.168.203.6@tcp:4:date.0 00000020:00080000:0.0:1787826810.769627:0:8407:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:3.0:1787826810.769627:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 45 00000100:00100000:3.0:1787826810.769638:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1874672134153856:12345-192.168.203.6@tcp:16:kworker.0 00000020:00080000:3.0:1787826810.769645:0:8402:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:0.0:1787826810.769899:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2393:x1874672134153728:12345-192.168.203.6@tcp:4:date.0 Request processed in 278us (458us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826810.769899:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1874672134153856:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 256us (382us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826810.769917:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:3.0:1787826810.769928:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 45 00000100:00100000:3.0:1787826810.779991:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826810.780062:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153984 00000100:00100000:0.0:1787826810.780073:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153984 00000100:00100000:0.0:1787826810.780129:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:0.0:1787826810.780135:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134153984:12345-192.168.203.6@tcp:8:ptlrpcd_01_00.0 00010000:00020000:0.0:1787826810.780162:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826810.780276:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134153984:12345-192.168.203.6@tcp:8:ptlrpcd_01_00.0 Request processed in 137us (291us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826810.780284:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 46 00000004:00080000:0.0:1787826810.962486:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787826810.962514:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000004:00080000:0.0:1787826810.962525:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00100000:0.0:1787826810.962546:0:6464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:0.0:1787826810.962550:0:6464:0:(genops.c:885:class_export_put()) final put ffff8d5343506800/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00010000:00010000:1.0:1787826810.962587:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962601:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962609:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787826810.962612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343506800/623ddf66-2f94-46d4-a38e-7bde7caf88c3 for lustre-MDT0000 00010000:00010000:1.0:1787826810.962616:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826810.962623:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962635:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962665:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc2861ed (ffff8d54756ae900) 00000020:00000080:2.0:1787826810.962674:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5478965000 for lustre-MDT0000 00010000:00010000:1.0:1787826810.962675:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826810.962682:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962691:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a795384e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962708:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962715:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962721:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962726:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826810.962729:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962735:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962744:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc2861ed (ffff8d54756ae900) 00010000:00010000:1.0:1787826810.962746:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826810.962749:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962755:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6400/0xc0fefc09a79538a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962771:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962785:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962791:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962797:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826810.962800:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962806:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962814:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3509f068 (ffff8d53428e3500) 00010000:00010000:1.0:1787826810.962817:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826810.962819:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826810.962825:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a79538cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826811.089420:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826812.113403:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826812.305290:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826812.305347:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826812.305347:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134154112 00000100:00100000:3.0:1787826812.305358:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134154112 00000100:00100000:1.0:1787826812.305389:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826812.305402:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134154496 00000100:00100000:2.0:1787826812.305408:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134154496 00000100:00100000:1.0:1787826812.305428:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826812.305439:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134154240 00000100:00100000:0.0:1787826812.305445:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134154240 00000100:00100000:3.0:1787826812.305445:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 327 00000100:00100000:2.0:1787826812.305450:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134154624 00000100:00100000:2.0:1787826812.305454:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134154624 00000100:00100000:3.0:1787826812.305458:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134154112:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826812.305470:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826812.305496:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:2.0:1787826812.305507:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134154624:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826812.305509:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134154368 00000100:00100000:0.0:1787826812.305515:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134154368 00000100:00080000:1.0:1787826812.305517:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826812.305524:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826812.305530:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826812.305530:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134154112:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826812.305541:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 327 00000100:00100000:0.0:1787826812.305543:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 127 00000100:00100000:2.0:1787826812.305550:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134154624:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826812.305552:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134154240:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826812.305563:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:1.0:1787826812.305568:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:2.0:1787826812.305597:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00100000:0.0:1787826812.305605:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134154240:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826812.305607:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134154496:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:1.0:1787826812.305608:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134154368:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826812.305628:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 127 00010000:00020000:2.0:1787826812.305640:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826812.305651:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134154368:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826812.305661:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:2.0:1787826812.316098:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134154496:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 10484us (10742us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826812.316113:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00080000:2.0:1787826813.009393:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787826813.009397:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143656832:0@lo:400:kworker.0 00000100:00080000:2.0:1787826813.009398:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1787826813.009401:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143656960:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787826813.009403:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826813.009411:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 184 00000100:00080000:2.0:1787826813.009415:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826813.009421:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826813.009440:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e15d2c0 x1874672143657600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826813.009466:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826813.009471:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826813.009478:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826813.009482:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826813.009485:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826813.009490:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 184 00000100:00080000:2.0:1787826813.009495:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1787826813.009499:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143657088:0@lo:400:kworker.0 00000100:00080000:2.0:1787826813.009500:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826813.009517:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143657472:0@lo:400:kworker.0 00000100:00100000:2.0:1787826813.009520:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d545326bc00 x1874672143658240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826813.009525:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143657344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.009544:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826813.009551:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826813.009556:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143657216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826813.009580:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826813.009592:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143658112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.009600:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657088 00000100:00100000:3.0:1787826813.009607:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657088 00000100:00100000:2.0:1787826813.009612:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826813.009613:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143657984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826813.009630:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826813.009653:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143657856:0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.009655:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657344 00000100:00100000:3.0:1787826813.009660:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657344 00000100:00100000:0.0:1787826813.009665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826813.009687:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143658112 00000100:00100000:3.0:1787826813.009691:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143658112 00000100:00100000:0.0:1787826813.009709:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656832 00000100:00100000:2.0:1787826813.009710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826813.009716:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656832 00000100:00100000:3.0:1787826813.009720:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657856 00000100:00100000:3.0:1787826813.009724:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657856 00000100:00100000:1.0:1787826813.009733:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657472 00000100:00100000:1.0:1787826813.009739:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657472 00000100:00100000:2.0:1787826813.009739:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826813.009749:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f731680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143658368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826813.009753:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787826813.009760:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787826813.009770:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143656832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.009772:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e155a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143657088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826813.009777:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657216 00000100:00100000:1.0:1787826813.009783:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657216 00000100:00100000:2.0:1787826813.009785:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826813.009805:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143658368 00000100:00100000:1.0:1787826813.009809:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143658368 00000100:00100000:2.0:1787826813.009829:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787826813.009836:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787826813.009838:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143656832:12345-0@lo:400:kworker.0 Request processed in 67us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826813.009838:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e155a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143657088:12345-0@lo:400:kworker.0 Request processed in 66us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826813.009840:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143657344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826813.009851:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143657472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826813.009858:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787826813.009858:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787826813.009883:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143657344:12345-0@lo:400:kworker.0 Request processed in 46us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826813.009885:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787826813.009897:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143658112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826813.009901:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787826813.009905:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787826813.009913:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143657216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826813.009930:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787826813.009932:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143657472:12345-0@lo:400:kworker.0 Request processed in 83us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826813.009944:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826813.009945:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143657856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.009959:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143658112:12345-0@lo:400:kworker.0 Request processed in 65us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826813.009968:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787826813.009970:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787826813.009981:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143657216:12345-0@lo:400:kworker.0 Request processed in 70us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826813.009982:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143658368:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826813.009995:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787826813.009998:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826813.010001:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143657856:12345-0@lo:400:kworker.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826813.010003:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826813.010012:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000004:00000024:1.0:1787826813.010021:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826813.010039:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656960 00000100:00100000:3.0:1787826813.010041:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143657088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826813.010044:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656960 00000100:00100000:3.0:1787826813.010052:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143657728:0@lo:400:kworker.0 00000100:00100000:2.0:1787826813.010060:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657984 00000100:00100000:2.0:1787826813.010067:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657984 00000100:00100000:1.0:1787826813.010077:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143658368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826813.010085:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787826813.010094:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826813.010098:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143656960:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826813.010100:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787826813.010110:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143657600:0@lo:8:kworker.0 00002000:00000024:0.0:1787826813.010122:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826813.010126:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657728 00000100:00100000:3.0:1787826813.010131:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657728 00010000:00080000:1.0:1787826813.010142:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5453268000 x1874672143658112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826813.010153:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826813.010163:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143658112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.010163:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787826813.010176:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143657728:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826813.010189:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e16c780 x1874672143656960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826813.010191:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143656960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826813.010197:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143658240:0@lo:8:kworker.0 00000100:00100000:0.0:1787826813.010208:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787826813.010232:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143657728:12345-0@lo:400:kworker.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826813.010241:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826813.010243:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787826813.010253:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143657984:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826813.010257:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143656960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826813.010259:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143657600 00000100:00100000:2.0:1787826813.010263:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826813.010265:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143657600 00002000:00000024:0.0:1787826813.010270:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826813.010280:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143657472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.010287:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143658240 00000100:00100000:3.0:1787826813.010291:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143658240 00000100:00100000:3.0:1787826813.010309:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826813.010314:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143657984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826813.010319:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143657600:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826813.010320:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826813.010328:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787826813.010333:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143658240:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787826813.010339:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1787826813.010348:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826813.010349:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143657344:0@lo:400:kworker.0 00000100:00080000:0.0:1787826813.010351:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787826813.010371:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e154000 x1874672143657984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826813.010387:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143657984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826813.010389:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143657600:12345-0@lo:8:kworker.0 Request processed in 71us (239us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826813.010392:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f731680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143658368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826813.010402:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143658240:12345-0@lo:8:kworker.0 Request processed in 67us (142us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826813.010408:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143656832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826813.010408:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826813.010415:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143657216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826813.010428:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826813.010433:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143657856:0@lo:400:kworker.0 00010000:00080000:3.0:1787826813.010444:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e15c780 x1874672143657728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826813.010463:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143657728:0@lo:400:kworker.0 00000100:00080000:2.0:1787826813.010472:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826813.010479:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826813.010483:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143657600:0@lo:8:kworker.0 00000100:00080000:2.0:1787826813.010494:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826813.010497:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826813.010500:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143658240:0@lo:8:kworker.0 00010000:00010000:2.0:1787826813.137390:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826814.033762:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143658496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826814.033842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826814.033932:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143658496 00000100:00100000:1.0:1787826814.033946:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143658496 00000100:00100000:1.0:1787826814.034016:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787826814.034032:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143658496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826814.034076:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826814.034169:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143658496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826814.034179:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787826814.034210:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143658496:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826814.161380:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826815.185483:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826816.209363:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826817.233374:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826817.425164:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826817.425241:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134154880 00000100:00100000:3.0:1787826817.425251:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134154880 00000100:00100000:1.0:1787826817.425287:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00080000:0.0:1787826817.425306:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826817.425316:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 133 00000100:00100000:1.0:1787826817.425332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826817.425332:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134154880:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826817.425353:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134154752 00000100:00100000:0.0:1787826817.425359:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134154752 00000100:00100000:1.0:1787826817.425374:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826817.425387:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155136 00000100:00100000:2.0:1787826817.425393:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155136 00000100:00100000:0.0:1787826817.425403:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 329 00000100:00100000:3.0:1787826817.425411:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134154880:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826817.425418:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155264 00000100:00100000:0.0:1787826817.425419:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134154752:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826817.425421:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155264 00000100:00100000:3.0:1787826817.425426:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 133 00000100:00100000:1.0:1787826817.425430:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826817.425453:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155008 00000100:00100000:3.0:1787826817.425457:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155008 00000100:00100000:2.0:1787826817.425459:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:0.0:1787826817.425465:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134154752:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826817.425469:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134155264:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826817.425481:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 329 00000100:00100000:3.0:1787826817.425486:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 134 00000100:00100000:3.0:1787826817.425495:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134155008:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826817.425505:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134155264:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826817.425512:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:3.0:1787826817.425516:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134155008:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 24us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826817.425521:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 134 00000100:00100000:2.0:1787826817.425527:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 50 00000100:00100000:2.0:1787826817.425532:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134155136:12345-192.168.203.6@tcp:8:kworker.0 00000100:00080000:0.0:1787826817.425547:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826817.425554:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00020000:2.0:1787826817.425565:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826817.436314:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134155136:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 10771us (10977us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826817.436338:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 50 00000100:00100000:3.0:1787826818.129390:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143658880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826818.129394:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f702940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143659136:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787826818.129395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787826818.129399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143659008:0@lo:400:kworker.0 00000100:00080000:1.0:1787826818.129404:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826818.129408:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826818.129414:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 187 00000100:00080000:1.0:1787826818.129436:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787826818.129444:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826818.129470:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d545326bc00 x1874672143659648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826818.129471:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826818.129476:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826818.129477:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826818.129550:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143659776:0@lo:400:kworker.0 00000100:00080000:1.0:1787826818.129553:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1787826818.129553:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f731680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143658752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826818.129559:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143659520:0@lo:400:kworker.0 00000100:00080000:1.0:1787826818.129564:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826818.129567:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826818.129572:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 187 00000100:00080000:1.0:1787826818.129576:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787826818.129580:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826818.129597:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f81c3c0 x1874672143660160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826818.129597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826818.129605:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826818.129606:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826818.129638:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659008 00000100:00100000:2.0:1787826818.129640:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787826818.129645:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659008 00000100:00100000:2.0:1787826818.129651:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143659264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826818.129659:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e157c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143658624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826818.129660:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787826818.129674:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143659392:0@lo:400:kworker.0 00000100:00100000:2.0:1787826818.129684:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826818.129699:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787826818.129703:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826818.129712:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143659904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826818.129715:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143659008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826818.129717:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826818.129749:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143660032:0@lo:400:kworker.0 00000100:00100000:2.0:1787826818.129753:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826818.129766:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659392 00000100:00100000:3.0:1787826818.129772:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659392 00000100:00100000:1.0:1787826818.129781:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143659008:12345-0@lo:400:kworker.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826818.129789:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826818.129799:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659136 00000100:00100000:2.0:1787826818.129803:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659136 00000100:00100000:1.0:1787826818.129813:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787826818.129813:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659904 00000100:00100000:3.0:1787826818.129819:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659904 00000100:00100000:2.0:1787826818.129830:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659520 00000100:00100000:0.0:1787826818.129835:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143659008:0@lo:400:kworker.0 00000100:00100000:2.0:1787826818.129836:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659520 00000100:00100000:1.0:1787826818.129839:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660032 00000100:00100000:1.0:1787826818.129845:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660032 00000100:00100000:3.0:1787826818.129864:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787826818.129865:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659264 00000100:00100000:2.0:1787826818.129870:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659264 00000100:00100000:0.0:1787826818.129881:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826818.129883:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787826818.129885:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143659392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826818.129900:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143659904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826818.129901:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143659136:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826818.129901:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787826818.129913:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143659520:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1787826818.129941:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826818.129944:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143659392:12345-0@lo:400:kworker.0 Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826818.129954:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787826818.129965:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143659520:12345-0@lo:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826818.129969:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143659904:12345-0@lo:400:kworker.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826818.129975:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787826818.129977:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787826818.129988:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143659136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826818.129988:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787826818.129993:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143660032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826818.129998:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826818.130007:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787826818.130010:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143659264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826818.130035:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143659904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826818.130039:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143658752 00000100:00100000:0.0:1787826818.130044:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143658752 00000100:00100000:3.0:1787826818.130052:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143660032:12345-0@lo:400:kworker.0 Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826818.130060:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143659264:12345-0@lo:400:kworker.0 Request processed in 51us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826818.130064:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f702940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143659136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826818.130065:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787826818.130081:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787826818.130092:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826818.130093:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143658752:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787826818.130098:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826818.130104:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826818.130106:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143659264:0@lo:400:kworker.0 00000100:00100000:2.0:1787826818.130123:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143658880 00000100:00100000:2.0:1787826818.130128:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143658880 00000100:00100000:0.0:1787826818.130137:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143658752:12345-0@lo:400:kworker.0 Request processed in 48us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826818.130139:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143659392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826818.130151:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787826818.130161:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143658624 00010000:00080000:3.0:1787826818.130166:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f81f0c0 x1874672143660032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826818.130167:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143658624 00000100:00100000:2.0:1787826818.130172:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787826818.130184:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143660032:0@lo:400:kworker.0 00000100:00100000:2.0:1787826818.130185:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e155e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143658880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826818.130199:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f731680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143658752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826818.130208:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143659520:0@lo:400:kworker.0 00002000:00000024:2.0:1787826818.130210:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826818.130248:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143659648:0@lo:8:kworker.0 00000100:00100000:0.0:1787826818.130257:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659776 00000100:00080000:3.0:1787826818.130263:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826818.130270:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659776 00000100:00100000:2.0:1787826818.130273:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e155e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143658880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826818.130278:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787826818.130291:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826818.130296:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787826818.130302:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143658624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826818.130311:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826818.130312:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143659648 00000100:00100000:0.0:1787826818.130317:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143659648 00010000:00080000:3.0:1787826818.130322:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e16d2c0 x1874672143658880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826818.130332:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143660160:0@lo:8:kworker.0 00000100:00100000:2.0:1787826818.130337:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143658624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826818.130340:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143658880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826818.130347:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787826818.130349:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826818.130362:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143659776:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826818.130366:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e157c00 x1874672143658624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826818.130371:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826818.130379:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787826818.130388:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143659648:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787826818.130410:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e157c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143658624:0@lo:13:osp-pre-1-1.0 00010000:00020000:2.0:1787826818.130411:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826818.130420:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143659776:12345-0@lo:400:kworker.0 Request processed in 59us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826818.130430:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787826818.130442:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660160 00000100:00100000:1.0:1787826818.130447:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660160 00000100:00100000:2.0:1787826818.130456:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143659648:12345-0@lo:8:kworker.0 Request processed in 69us (168us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826818.130464:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787826818.130469:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d545326ad00 x1874672143659776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826818.130476:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787826818.130486:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143659776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826818.130488:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143660160:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787826818.130504:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787826818.130514:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826818.130520:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826818.130524:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143659648:0@lo:8:kworker.0 00000100:00080000:2.0:1787826818.130557:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787826818.130559:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143660160:12345-0@lo:8:kworker.0 Request processed in 71us (191us total) trans 0 rc -19/-19 00000100:00080000:2.0:1787826818.130568:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826818.130572:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826818.130573:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143660160:0@lo:8:kworker.0 00010000:00010000:0.0:1787826818.257417:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826819.153565:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143660288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826819.153638:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826819.153782:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660288 00000100:00100000:0.0:1787826819.153790:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660288 00000100:00100000:0.0:1787826819.153839:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787826819.153849:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e157c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143660288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826819.153887:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826819.154032:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e157c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143660288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826819.154040:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787826819.154106:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143660288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826819.281306:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826820.305405:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826821.313935:0:15879:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826821.313939:0:15879:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787826821.313941:0:15879:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787826821.314055:0:15879:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d547f8e5800 00000020:01000004:2.0:1787826821.314072:0:15879:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787826821.314085:0:15879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826821.314098:0:15879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d53444f99b8) 00000020:00000080:2.0:1787826821.314115:0:15879:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1787826821.329321:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787826821.337849:0:15879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787826821.339544:0:15879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787826821.339807:0:15879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787826821.339943:0:15879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787826821.340096:0:15879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787826821.340208:0:15879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787826821.340349:0:15879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1787826821.340925:0:15879:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787826821.341085:0:15879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787826821.341094:0:15879:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787826821.341101:0:15879:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a79538f6 00000020:01000004:1.0:1787826821.341106:0:15879:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787826821.341123:0:15879:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787826821.341125:0:15879:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787826821.341129:0:15879:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787826821.341148:0:15879:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787826821.341151:0:15879:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787826821.345878:0:15879:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787826821.345913:0:15879:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787826821.345926:0:15879:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787826821.345928:0:15879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826821.345929:0:15879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826821.345931:0:15879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826821.345932:0:15879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826821.345934:0:15879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826821.345935:0:15879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826821.345936:0:15879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826821.345938:0:15879:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826821.345940:0:15879:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787826821.345943:0:15879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826821.345944:0:15879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826821.345945:0:15879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826821.345946:0:15879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826821.345947:0:15879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826821.345948:0:15879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826821.345949:0:15879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826821.345950:0:15879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826821.345951:0:15879:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826821.345975:0:15879:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787826821.345992:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787826821.346063:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.346117:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.346127:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660416 00000100:00100000:0.0:1787826821.346135:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660416 00000100:00100000:0.0:1787826821.346186:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787826821.346195:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:15879:x1874672143660416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826821.346247:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787826821.346252:0:6479:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787826821.346263:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787826821.346458:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:15879:x1874672143660416:12345-0@lo:253:mount.lustre.0 Request processed in 263us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.346467:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787826821.346479:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787826821.346492:0:15879:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787826821.346495:0:15879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826821.346497:0:15879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826821.346498:0:15879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826821.346499:0:15879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826821.346500:0:15879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826821.346501:0:15879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826821.346502:0:15879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826821.346503:0:15879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826821.346505:0:15879:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787826821.346533:0:15879:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d547f8e5800 from lustre-OST0000 10000000:01000000:1.0:1787826821.346558:0:15879:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787826821.346562:0:15879:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787826821.346569:0:15879:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:1.0:1787826821.346577:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826821.346640:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826821.346667:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.346692:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5446489480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.346720:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660544 00000100:00100000:0.0:1787826821.346726:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660544 00000100:00100000:0.0:1787826821.346760:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787826821.346769:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:15879:x1874672143660544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826821.346834:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:15879:x1874672143660544:12345-0@lo:501:mount.lustre.0 Request processed in 66us (165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826821.346841:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787826821.346862:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660544:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787826821.346878:0:15879:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787826821.346894:0:15879:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787826821.346899:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.346907:0:15879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826821.346938:0:15879:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d547f8e5800 10000000:01000000:1.0:1787826821.346943:0:15879:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787826821.346948:0:15879:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787826821.346950:0:15879:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826821.346954:0:15879:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787826821.346956:0:15879:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787826821.346976:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.346984:0:15879:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.346992:0:15879:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826821.347004:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826821.347029:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.347047:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5446489480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826821.347074:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660672 00000100:00100000:2.0:1787826821.347078:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660672 00000100:00100000:2.0:1787826821.347100:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787826821.347105:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:15879:x1874672143660672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826821.347111:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826821.347121:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a7953904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79538fd expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.347143:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a7953904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79538fd expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.347153:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a7953904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79538fd expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.347162:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3600, rc 0) 00000100:00100000:2.0:1787826821.347194:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143660672:12345-0@lo:101:mount.lustre.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.347200:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787826821.347237:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826821.347250:0:15879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.347260:0:15879:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826821.347876:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787826821.348283:0:15879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826821.349263:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787826821.349297:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787826821.349314:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787826821.349328:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787826821.349341:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787826821.349354:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787826821.349368:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787826821.349381:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787826821.349394:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787826821.349408:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787826821.349423:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787826821.349436:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787826821.349454:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787826821.349460:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787826821.349555:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826821.349601:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.349635:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826821.349660:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660800 00000100:00100000:2.0:1787826821.349673:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660800 00000100:00100000:2.0:1787826821.349712:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787826821.349721:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143660800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826821.349823:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143660800:12345-0@lo:501:mount.lustre.0 Request processed in 102us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.349831:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787826821.349841:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826821.349872:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826821.349910:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.349931:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.349958:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143660928 00000100:00100000:0.0:1787826821.349963:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143660928 00000100:00100000:0.0:1787826821.349992:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787826821.349999:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143660928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826821.350088:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143660928:12345-0@lo:503:mount.lustre.0 Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.350096:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787826821.350102:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143660928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826821.350433:0:15879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826821.350478:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826821.350526:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.350554:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54473386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.350574:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661056 00000100:00100000:0.0:1787826821.350579:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661056 00000100:00100000:0.0:1787826821.350607:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787826821.350613:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143661056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826821.350693:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143661056:12345-0@lo:502:mount.lustre.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826821.350701:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826821.350702:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000040:00080000:1.0:1787826821.350847:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787826821.350878:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787826821.350893:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787826821.350908:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787826821.350922:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787826821.350936:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787826821.350952:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787826821.350971:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787826821.350987:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787826821.350999:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787826821.351011:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787826821.351022:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787826821.351042:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826821.351078:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.351097:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54473386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826821.351122:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661184 00000100:00100000:2.0:1787826821.351127:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661184 00000100:00100000:2.0:1787826821.351157:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787826821.351164:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143661184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826821.351272:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143661184:12345-0@lo:502:mount.lustre.0 Request processed in 107us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.351280:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787826821.351285:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826821.351327:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787826821.351334:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787826821.351736:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826821.351743:0:15883:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787826821.351750:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826821.351752:0:15883:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787826821.351757:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826821.351769:0:15883:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5450eecd28) 00000020:00000080:1.0:1787826821.351789:0:15883:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787826821.351794:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826821.351850:0:15883:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e5800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787826821.351857:0:15883:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826821.351862:0:15883:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953912 00010000:00010000:1.0:1787826821.354886:0:15883:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1787826821.355198:0:15883:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 8589934592 lx: 1874672143596416 gen 0 00000001:00080000:1.0:1787826821.355253:0:15883:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294967299 srv lr: 8589934592 lx: 1874672143598336 gen 0 00000001:00080000:1.0:1787826821.355275:0:15883:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 8589934593 srv lr: 8589934592 lx: 1874672134151168 gen 0 00000001:00000004:1.0:1787826821.355289:0:15883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1787826821.356250:0:15883:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1787826821.357012:0:15883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787826821.357022:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826821.357028:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826821.357030:0:15883:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787826821.357033:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787826821.357035:0:15883:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787826821.357036:0:15883:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826821.357038:0:15883:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826821.357039:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787826821.357042:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826821.357043:0:15883:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787826821.357045:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826821.357048:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826821.357049:0:15883:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787826821.357051:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787826821.357054:0:15883:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787826821.357056:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826821.357058:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826821.357060:0:15883:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787826821.357062:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826821.357065:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826821.357066:0:15883:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787826821.357069:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787826821.357087:0:15883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826821.357091:0:15883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826821.357092:0:15883:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787826821.357095:0:15883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787826821.357189:0:15879:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787826821.357248:0:15879:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787826821.357268:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.357279:0:15879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826821.357287:0:15879:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d547f8e5800 from 1 10000000:01000000:2.0:1787826821.357289:0:15879:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826821.357322:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.357329:0:15879:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.357349:0:15879:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826821.357371:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826821.357435:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.357493:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475607f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826821.357498:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661312 00000100:00100000:3.0:1787826821.357516:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661312 00000100:00100000:3.0:1787826821.357563:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787826821.357573:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:15879:x1874672143661312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826821.357586:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826821.357599:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953935 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795392e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.357623:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795392e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.357635:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795392e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.357656:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d544148f000, rc 0) 00000100:00100000:3.0:1787826821.357715:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661312:12345-0@lo:101:mount.lustre.0 Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826821.357723:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787826821.357745:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826821.357760:0:15879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.357767:0:15879:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826821.358537:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000040:00080000:2.0:1787826821.358697:0:15879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826821.358863:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787826821.358892:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787826821.358909:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787826821.358927:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787826821.358943:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787826821.358965:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787826821.358972:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 6 count 7 00000100:00100000:2.0:1787826821.359020:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826821.359056:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.359091:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475607900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.359100:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661440 00000100:00100000:0.0:1787826821.359106:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661440 00000100:00100000:0.0:1787826821.359144:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787826821.359153:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826821.359266:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661440:12345-0@lo:501:mount.lustre.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.359275:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787826821.359289:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826821.359317:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826821.359359:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.359385:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475607900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826821.359411:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661568 00000100:00100000:1.0:1787826821.359416:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661568 00000100:00100000:1.0:1787826821.359446:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787826821.359460:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826821.359559:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661568:12345-0@lo:503:mount.lustre.0 Request processed in 98us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.359564:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826821.359570:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000040:00080000:2.0:1787826821.359814:0:15879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826821.359840:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826821.359866:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.359883:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5475607f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.359912:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661696 00000100:00100000:0.0:1787826821.359917:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661696 00000100:00100000:0.0:1787826821.359949:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787826821.359956:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826821.360053:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661696:12345-0@lo:502:mount.lustre.0 Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.360061:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787826821.360080:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787826821.360250:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787826821.360275:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787826821.360292:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787826821.360307:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787826821.360332:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:3.0:1787826821.360354:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826821.360388:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.360408:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661824 00000100:00100000:2.0:1787826821.360415:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661824 00000100:00100000:3.0:1787826821.360415:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826821.360449:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787826821.360456:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826821.360531:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661824:12345-0@lo:502:mount.lustre.0 Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.360537:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787826821.360561:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787826821.360594:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787826821.360600:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1787826821.360960:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826821.360967:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826821.360969:0:15887:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787826821.360975:0:15887:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547f8e5800 00000020:00000080:3.0:1787826821.360978:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787826821.360984:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826821.360986:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826821.360987:0:15887:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787826821.360989:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826821.360991:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826821.360992:0:15887:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787826821.361000:0:15887:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547f8e5800 00000020:00000080:3.0:1787826821.361003:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787826821.361044:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826821.361047:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826821.361048:0:15887:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787826821.361051:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:1.0:1787826821.361107:0:15879:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787826821.361136:0:15879:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826821.361149:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.361158:0:15879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826821.361265:0:15879:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787826821.361269:0:15879:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d547f8e5800 10000000:01000000:1.0:1787826821.361272:0:15879:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d547f8e5800 10000000:01000000:1.0:1787826821.361277:0:15879:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826821.361283:0:15879:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d547f8e5800 from 1 10000000:01000000:1.0:1787826821.361286:0:15879:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826821.361309:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.361316:0:15879:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.361323:0:15879:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826821.361333:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826821.361369:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826821.361402:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143661952 00000100:00100000:1.0:1787826821.361407:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.361408:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143661952 00000100:00100000:0.0:1787826821.361438:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787826821.361445:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:15879:x1874672143661952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826821.361451:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826821.361461:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1c00/0xc0fefc09a7953943 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795393c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.361478:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1c00/0xc0fefc09a7953943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795393c expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.361485:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1c00/0xc0fefc09a7953943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795393c expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.361490:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1c00, rc 0) 00000100:00100000:0.0:1787826821.361536:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143661952:12345-0@lo:101:mount.lustre.0 Request processed in 93us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.361546:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787826821.361684:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143661952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826821.361697:0:15879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826821.361713:0:15879:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826821.362652:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787826821.362794:0:15879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826821.362959:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787826821.363000:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787826821.363024:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787826821.363043:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787826821.363063:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787826821.363082:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787826821.363101:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787826821.363117:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787826821.363136:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787826821.363156:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787826821.363173:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787826821.363189:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787826821.363205:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787826821.363279:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787826821.363299:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787826821.363315:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787826821.363332:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787826821.363362:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787826821.363386:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787826821.363406:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787826821.363423:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787826821.363443:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787826821.363472:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787826821.363492:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787826821.363523:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787826821.363542:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787826821.363562:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787826821.363581:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787826821.363596:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787826821.363612:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787826821.363628:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787826821.363646:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787826821.363664:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787826821.363696:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787826821.363716:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787826821.363734:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787826821.363751:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787826821.363770:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787826821.363789:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787826821.363807:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787826821.363824:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787826821.363842:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787826821.363860:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787826821.363879:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787826821.363897:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787826821.363915:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787826821.363934:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787826821.363952:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787826821.364101:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787826821.364126:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787826821.364150:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787826821.364156:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787826821.364242:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826821.364290:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826821.364338:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662080 00000100:00100000:1.0:1787826821.364340:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5446489780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.364345:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662080 00000100:00100000:0.0:1787826821.364397:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787826821.364411:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826821.364498:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662080:12345-0@lo:501:mount.lustre.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.364503:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787826821.364527:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826821.364560:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826821.364599:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826821.364622:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.364657:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662208 00000100:00100000:0.0:1787826821.364663:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662208 00000100:00100000:0.0:1787826821.364698:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787826821.364707:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826821.364798:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662208:12345-0@lo:503:mount.lustre.0 Request processed in 92us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.364806:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787826821.364832:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787826821.365166:0:15879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787826821.365267:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826821.365310:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826821.365347:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.365350:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662336 00000100:00100000:0.0:1787826821.365356:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662336 00000100:00100000:0.0:1787826821.365394:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787826821.365404:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826821.365484:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662336:12345-0@lo:502:mount.lustre.0 Request processed in 82us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.365492:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787826821.365531:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787826821.365708:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787826821.365735:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787826821.365752:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787826821.365768:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787826821.365782:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787826821.365803:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787826821.365820:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787826821.365831:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787826821.365839:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787826821.365859:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787826821.365868:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787826821.365876:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787826821.365890:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787826821.365897:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787826821.365904:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787826821.365911:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787826821.365917:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787826821.365926:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787826821.365941:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787826821.365954:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787826821.365968:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787826821.365988:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787826821.366004:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787826821.366022:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787826821.366036:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787826821.366066:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787826821.366084:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787826821.366099:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787826821.366118:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787826821.366138:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787826821.366157:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787826821.366169:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787826821.366177:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787826821.366186:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787826821.366195:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787826821.366202:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787826821.366264:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787826821.366286:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787826821.366308:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787826821.366328:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787826821.366344:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787826821.366362:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787826821.366392:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787826821.366411:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787826821.366433:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787826821.366476:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787826821.366491:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787826821.366506:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787826821.366551:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826821.366593:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826821.366620:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826821.366636:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662464 00000100:00100000:2.0:1787826821.366643:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662464 00000100:00100000:2.0:1787826821.366679:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787826821.366687:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826821.366781:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662464:12345-0@lo:502:mount.lustre.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.366788:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787826821.366796:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787826821.366930:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787826821.366952:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787826821.366972:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826821.367007:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826821.367025:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826821.367044:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662592 00000100:00100000:2.0:1787826821.367049:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662592 00000100:00100000:2.0:1787826821.367083:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787826821.367091:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826821.367165:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143662592:12345-0@lo:502:mount.lustre.0 Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.367180:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787826821.367180:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143662592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787826821.367246:0:15879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787826821.367254:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787826821.367691:0:15890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787826821.367705:0:15890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d53437f3370) 00000020:00000080:3.0:1787826821.367727:0:15890:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787826821.367814:0:15890:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787826821.367818:0:15890:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787826821.367820:0:15890:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e5800 3 00010000:00080000:3.0:1787826821.367847:0:15890:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d53444b2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1787826821.369644:0:15890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:3.0:1787826821.369847:0:15890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787826821.369885:0:15890:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826821.369897:0:15890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a7953951 00000100:00080000:3.0:1787826821.369905:0:15890:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826821.369910:0:15890:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d53444b2800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826821.369947:0:15890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e1552c0 x1874672143662720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826821.369975:0:15890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787826821.370010:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143662720:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826821.370070:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826821.370071:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826821.370077:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826821.370080:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826821.370086:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 192 00000100:00080000:2.0:1787826821.370091:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826821.370096:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826821.370100:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143663232:0@lo:400:kworker.0 00000100:00100000:2.0:1787826821.370118:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53434761c0 x1874672143663360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826821.370130:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143662848:0@lo:400:kworker.0 00000100:00100000:3.0:1787826821.370144:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.370169:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826821.370175:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:2.0:1787826821.370176:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826821.370182:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826821.370185:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787826821.370186:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143663104:0@lo:400:kworker.0 00000100:00080000:2.0:1787826821.370205:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 192 00000100:00100000:1.0:1787826821.370206:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143663488:0@lo:400:kworker.0 00000100:00080000:2.0:1787826821.370240:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1787826821.370247:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826821.370249:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826821.370267:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547d2b2d00 x1874672143663872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826821.370274:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143663744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826821.370315:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.370320:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143662976:0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370321:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826821.370331:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143664000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826821.370356:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143663232 00000100:00100000:3.0:1787826821.370362:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143663232 00000100:00100000:2.0:1787826821.370368:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.370378:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.370398:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143663616:0@lo:400:kworker.0 00000100:00100000:0.0:1787826821.370413:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662976 00000100:00100000:0.0:1787826821.370418:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662976 00000100:00100000:1.0:1787826821.370422:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662720 00000100:00100000:3.0:1787826821.370425:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787826821.370429:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662720 00000100:00100000:3.0:1787826821.370437:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5451bcb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143663232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826821.370445:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826821.370458:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787826821.370463:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143662848 00000100:00100000:1.0:1787826821.370467:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143662848 00000100:00100000:0.0:1787826821.370470:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143662976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370494:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143663104 00000100:00100000:1.0:1787826821.370498:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143663104 00000100:00100000:3.0:1787826821.370500:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5451bcb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143663232:12345-0@lo:400:kworker.0 Request processed in 65us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826821.370522:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787826821.370533:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143663744 00000100:00100000:1.0:1787826821.370537:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143663744 00000100:00100000:0.0:1787826821.370551:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143662976:12345-0@lo:400:kworker.0 Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.370558:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787826821.370566:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143663616 00000100:00100000:1.0:1787826821.370571:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143663616 00000100:00100000:2.0:1787826821.370598:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143662976:0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370609:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787826821.370620:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143662848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370684:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143662848:12345-0@lo:400:kworker.0 Request processed in 66us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826821.370693:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787826821.370712:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343475a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143662848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370717:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787826821.370730:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143663104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370771:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143663104:12345-0@lo:400:kworker.0 Request processed in 45us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826821.370786:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787826821.370802:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787826821.370808:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143663744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370841:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143663744:12345-0@lo:400:kworker.0 Request processed in 34us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826821.370848:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787826821.370862:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787826821.370871:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143663616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.370875:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787826821.370883:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1874672143662720:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787826821.370902:0:10060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000100:00100000:3.0:1787826821.370924:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143663616:12345-0@lo:400:kworker.0 Request processed in 53us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826821.370932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000020:00000080:1.0:1787826821.370945:0:10060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a7953958 00000100:00100000:2.0:1787826821.370956:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143663616:0@lo:400:kworker.0 00000004:00100000:1.0:1787826821.370961:0:10060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787826821.370973:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143663104:0@lo:400:kworker.0 00010000:00080000:3.0:1787826821.370989:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d2b30c0 x1874672143663744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826821.370995:0:10060:0:(import.c:65:import_set_state_nolock()) ffff8d546e143000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826821.371014:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143663744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826821.371028:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143663232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.371039:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143662720:12345-0@lo:38:llog_process_th.0 Request processed in 154us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826821.371046:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787826821.371076:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143663488 00000100:00100000:1.0:1787826821.371080:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143663488 00000100:00100000:1.0:1787826821.371111:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143664000 00000100:00100000:1.0:1787826821.371114:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143664000 00000100:00100000:1.0:1787826821.371140:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787826821.371149:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143663488:12345-0@lo:400:kworker.0 00000020:01000004:2.0:1787826821.371156:0:15890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787826821.371169:0:15890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d53444fcd28) 00000020:00000080:2.0:1787826821.371187:0:15890:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:1.0:1787826821.371192:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143663488:12345-0@lo:400:kworker.0 Request processed in 45us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826821.371199:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787826821.371237:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787826821.371246:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143664000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.371290:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143664000:12345-0@lo:400:kworker.0 Request processed in 46us (912us total) trans 0 rc 0/0 00000020:01000004:2.0:1787826821.371295:0:15890:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e5800 from lustre-OST0000, refs=3 00000100:00100000:1.0:1787826821.371299:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000020:01000004:2.0:1787826821.371300:0:15890:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e5800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826821.371304:0:15890:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e5800 3 00010000:00080000:2.0:1787826821.371324:0:15890:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5442bd6000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00000100:00080000:1.0:1787826821.371329:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826821.371334:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826821.371337:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787826821.371362:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d2b0000 x1874672143664000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826821.371372:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143664000:0@lo:400:kworker.0 00000100:00100000:1.0:1787826821.371392:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143663360:0@lo:8:kworker.0 00000100:00100000:1.0:1787826821.371420:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.371444:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143663872:0@lo:8:kworker.0 00000100:00100000:1.0:1787826821.371469:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826821.371490:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826821.371496:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787826821.371502:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787826821.371516:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787826821.371519:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787826821.371525:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143662720:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826821.371547:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143663360 00000100:00100000:1.0:1787826821.371550:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143663360 00000100:00100000:1.0:1787826821.371562:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143663872 00000100:00100000:1.0:1787826821.371563:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143663872 00000100:00100000:1.0:1787826821.371572:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787826821.371576:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143663360:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787826821.371610:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143663360:12345-0@lo:8:kworker.0 Request processed in 33us (190us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826821.371623:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787826821.371635:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826821.371640:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143663872:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787826821.371671:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143663872:12345-0@lo:8:kworker.0 Request processed in 30us (201us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826821.371675:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787826821.371696:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d2b03c0 x1874672143663488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826821.371703:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143663488:0@lo:400:kworker.0 00000100:00080000:1.0:1787826821.371728:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826821.371732:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787826821.371735:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53434761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143663360:0@lo:8:kworker.0 00000100:00080000:1.0:1787826821.371744:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826821.371748:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787826821.371751:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143663872:0@lo:8:kworker.0 00010000:00010000:2.0:1787826821.372902:0:15890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:2.0:1787826821.373070:0:15890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826821.373093:0:15890:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826821.373100:0:15890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a7953966 00000100:00080000:2.0:1787826821.373106:0:15890:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826821.373110:0:15890:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d5442bd6000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826821.373130:0:15890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b10f00 x1874672143664128/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826821.373145:0:15890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1787826821.374383:0:15890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787826821.374630:0:15879:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787826821.374674:0:15879:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826821.374691:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.374704:0:15879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826821.374753:0:15879:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787826821.374755:0:15879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826821.374757:0:15879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826821.374763:0:15879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826821.374764:0:15879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826821.374765:0:15879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826821.374766:0:15879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826821.374767:0:15879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826821.374768:0:15879:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826821.374772:0:15879:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787826821.374774:0:15879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826821.374775:0:15879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826821.374775:0:15879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826821.374776:0:15879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826821.374777:0:15879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826821.374778:0:15879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826821.374779:0:15879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826821.374779:0:15879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826821.374780:0:15879:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826821.374793:0:15879:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787826821.374803:0:15879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b10780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143664256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826821.374855:0:15879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826821.374885:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143664256 00000100:00100000:2.0:1787826821.374891:0:15879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826821.374892:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143664256 00000100:00100000:0.0:1787826821.374942:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787826821.374952:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143664256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826821.374979:0:9479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787826821.374990:0:9479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787826821.375318:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143664128:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826821.375357:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.375397:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143664128 00000100:00100000:2.0:1787826821.375402:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143664128 00000100:00100000:2.0:1787826821.375431:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826821.375436:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54532692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3615:x1874672143664128:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787826821.375455:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:2.0:1787826821.375485:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a795396d 00000004:00100000:2.0:1787826821.375499:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826821.375535:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826821.375583:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54532692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143664128:12345-0@lo:38:llog_process_th.0 Request processed in 145us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.375590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787826821.375614:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b10f00 x1874672143664128/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826821.375625:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826821.375631:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787826821.375638:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787826821.375642:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787826821.375644:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787826821.375657:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143664128:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787826821.377832:0:9479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826821.377845:0:9479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787826821.377867:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826821.377872:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826821.377890:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.377904:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.377911:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.377917:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.377923:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.377944:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 9 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.377954:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 9 pid: 9479 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826821.377962:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143664384:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787826821.378032:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826821.378034:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:15879:x1874672143664256:12345-0@lo:253:mount.lustre.0 Request processed in 3080us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.378048:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:3.0:1787826821.378054:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826821.378066:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143664512:0@lo:104: 00000100:00100000:1.0:1787826821.378072:0:15879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b10780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:15879:1874672143664256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787826821.378084:0:15879:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787826821.378087:0:15879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826821.378089:0:15879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826821.378090:0:15879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826821.378091:0:15879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826821.378092:0:15879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826821.378095:0:15879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826821.378098:0:15879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:3.0:1787826821.378098:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1787826821.378100:0:15879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826821.378101:0:15879:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787826821.378111:0:15879:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787826821.378125:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143664512 00000100:00100000:2.0:1787826821.378132:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143664512 00010000:00010000:3.0:1787826821.378133:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.378145:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826821.378155:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143664640:0@lo:104: 00000100:00100000:2.0:1787826821.378171:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787826821.378181:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e157c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143664512:12345-0@lo:104: 00000100:00100000:3.0:1787826821.378187:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826821.378197:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826821.378212:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143664640 00000100:00100000:0.0:1787826821.378233:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143664640 00000100:00100000:0.0:1787826821.378263:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787826821.378271:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143664640:12345-0@lo:104: 00010000:00010000:0.0:1787826821.378281:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826821.378285:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826821.378305:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143664512:0@lo:104: 00010000:00010000:2.0:1787826821.378310:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826821.378318:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e157c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143664512:12345-0@lo:104: Request processed in 139us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.378326:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787826821.378337:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143664640:0@lo:104: 00010000:00010000:0.0:1787826821.378338:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787826821.378347:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143664640:12345-0@lo:104: Request processed in 77us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826821.378354:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1787826821.378378:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826821.378383:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378391:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350f600 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826821.378395:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378414:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826821.378422:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826821.378427:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826821.378458:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378473:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826821.378495:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378503:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d534350f600/0xc0fefc09a79537fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953801 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826821.378506:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787826821.378528:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787826821.378530:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143664768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826821.378533:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378542:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d534350e400 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826821.378545:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378553:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826821.378560:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826821.378561:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787826821.378573:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787826821.378586:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143664768 00000100:00100000:2.0:1787826821.378590:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143664768 00010000:00010000:2.0:1787826821.378606:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378611:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378618:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826821.378631:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00010000:00010000:0.0:1787826821.378636:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826821.378641:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143664768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826821.378655:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826821.378657:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d534350e400/0xc0fefc09a79537ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79537f3 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.378662:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.378674:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378676:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826821.378679:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826821.378683:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826821.378687:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350f800/0xc0fefc09a7953801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79537fa expref: 24 pid: 9479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826821.378691:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826821.378704:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143664896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826821.378710:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826821.378742:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3617:x1874672143664768:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.378749:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826821.378753:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826821.378769:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143664896 00000100:00100000:2.0:1787826821.378772:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143664896 00010000:00010000:2.0:1787826821.378783:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826821.378792:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143664768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826821.378800:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787826821.378807:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3617:x1874672143664896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826821.378813:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826821.378815:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.378821:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.378830:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a79537f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79537ec expref: 23 pid: 6479 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.378836:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826821.378856:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3617:x1874672143664896:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.378863:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826821.378876:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143664896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826821.379411:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143664384:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787826821.379429:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826821.379664:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826821.379702:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155392 00000100:00100000:2.0:1787826821.379708:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155392 00010000:00010000:2.0:1787826821.379725:0:13703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 10 pid: 9479 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826821.379759:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00100000:2.0:1787826821.379765:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134155392:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826821.379773:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826821.379778:0:13703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 10 pid: 9479 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379788:0:13703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 10 pid: 9479 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379799:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d534350fc00/0xc0fefc09a7953808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673d2 expref: 10 pid: 9479 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379810:0:13703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379817:0:13703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826821.379828:0:13703:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001957148s 00010000:00010000:2.0:1787826821.379831:0:13703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379836:0:13703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379840:0:13703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379844:0:13703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379852:0:13703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148ea00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826821.379855:0:13703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379861:0:13703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379875:0:13703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826821.379886:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826821.379888:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.379898:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826821.379912:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544148ea00/0xc0fefc09a7953974 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826821.379929:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+9:2391:x1874672134155392:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 162us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826821.379936:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 47 00010000:00080000:2.0:1787826821.382893:0:15879:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 8589934593 00010000:00080000:0.0:1787826821.383840:0:15896:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 15896 00010000:00080000:0.0:1787826821.383854:0:15896:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787826821.383857:0:15896:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:2.0:1787826821.383901:0:15879:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826821.383938:0:15879:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826821.383958:0:15879:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787826821.383973:0:15879:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787826821.384982:0:15879:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826821.385285:0:15879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787826821.705898:0:15945:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826821.706098:0:15945:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787826822.353653:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826822.545364:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826822.545405:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155904 00000100:00100000:0.0:1787826822.545409:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826822.545415:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155904 00000100:00100000:1.0:1787826822.545455:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:1.0:1787826822.545463:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134155904:12345-192.168.203.6@tcp:8:kworker.0 00010000:00080000:1.0:1787826822.545492:0:10061:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d534260f000, cookie 0xc0fefc09a7953927 00010000:00080000:1.0:1787826822.545511:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t8589934593 exp ffff8d534260f000 cur 197 last 1787826821 00000100:00100000:0.0:1787826822.545513:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:02000400:1.0:1787826822.545522:0:10061:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:0.0:1787826822.545540:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826822.545565:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826822.545587:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134156032 00000100:00100000:0.0:1787826822.545591:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134156032 00000100:00100000:0.0:1787826822.545635:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:0.0:1787826822.545644:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134156032:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826822.545705:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134156032:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 62us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826822.545712:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:0.0:1787826822.545819:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155776 00000100:00100000:0.0:1787826822.545824:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155776 00000100:00100000:0.0:1787826822.545856:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155648 00000100:00100000:0.0:1787826822.545859:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155648 00000100:00100000:0.0:1787826822.545885:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00100000:0.0:1787826822.545905:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134155776:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826822.545942:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134155776:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826822.545950:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00100000:0.0:1787826822.545967:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 144 00000100:00100000:0.0:1787826822.545989:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f731680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134155648:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826822.546015:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f731680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134155648:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826822.546022:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 144 00000100:00080000:0.0:1787826822.546113:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826822.546117:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826822.546126:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826822.546314:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134155520 00000100:00100000:3.0:1787826822.546319:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134155520 00000100:00100000:3.0:1787826822.546349:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 350 00000100:00100000:3.0:1787826822.546356:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134155520:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826822.546393:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134155520:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826822.546400:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 350 00010000:00080000:1.0:1787826822.549798:0:10061:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:1.0:1787826822.549821:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d534260f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 28672 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787826822.549830:0:10061:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787826822.549944:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d534260b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826822.550010:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134155904:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 4546us (4652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826822.550018:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:0.0:1787826822.553291:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826822.553321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826822.553333:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134156160 00000100:00100000:1.0:1787826822.553343:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134156160 00000100:00100000:2.0:1787826822.553352:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134156288 00000100:00100000:2.0:1787826822.553359:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134156288 00000100:00100000:1.0:1787826822.553396:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:1.0:1787826822.553409:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134156160:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787826822.553410:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:3.0:1787826822.553423:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134156288:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787826822.553431:0:8399:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547f74f0c0 x1874672134156160/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:423/0 lens 328/0 e 0 to 0 dl 1787826833 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826822.553435:0:8402:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547f74e1c0 x1874672134156288/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:423/0 lens 328/0 e 0 to 0 dl 1787826833 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826822.553483:0:15896:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1787826822.553488:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134156288:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 66us (163us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826822.553489:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134156160:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 80us (198us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826822.553514:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:3.0:1787826822.553522:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:1.0:1787826822.673153:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826822.673191:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134156416 00000100:00100000:1.0:1787826822.673198:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134156416 00000100:00100000:1.0:1787826822.673268:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 351 00000100:00100000:1.0:1787826822.673277:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+9:10866:x1874672134156416:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826822.673292:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826822.673309:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346741f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826822.673334:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826822.673345:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826822.673353:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7600, rc 0) 00000100:00100000:1.0:1787826822.673404:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134156416:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 128us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826822.673420:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 351 00000100:00100000:0.0:1787826822.674170:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826822.674235:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134156544 00000100:00100000:1.0:1787826822.674241:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134156544 00000100:00100000:1.0:1787826822.674280:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 352 00000100:00100000:1.0:1787826822.674290:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134156544:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826822.674307:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787826822.674324:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826822.674328:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787826822.674945:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134156544:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 656us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826822.674954:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 352 00000100:00100000:2.0:1787826823.249345:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143665024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826823.249347:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826823.249362:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143665280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826823.249408:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826823.249412:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.249465:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143665152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826823.249487:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665024 00000100:00100000:2.0:1787826823.249487:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665280 00000100:00100000:1.0:1787826823.249507:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665024 00000100:00100000:2.0:1787826823.249507:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665280 00000100:00100000:3.0:1787826823.249507:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.249553:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665152 00000100:00100000:3.0:1787826823.249557:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665152 00000100:00100000:1.0:1787826823.249558:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826823.249559:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787826823.249572:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143665024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826823.249577:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143665280:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787826823.249604:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787826823.249605:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1787826823.249605:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787826823.249664:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143665024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826823.249672:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826823.249673:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143665280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826823.249684:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787826823.249696:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787826823.249697:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b11680 x1874672143665024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826823.249708:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143665152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826823.249722:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826823.249730:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143665024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826823.249731:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143665280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826823.249763:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143665152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826823.249769:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787826823.249779:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5341f60000 x1874672143665152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826823.249788:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143665152:0@lo:13:osp-pre-1-1.0 10000000:01000000:3.0:1787826823.313864:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826823.313869:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 8 10000000:01000000:3.0:1787826823.313872:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826823.313909:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826823.313919:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826823.313931:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826823.313954:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826823.314007:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826823.314041:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665408 00000100:00100000:3.0:1787826823.314042:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826823.314048:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665408 00000100:00100000:0.0:1787826823.314089:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787826823.314097:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143665408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826823.314107:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826823.314117:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953982 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.314136:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.314145:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.314151:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1200, rc 0) 00000100:00100000:0.0:1787826823.314183:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143665408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826823.314189:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787826823.314226:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826823.314238:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826823.314244:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826823.314289:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787826823.314316:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.314339:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826823.314355:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665536 00000100:00100000:2.0:1787826823.314362:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665536 00000100:00100000:2.0:1787826823.314395:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787826823.314403:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143665536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826823.314418:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826823.314433:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826823.314437:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787826823.314543:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143665536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826823.314551:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787826823.314557:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665536:0@lo:256:ll_cfg_requeue.0 00000100:00080000:3.0:1787826823.314595:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 9, was 0): DISCONN 00010000:00080000:3.0:1787826823.314603:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:3.0:1787826823.314607:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826823.314611:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826823.314628:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5341f60780 x1874672143665664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1787826823.314672:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:0.0:1787826823.314677:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143665664:0@lo:8:ll_cfg_requeue.0 00010000:00010000:3.0:1787826823.314679:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826823.314688:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826823.314694:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826823.314696:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 8 10000000:01000000:3.0:1787826823.314698:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826823.314712:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826823.314717:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826823.314722:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826823.314728:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826823.314745:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826823.314774:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826823.314776:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665664 00000100:00100000:2.0:1787826823.314783:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665664 00000100:00100000:3.0:1787826823.314792:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826823.314806:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665792 00000100:00100000:0.0:1787826823.314815:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665792 00000100:00100000:2.0:1787826823.314817:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787826823.314825:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143665664:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826823.314844:0:10061:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d5448684800, cookie 0xc0fefc09a7953919 00010000:00080000:2.0:1787826823.314850:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5448684800 cur 198 last 1787826821 00000100:00100000:0.0:1787826823.314853:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787826823.314861:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143665792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826823.314867:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1787826823.314868:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d5448684800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00010000:00010000:0.0:1787826823.314874:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953990 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787826823.314875:0:10061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787826823.314879:0:10061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:0.0:1787826823.314888:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.314896:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.314901:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0600, rc 0) 00000100:00100000:0.0:1787826823.314933:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143665792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826823.314938:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787826823.314978:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826823.314998:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826823.315006:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826823.315042:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665920:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1787826823.315060:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826823.315077:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.315098:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826823.315114:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143665920 00000100:00100000:2.0:1787826823.315117:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143665664:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 290us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826823.315120:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143665920 00000100:00100000:2.0:1787826823.315128:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826823.315156:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787826823.315165:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143665920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826823.315176:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826823.315188:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826823.315191:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787826823.315295:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143665920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826823.315303:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787826823.315309:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143665920:0@lo:256:ll_cfg_requeue.0 00000100:00080000:3.0:1787826823.315341:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 9, was 0): DISCONN 00010000:00080000:0.0:1787826823.315347:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5341f60780 x1874672143665664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826823.315348:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:3.0:1787826823.315354:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826823.315363:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00080000:0.0:1787826823.315380:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00100000:3.0:1787826823.315380:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e1561c0 x1874672143666048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826823.315391:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787826823.315397:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1787826823.315400:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:0.0:1787826823.315403:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 10000000:01000000:3.0:1787826823.315405:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00080000:0.0:1787826823.315407:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00010000:3.0:1787826823.315411:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826823.315424:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826823.315606:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143665664:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787826823.315618:0:16211:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1787826823.315622:0:16211:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00000100:00100000:0.0:1787826823.315624:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143666048:0@lo:8:ll_cfg_requeue.0 00010000:00010000:3.0:1787826823.315633:0:16211:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1787826823.315653:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826823.315678:0:16211:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1787826823.315692:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666048 00000100:00100000:2.0:1787826823.315698:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666048 00000100:00100000:0.0:1787826823.315719:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143666176:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1787826823.315730:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787826823.315737:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143666048:12345-0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1787826823.315752:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787826823.315754:0:8401:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d534260e800, cookie 0xc0fefc09a7953920 00010000:00080000:2.0:1787826823.315761:0:8401:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d534260e800 cur 198 last 1787826821 00002000:00100000:2.0:1787826823.315772:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d534260e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1787826823.315774:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666176 00002000:00080000:2.0:1787826823.315777:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:3.0:1787826823.315778:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666176 00002000:00100000:2.0:1787826823.315781:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1787826823.315805:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826823.315814:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787826823.315825:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143666176:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787826823.315839:0:8402:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f74cf00 x1874672143666176/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:424/0 lens 224/0 e 0 to 0 dl 1787826834 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826823.315852:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143666176:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 30us (103us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826823.315860:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787826823.315866:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143666048:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 126us (210us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826823.315871:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e1561c0 x1874672143666048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826823.315878:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787826823.315883:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00010000:00080000:3.0:1787826823.315889:0:15896:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00080000:0.0:1787826823.315891:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787826823.315896:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00010000:00080000:3.0:1787826823.315896:0:15896:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 8589934594 00000100:00100000:0.0:1787826823.315899:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00010000:00080000:3.0:1787826823.315902:0:15896:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589934594 00000100:00080000:0.0:1787826823.315904:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 4294967299 last 0 00000100:00080000:0.0:1787826823.315909:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:3.0:1787826823.315909:0:15896:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589934594 00000100:00100000:1.0:1787826823.316018:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143666048:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826823.316029:0:16212:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1787826823.316033:0:16212:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1787826823.316036:0:16212:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1787826823.316068:0:16212:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787826823.316130:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143666304:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787826823.316151:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.316187:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666304 00000100:00100000:3.0:1787826823.316191:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666304 00000100:00100000:3.0:1787826823.316242:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787826823.316252:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143666304:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787826823.316262:0:10061:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d5453268780 x1874672143666304/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:424/0 lens 224/0 e 0 to 0 dl 1787826834 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826823.316287:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143666304:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (133us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826823.316294:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787826823.316546:0:15896:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 8589934594 00010000:00080000:0.0:1787826823.316550:0:15896:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1787826823.316555:0:15896:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826823.316557:0:15896:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826823.316564:0:15896:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547f74f0c0 x1874672134156160/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:423/0 lens 328/0 e 0 to 0 dl 1787826833 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826823.316575:0:15896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826823.316593:0:15896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a795399e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467418 expref: -99 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.316610:0:15896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a795399e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 7 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.316625:0:15896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a795399e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 7 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.316633:0:15896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0000, rc 0) 00010000:00080000:0.0:1787826823.316678:0:15896:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826823.316687:0:15896:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826823.316688:0:15896:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826823.316694:0:15896:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547f74e1c0 x1874672134156288/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:423/0 lens 328/0 e 0 to 0 dl 1787826833 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826823.316703:0:15896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826823.316716:0:15896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34673f5 expref: -99 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.316730:0:15896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.316748:0:15896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826823.316755:0:15896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1e00, rc 0) 00010000:00080000:0.0:1787826823.316777:0:15896:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826823.316783:0:15896:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1787826823.317988:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826823.318080:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134156672 00000100:00100000:1.0:1787826823.318087:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134156672 00000100:00100000:1.0:1787826823.318125:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:1.0:1787826823.318134:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2389:x1874672134156672:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1787826823.318145:0:9498:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f74e940 x1874672134156672/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:424/0 lens 224/0 e 0 to 0 dl 1787826834 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826823.318162:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2389:x1874672134156672:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 Request processed in 31us (178us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826823.318168:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 64 00010000:00080000:0.0:1787826823.318180:0:15896:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1787826823.318538:0:15896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00100000:3.0:1787826823.319908:0:15880:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:3.0:1787826823.319915:0:15880:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787826823.319918:0:15880:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:0.0:1787826823.320121:0:15896:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:0.0:1787826823.320130:0:15896:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d547f74cf00 x1874672143666176/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:424/0 lens 224/0 e 0 to 0 dl 1787826834 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826823.320206:0:15896:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d5453268780 x1874672143666304/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:424/0 lens 224/0 e 0 to 0 dl 1787826834 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826823.320274:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826823.320281:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d546e154b40 x1874672143666176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826839 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826823.320292:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d546e154b40 x1874672143666176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826839 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826823.320299:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1787826823.320314:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1787826823.320318:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826823.320383:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143666560:0@lo:7:osp-pre-0-1.0 00010000:00080000:0.0:1787826823.320385:0:15896:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d547f74e940 x1874672134156672/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:424/0 lens 224/0 e 0 to 0 dl 1787826834 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787826823.320431:0:15896:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:3.0:1787826823.320435:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.320461:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826823.320477:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143666432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826823.320514:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.320558:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.320581:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666560 00000100:00100000:3.0:1787826823.320585:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666560 00000100:00100000:3.0:1787826823.320619:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787826823.320626:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143666560:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787826823.320784:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666432 00000100:00100000:3.0:1787826823.320789:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666432 00000100:00100000:3.0:1787826823.320807:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656320 00000100:00100000:3.0:1787826823.320809:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656320 00000100:00100000:3.0:1787826823.320820:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826823.320826:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1874672143666432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826823.320843:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 28672 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787826823.320881:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1874672143666432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826823.320889:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826823.320911:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787826823.320918:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143656320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826823.320928:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 28672 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787826823.320958:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143656320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826823.320964:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787826823.321018:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143656320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826823.321051:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143666432:0@lo:13:osp-pre-0-1.0 00002000:00080000:3.0:1787826823.322105:0:8401:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787826823.322110:0:8401:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787826823.322150:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143666560:12345-0@lo:7:osp-pre-0-1.0 Request processed in 1524us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826823.322158:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787826823.322189:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143666560:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787826823.322198:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787826823.323979:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143666176:0@lo:400:ldlm_lock_repla.0 00000100:00080000:2.0:1787826823.324026:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826823.324035:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d547f74f840 x1874672143666304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826839 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826823.324044:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d547f74f840 x1874672143666304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826839 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826823.324051:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1787826823.324076:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1787826823.324080:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1787826823.324086:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000084d4e318): req@ffff8d547d36f480 x1874672143656448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787826825 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826823.324101:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143666304:0@lo:400:ldlm_lock_repla.0 00000004:00080000:3.0:1787826823.324150:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 198186933909ns, next at 199186931495ns, rc = 0 00000100:00100000:3.0:1787826823.324188:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143666944:0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787826823.324265:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.324265:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.324294:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826823.324313:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143666688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826823.324337:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.324357:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826823.324363:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143666816:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826823.324385:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826823.324427:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666944 00000100:00100000:3.0:1787826823.324441:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666944 00000100:00100000:3.0:1787826823.324482:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666816 00000100:00100000:3.0:1787826823.324486:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666816 00000100:00100000:1.0:1787826823.324510:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787826823.324523:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143666944:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1787826823.324530:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787826823.324535:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143656448 00000100:00100000:2.0:1787826823.324539:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143656448 00000100:00100000:3.0:1787826823.324541:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143666816:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826823.324560:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143666688 00002000:00080000:3.0:1787826823.324561:0:10061:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:2.0:1787826823.324563:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143666688 00000100:00100000:2.0:1787826823.324581:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787826823.324589:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3617:x1874672143656448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826823.324603:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 28672 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787826823.324650:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3617:x1874672143656448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826823.324657:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787826823.324675:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826823.324682:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1874672143666688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826823.324693:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 28672 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787826823.324732:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1874672143666688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826823.324742:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787826823.324757:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143666688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826823.324795:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143656448:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787826823.325773:0:9498:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787826823.325779:0:9498:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:1.0:1787826823.325830:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143666944:12345-0@lo:7:osp-pre-0-0.0 Request processed in 1311us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826823.325838:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00002000:00010000:1.0:1787826823.325906:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 2123, mtime: 0x6a901275, atime: 0x0, ctime: 0x6a901275, blocks: 0x8 00010000:00010000:1.0:1787826823.325915:0:10061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.325932:0:10061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 6 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.325952:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=198s v=(0 0) 00010000:00010000:1.0:1787826823.325956:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826823.325961:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.325989:0:10061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 6 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.326003:0:10061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 6 pid: 15896 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826823.326014:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10061:1874672143667072:192.168.203.6@tcp:104: 00000100:00100000:1.0:1787826823.326064:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e1d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826823.326150:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143666944:0@lo:7:osp-pre-0-0.0 00000004:00080000:3.0:1787826823.326157:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x21:0x0] 00000100:00100000:2.0:1787826823.327046:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10061:1874672143667072:192.168.203.6@tcp:104: 00010000:00010000:2.0:1787826823.327063:0:10061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826823.327299:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826823.327334:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134156800 00000100:00100000:1.0:1787826823.327340:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134156800 00010000:00010000:1.0:1787826823.327368:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 15896 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826823.327401:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:1.0:1787826823.327411:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134156800:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826823.327422:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826823.327428:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 15896 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.327454:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 15896 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.327476:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729423f6/0xc0fefc09a79539a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673f5 expref: 7 pid: 15896 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.327488:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826823.327492:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826823.327513:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.327522:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.327546:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826823.327562:0:10061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826823.327572:0:10061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826823.327581:0:10061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826823.327587:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134156800:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 170us (280us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826823.327594:0:10061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826823.327601:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 48 00010000:00010000:2.0:1787826823.327620:0:10061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826823.327762:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143666816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3224us (3375us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787826823.327771:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1787826823.327780:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d5343b13c00/2, rc 0, transno 12884901889 00000100:00100000:1.0:1787826823.327787:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143666816:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826823.328271:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826823.328278:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.328287:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7a00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826823.328299:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.328310:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.328322:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.328330:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a79539ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826823.328347:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826823.328349:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826823.328351:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826823.330766:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826823.330802:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826823.330808:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153856 00000100:00100000:2.0:1787826823.330816:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153856 00000100:00100000:1.0:1787826823.330837:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134153728 00000100:00100000:1.0:1787826823.330842:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134153728 00000100:00100000:2.0:1787826823.330869:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 63 00002000:00100000:1.0:1787826823.330876:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->28) req@ffff8d546e156940 x1874672134153728/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:424/0 lens 520/0 e 0 to 0 dl 1787826834 ref 1 fl New:/602/ffffffff rc 0/-1 job:'date.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787826823.330881:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2392:x1874672134153856:12345-192.168.203.6@tcp:16:kworker.0 00002000:00100000:1.0:1787826823.330893:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e156940 with x1874672134153728 ext(0->28) 00002000:00010000:1.0:1787826823.330914:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e156940 00000100:00100000:1.0:1787826823.330938:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:1.0:1787826823.330947:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2393:x1874672134153728:12345-192.168.203.6@tcp:4:date.0 00002000:00080000:0.0:1787826823.330953:0:15896:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787826823.330959:0:15896:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:2.0:1787826823.331339:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2392:x1874672134153856:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 461us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826823.331350:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:1.0:1787826823.331975:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134153728:12345-192.168.203.6@tcp:4:date.0 Request processed in 1028us (1171us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787826823.331992:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 2 00002000:00100000:1.0:1787826823.332001:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->28) req@ffff8d546e156940 x1874672134153728/t12884901890(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:424/0 lens 520/448 e 0 to 0 dl 1787826834 ref 1 fl Complete:/602/0 rc 0/0 job:'date.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826823.332008:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e156940 with x1874672134153728 ext(0->28) 00002000:00010000:1.0:1787826823.332013:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e156940 00010000:00010000:1.0:1787826823.377396:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826823.386561:0:16236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1787826823.710013:0:16288:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826823.710243:0:16288:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1787826824.029378:0:16338:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826824.029604:0:16338:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787826824.274454:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143667200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826824.274559:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826824.274631:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143667200 00000100:00100000:0.0:1787826824.274642:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143667200 00000100:00100000:0.0:1787826824.274699:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826824.274733:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143667200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826824.274767:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826824.274851:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143667200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826824.274858:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787826824.274966:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143667200:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826824.401784:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826825.345400:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826825.345465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134157184 00000100:00100000:2.0:1787826825.345493:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134157184 00000100:00080000:3.0:1787826825.345554:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826825.345557:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 53 00000100:00100000:2.0:1787826825.345571:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:13118:x1874672134157184:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787826825.345602:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826825.345661:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:13118:x1874672134157184:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 93us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826825.345673:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 53 00000100:00100000:3.0:1787826825.346538:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826825.346590:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134157312 00000100:00100000:0.0:1787826825.346595:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134157312 00000100:00100000:0.0:1787826825.346646:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 54 00000100:00080000:3.0:1787826825.346655:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826825.346656:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13118:x1874672134157312:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787826825.346678:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826825.346727:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13118:x1874672134157312:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826825.346735:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 54 00000100:00100000:0.0:1787826825.348244:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826825.348298:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134157440 00000100:00100000:3.0:1787826825.348304:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134157440 00000100:00080000:0.0:1787826825.348348:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826825.348363:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:3.0:1787826825.348373:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+8:13118:x1874672134157440:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826825.348397:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 308672 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787826825.348462:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+8:13118:x1874672134157440:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826825.348469:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:1.0:1787826825.349296:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826825.349344:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134157568 00000100:00100000:2.0:1787826825.349349:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134157568 00000100:00080000:0.0:1787826825.349391:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826825.349394:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 84 00000100:00100000:2.0:1787826825.349406:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13118:x1874672134157568:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826825.349426:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826825.349476:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13118:x1874672134157568:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826825.349495:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 84 00010000:00010000:3.0:1787826825.425350:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826826.449305:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826826.833443:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143667328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833459:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143667456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826826.833534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826826.833535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826826.833556:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143667712:0@lo:400:kworker.0 00000100:00100000:0.0:1787826826.833581:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143667584:0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.833590:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826826.833612:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143667840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833613:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143667968:0@lo:400:kworker.0 00000100:00100000:0.0:1787826826.833624:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826826.833626:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143668224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826826.833667:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143668096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833672:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826826.833673:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826826.833679:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826826.833719:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826826.833725:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143668480:0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.833726:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143668736:0@lo:400:kworker.0 00000100:00100000:2.0:1787826826.833727:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143668352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826826.833743:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143668608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833773:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826826.833778:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826826.833798:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143667456 00000100:00100000:0.0:1787826826.833799:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143667712 00000100:00100000:3.0:1787826826.833804:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143667456 00000100:00100000:0.0:1787826826.833805:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143667712 00000100:00100000:2.0:1787826826.833817:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143668864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833836:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143667968 00000100:00100000:1.0:1787826826.833842:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143667968 00000100:00100000:2.0:1787826826.833846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826826.833851:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668224 00000100:00100000:3.0:1787826826.833855:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668224 00000100:00100000:0.0:1787826826.833858:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668352 00000100:00100000:0.0:1787826826.833872:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668352 00000100:00100000:2.0:1787826826.833880:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143667328 00000100:00100000:3.0:1787826826.833884:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668864 00000100:00100000:2.0:1787826826.833885:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143667328 00000100:00100000:3.0:1787826826.833888:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668864 00000100:00100000:1.0:1787826826.833898:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668096 00000100:00100000:1.0:1787826826.833904:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668096 00000100:00100000:0.0:1787826826.833919:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787826826.833924:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787826826.833925:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787826826.833930:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143667456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833938:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668480 00000100:00100000:3.0:1787826826.833938:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143667712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833945:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668480 00000100:00100000:2.0:1787826826.833945:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143667328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.833971:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787826826.833980:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143667968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.833999:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143667712:12345-0@lo:400:kworker.0 Request processed in 64us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826826.834007:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787826826.834019:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143667328:12345-0@lo:400:kworker.0 Request processed in 75us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826826.834020:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143667456:12345-0@lo:400:kworker.0 Request processed in 89us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826826.834029:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787826826.834032:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787826826.834036:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143667968:12345-0@lo:400:kworker.0 Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826826.834041:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787826826.834046:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143668224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.834058:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826826.834060:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143667584 00000100:00100000:0.0:1787826826.834064:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787826826.834065:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143667584 00000100:00100000:0.0:1787826826.834075:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143668352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.834082:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787826826.834093:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143668096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826826.834095:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143667840 00000100:00100000:2.0:1787826826.834099:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143667840 00000100:00100000:3.0:1787826826.834106:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143668224:12345-0@lo:400:kworker.0 Request processed in 63us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826826.834114:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787826826.834120:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787826826.834121:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143668352:12345-0@lo:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826826.834130:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787826826.834132:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143667584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.834149:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787826826.834154:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143668096:12345-0@lo:400:kworker.0 Request processed in 63us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826826.834160:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143668864:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826826.834163:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826826.834165:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787826826.834169:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826826.834172:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826826.834175:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826826.834181:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143667584:12345-0@lo:400:kworker.0 Request processed in 52us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826826.834192:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787826826.834193:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787826826.834194:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826826.834207:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143668480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.834212:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143668864:12345-0@lo:400:kworker.0 Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826826.834241:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787826826.834245:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787826826.834252:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143667840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.834273:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143668480:12345-0@lo:400:kworker.0 Request processed in 69us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826826.834282:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787826826.834291:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143667840:12345-0@lo:400:kworker.0 Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826826.834298:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787826826.834301:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668608 00000100:00100000:3.0:1787826826.834306:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668608 00000100:00100000:0.0:1787826826.834318:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143667584:0@lo:400:kworker.0 00010000:00080000:0.0:1787826826.834336:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533e6940 x1874672143668096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826826.834343:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143667968:0@lo:400:kworker.0 00000100:00100000:0.0:1787826826.834353:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143668096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.834356:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787826826.834363:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143668480:0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.834369:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143668608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826826.834384:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143667456:0@lo:400:kworker.0 00000100:00080000:0.0:1787826826.834385:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826826.834418:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826826.834426:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143668608:12345-0@lo:400:kworker.0 Request processed in 60us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826826.834434:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787826826.834440:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668736 00000100:00100000:0.0:1787826826.834446:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668736 00010000:00080000:1.0:1787826826.834450:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343ac6940 x1874672143668608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826826.834462:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143668608:0@lo:400:kworker.0 00000100:00100000:2.0:1787826826.834468:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143667712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.834495:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143667840:0@lo:400:kworker.0 00000100:00100000:2.0:1787826826.834508:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143668224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826826.834509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1787826826.834512:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787826826.834519:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533e4000 x1874672143668352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826826.834524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143668736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.834539:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143668352:0@lo:400:kworker.0 00010000:00080000:3.0:1787826826.834560:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343ac4000 x1874672143668864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826826.834570:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143668864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826826.834580:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143667328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826826.834591:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143668736:12345-0@lo:400:kworker.0 Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826826.834609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787826826.834619:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143668736:0@lo:400:kworker.0 00000001:02000400:2.0:1787826827.276782:0:16530:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:1.0:1787826827.473428:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826827.665357:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826827.665401:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826827.665418:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134157696 00000100:00100000:3.0:1787826827.665435:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134157696 00000100:00100000:1.0:1787826827.665440:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826827.665481:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826827.665518:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 358 00000100:00100000:1.0:1787826827.665525:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826827.665531:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134157696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826827.665609:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134157952 00000100:00100000:2.0:1787826827.665611:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134158208 00000100:00100000:2.0:1787826827.665619:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134158208 00000100:00100000:1.0:1787826827.665620:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134157952 00000100:00100000:0.0:1787826827.665625:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134158080 00000100:00100000:3.0:1787826827.665632:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134157696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 101us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826827.665633:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134158080 00000100:00100000:3.0:1787826827.665644:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 358 00000100:00100000:2.0:1787826827.665702:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:1.0:1787826827.665711:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134157824 00000100:00100000:1.0:1787826827.665719:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134157824 00000100:00100000:0.0:1787826827.665720:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:2.0:1787826827.665720:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134158208:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826827.665721:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:0.0:1787826827.665736:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134158080:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826827.665742:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134157952:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826827.665780:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134158208:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 67us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826827.665781:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 152 00000100:00100000:0.0:1787826827.665791:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134158080:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826827.665799:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134157952:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 57us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826827.665812:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134157824:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826827.665813:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:0.0:1787826827.665832:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:3.0:1787826827.665833:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00080000:3.0:1787826827.665888:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826827.665897:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134157824:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 93us (413us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826827.665898:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826827.665904:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826827.665915:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826827.665916:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 152 00000001:02000400:3.0:1787826827.914980:0:16578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1787826828.369440:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143668992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826828.369441:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143669120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826828.369469:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143669376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826828.369528:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826828.369528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143669248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826828.369552:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826828.369568:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143668992 00000100:00100000:3.0:1787826828.369576:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143668992 00000100:00100000:2.0:1787826828.369602:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826828.369620:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143669504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826828.369634:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143669248 00000100:00100000:3.0:1787826828.369639:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143669248 00000100:00100000:1.0:1787826828.369645:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143669120 00000100:00100000:1.0:1787826828.369653:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143669120 00000100:00100000:0.0:1787826828.369659:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826828.369667:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143669504 00000100:00100000:3.0:1787826828.369673:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143669504 00000100:00100000:2.0:1787826828.369704:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787826828.369709:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826828.369724:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143668992:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826828.369729:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826828.369735:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787826828.369747:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787826828.369752:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143669120:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1787826828.369761:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787826828.369765:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826828.369770:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:1.0:1787826828.369790:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826828.369820:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143668992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826828.369830:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787826828.369859:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143669376 00000100:00100000:1.0:1787826828.369865:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143669120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826828.369867:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143669376 00000100:00100000:1.0:1787826828.369880:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1787826828.369908:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343ac6d00 x1874672143668992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826828.369915:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787826828.369934:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143668992:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787826828.369958:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826828.369961:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143669120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826828.370005:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143669248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826828.370027:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 308672 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787826828.370106:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826828.370115:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143669504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826828.370125:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 308672 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787826828.370168:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143669504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826828.370187:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787826828.370202:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143669248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 270us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826828.370253:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143669248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826828.370257:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143669504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826828.370287:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787826828.370297:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787826828.370313:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143669376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826828.370328:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826828.370380:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143669376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826828.370392:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1787826828.370422:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b13480 x1874672143669376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826828.370437:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143669376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826828.497406:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826828.882482:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1787826828.882884:0:15880:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00080000:3.0:1787826828.882892:0:15880:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000100:00100000:0.0:1787826829.236063:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826829.236137:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134158336 00000100:00100000:2.0:1787826829.236146:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134158336 00000100:00080000:0.0:1787826829.236206:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826829.236248:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:3.0:1787826829.236261:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:13586:x1874672134158336:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787826829.236311:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826829.236387:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:13586:x1874672134158336:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826829.236395:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:2.0:1787826829.237522:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826829.237576:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134158464 00000100:00100000:3.0:1787826829.237582:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134158464 00000100:00080000:0.0:1787826829.237645:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826829.237648:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:3.0:1787826829.237660:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13586:x1874672134158464:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787826829.237684:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826829.237727:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13586:x1874672134158464:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826829.237735:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:1.0:1787826829.239411:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826829.239478:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134158592 00000100:00100000:2.0:1787826829.239485:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134158592 00000100:00100000:2.0:1787826829.239536:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 89 00000100:00080000:0.0:1787826829.239545:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826829.239548:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:13586:x1874672134158592:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826829.239568:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691958272 00000100:00100000:2.0:1787826829.239621:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:13586:x1874672134158592:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826829.239636:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 89 00000100:00100000:0.0:1787826829.240910:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826829.241012:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134158720 00000100:00100000:2.0:1787826829.241018:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134158720 00000100:00100000:2.0:1787826829.241210:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 90 00000100:00100000:2.0:1787826829.241245:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13586:x1874672134158720:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826829.241263:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826829.241315:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:13586:x1874672134158720:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 72us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826829.241322:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 90 00000100:00080000:0.0:1787826829.241495:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826829.266718:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826829.266779:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134158976 00000100:00100000:3.0:1787826829.266787:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134158976 00000100:00100000:3.0:1787826829.266832:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:3.0:1787826829.266839:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:13605:x1874672134158976:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826829.266881:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826829.266907:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79538d3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346740a expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.266928:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8d53428e3600) 00010000:00010000:3.0:1787826829.266937:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826829.266958:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.266970:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.266997:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267012:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267018:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267023:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267105:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267111:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267118:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826829.267406:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787826829.267418:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 204130202164ns, next at 205130199806ns, rc = 0 00010000:00010000:3.0:1787826829.267480:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267489:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267497:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267515:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267521:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267527:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267552:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826829.267572:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267578:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267585:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267591:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826829.267596:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267603:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267612:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8d54605a1f00) 00010000:00010000:3.0:1787826829.267614:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826829.267618:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267644:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539c1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267660:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267667:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267672:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267678:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826829.267681:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267687:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267695:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826829.267698:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826829.267701:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267706:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826829.267715:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047174510 reply state 00000000b4b7b6d1 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267725:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826829.267737:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3509f068 (ffff8d54605a1800) 00010000:00010000:3.0:1787826829.267740:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826829.267742:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826829.267814:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:13605:x1874672134158976:12345-192.168.203.6@tcp:36:rm.0 Request processed in 973us (1102us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787826829.267821:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 57 00010000:00010000:1.0:1787826829.267925:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826829.267931:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826829.267948:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030400 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826829.267951:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826829.267956:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826829.267965:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8d54605a1f00) 00010000:00010000:1.0:1787826829.267967:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826829.267970:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826829.267976:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a79539c8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826829.267990:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826829.267991:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826829.267993:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826829.393404:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826829.393426:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143669632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826829.393505:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826829.393559:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143669632 00000100:00100000:3.0:1787826829.393568:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143669632 00000100:00100000:3.0:1787826829.393614:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787826829.393624:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143669632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826829.393649:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826829.393701:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143669632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826829.393709:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787826829.393757:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143669632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826829.521388:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826830.545405:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826831.529039:0:16774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 2: |x| 10 open(O_CREAT)s ======= 06:33:50 (1787826830) 00000100:00100000:1.0:1787826831.548848:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.548901:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134159232 00000100:00100000:3.0:1787826831.548911:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134159232 00000100:00100000:3.0:1787826831.549002:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 58 00000100:00100000:3.0:1787826831.549013:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+9:14044:x1874672134159232:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826831.549035:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1787826831.549048:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826831.549081:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467426 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549169:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549179:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549197:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549277:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549287:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549294:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826831.549583:0:10060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787826831.549734:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a79539e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549744:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a79539e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549752:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a79539e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549778:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549783:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549787:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549791:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826831.549798:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549804:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549812:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826831.549815:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826831.549817:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549822:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a79539d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826831.549830:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe68a357 reply state 000000006f1659ec transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549837:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549841:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x95f49252 (ffff8d54605a1600) 00010000:00010000:3.0:1787826831.549843:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826831.549844:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826831.549867:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467426 expref: 12 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549880:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a79539e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467426 expref: 11 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.549887:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8d54605a1000) 00010000:00010000:3.0:1787826831.549889:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826831.549902:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030200, rc 0) 00000100:00100000:3.0:1787826831.549959:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:14044:x1874672134159232:12345-192.168.203.6@tcp:101:bash.0 Request processed in 948us (1117us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787826831.549967:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 58 00000100:00100000:2.0:1787826831.552049:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.552084:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134159360 00000100:00100000:3.0:1787826831.552092:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134159360 00000100:00080000:1.0:1787826831.552148:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826831.552167:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:3.0:1787826831.552177:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:14044:x1874672134159360:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826831.552192:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826831.552208:0:10061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2993422/0xc0fefc09a79539f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346742d expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826831.552655:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826831.552675:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=206s v=(0 0) 00010000:00010000:3.0:1787826831.552680:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826831.552689:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2993422/0xc0fefc09a79539f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346742d expref: 7 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.552706:0:10061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2993422/0xc0fefc09a79539f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346742d expref: 7 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.552718:0:10061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030400, rc 0) 00000100:00100000:3.0:1787826831.552868:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+7:14044:x1874672134159360:12345-192.168.203.6@tcp:101:bash.0 Request processed in 692us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826831.552875:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:1.0:1787826831.554516:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.554567:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134159488 00000100:00100000:2.0:1787826831.554575:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134159488 00002000:00100000:2.0:1787826831.554615:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->5) req@ffff8d547f7f30c0 x1874672134159488/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:432/0 lens 496/0 e 0 to 0 dl 1787826842 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826831.554625:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f30c0 with x1874672134159488 ext(0->5) 00002000:00010000:2.0:1787826831.554631:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f30c0 00000100:00100000:2.0:1787826831.554664:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:1.0:1787826831.554672:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787826831.554674:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134159488:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:1.0:1787826831.554687:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000001:00080000:1.0:1787826831.557107:0:15880:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000100:00100000:2.0:1787826831.557266:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134159488:12345-192.168.203.6@tcp:4:bash.0 Request processed in 2590us (2750us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787826831.557277:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 3 00002000:00100000:2.0:1787826831.557289:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->5) req@ffff8d547f7f30c0 x1874672134159488/t12884901891(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:432/0 lens 496/448 e 0 to 0 dl 1787826842 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826831.557299:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f30c0 with x1874672134159488 ext(0->5) 00002000:00010000:2.0:1787826831.557305:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f30c0 00000100:00100000:1.0:1787826831.559021:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.559069:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134159744 00000100:00100000:2.0:1787826831.559078:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134159744 00000100:00100000:2.0:1787826831.559123:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:2.0:1787826831.559133:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545046f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+12:14044:x1874672134159744:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:2.0:1787826831.559420:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545046f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+13:14044:x1874672134159744:12345-192.168.203.6@tcp:35:bash.0 Request processed in 287us (400us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787826831.559430:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:0.0:1787826831.562249:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.562320:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134160000 00000100:00100000:3.0:1787826831.562329:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134160000 00000100:00100000:3.0:1787826831.562389:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00100000:3.0:1787826831.562400:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+13:14044:x1874672134160000:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826831.562422:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826831.562454:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467434 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.562547:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.562566:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.562577:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.562591:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.562599:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.562606:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826831.562877:0:6487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787826831.563012:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953a0e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563022:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953a0e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563030:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953a0e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563066:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563072:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563079:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563085:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826831.563089:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563096:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563107:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826831.563110:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826831.563114:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563121:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953a00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826831.563133:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007da43b98 reply state 00000000d9a5e245 transno 4294967317 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563143:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563149:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2ef3d52 (ffff8d54605a1300) 00010000:00010000:3.0:1787826831.563167:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826831.563170:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826831.563197:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a79539f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467434 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563211:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953a0e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467434 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.563240:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x4:0x0].0x0 (ffff8d54605a1400) 00010000:00010000:3.0:1787826831.563243:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826831.563247:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5482176e00, rc 0) 00000100:00100000:3.0:1787826831.563303:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:14044:x1874672134160000:12345-192.168.203.6@tcp:101:bash.0 Request processed in 905us (1086us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787826831.563310:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00100000:1.0:1787826831.565327:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.565368:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134160128 00000100:00100000:2.0:1787826831.565374:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134160128 00000100:00100000:2.0:1787826831.565426:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:2.0:1787826831.565447:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:14044:x1874672134160128:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826831.565462:0:9498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826831.565476:0:9498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c835f654/0xc0fefc09a7953a1c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346743b expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826831.565807:0:9498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826831.565829:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=206s v=(0 0) 00010000:00010000:2.0:1787826831.565834:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826831.565844:0:9498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c835f654/0xc0fefc09a7953a1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 8 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.565860:0:9498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c835f654/0xc0fefc09a7953a1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 8 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.565872:0:9498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3e00, rc 0) 00000100:00100000:2.0:1787826831.565939:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:14044:x1874672134160128:12345-192.168.203.6@tcp:101:bash.0 Request processed in 504us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.565956:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:0.0:1787826831.567487:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826831.567536:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134160384 00000100:00100000:1.0:1787826831.567543:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134160384 00000100:00100000:1.0:1787826831.567581:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:1.0:1787826831.567590:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:14044:x1874672134160384:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:1.0:1787826831.567818:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:14044:x1874672134160384:12345-192.168.203.6@tcp:35:bash.0 Request processed in 229us (333us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787826831.567826:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:1.0:1787826831.569111:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.569159:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134160640 00000100:00100000:2.0:1787826831.569166:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134160640 00000100:00100000:2.0:1787826831.569208:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 60 00000100:00100000:2.0:1787826831.569249:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+17:14044:x1874672134160640:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826831.569266:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826831.569283:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953a23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467442 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826831.569285:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826831.569391:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569405:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569415:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569429:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569452:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569460:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826831.569744:0:6486:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787826831.569916:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7953a38 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569926:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7953a38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569934:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7953a38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569964:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569981:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569988:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.569995:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826831.570000:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.570007:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.570019:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826831.570022:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826831.570027:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.570033:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2800/0xc0fefc09a7953a2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826831.570044:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d9a59c0 reply state 000000003f93b201 transno 4294967319 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.570054:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.570061:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8ac02452 (ffff8d53428dea00) 00010000:00010000:2.0:1787826831.570063:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826831.570074:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826831.570100:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953a23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467442 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.570119:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7953a38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467442 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.570126:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0x0 (ffff8d53428de600) 00010000:00010000:2.0:1787826831.570129:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826831.570131:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3400, rc 0) 00000100:00100000:2.0:1787826831.570181:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:14044:x1874672134160640:12345-192.168.203.6@tcp:101:bash.0 Request processed in 965us (1072us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787826831.570189:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 60 00000100:00100000:2.0:1787826831.571687:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826831.571731:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134160768 00000100:00100000:0.0:1787826831.571739:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134160768 00000100:00100000:0.0:1787826831.571783:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:0.0:1787826831.571791:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:14044:x1874672134160768:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1787826831.571801:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826831.571813:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953a46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467449 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826831.572149:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826831.572165:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=206s v=(0 0) 00010000:00010000:0.0:1787826831.572169:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826831.572175:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953a46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467449 expref: 9 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.572187:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953a46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467449 expref: 9 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.572194:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0400, rc 0) 00000100:00100000:0.0:1787826831.572241:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+9:14044:x1874672134160768:12345-192.168.203.6@tcp:101:bash.0 Request processed in 452us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826831.572248:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:0.0:1787826831.573449:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.573482:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134161024 00000100:00100000:2.0:1787826831.573489:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134161024 00000100:00100000:2.0:1787826831.573528:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:2.0:1787826831.573538:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:14044:x1874672134161024:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:2.0:1787826831.573761:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+21:14044:x1874672134161024:12345-192.168.203.6@tcp:35:bash.0 Request processed in 224us (325us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787826831.573768:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:2.0:1787826831.576088:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826831.576138:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134161280 00000100:00100000:0.0:1787826831.576144:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134161280 00000100:00100000:0.0:1787826831.576193:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:0.0:1787826831.576205:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+21:14044:x1874672134161280:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1787826831.576239:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826831.576259:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a7953a4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467450 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576343:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576364:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576376:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576391:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576399:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576406:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826831.576719:0:10060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x7:0x0], index 0: 0 00010000:00010000:0.0:1787826831.576872:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7953a62 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576900:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7953a62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576908:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7953a62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576950:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576959:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576966:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576973:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826831.576977:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576984:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.576995:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787826831.576999:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826831.577003:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.577009:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953a54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826831.577021:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012054cb6 reply state 00000000df4fdafc transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.577038:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.577045:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x427acf52 (ffff8d53436dba00) 00010000:00010000:0.0:1787826831.577047:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826831.577050:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826831.577075:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a7953a4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467450 expref: 24 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.577090:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7953a62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467450 expref: 23 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.577097:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6:0x0].0x0 (ffff8d53436db600) 00010000:00010000:0.0:1787826831.577100:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826831.577103:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1000, rc 0) 00000100:00100000:0.0:1787826831.577155:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:14044:x1874672134161280:12345-192.168.203.6@tcp:101:bash.0 Request processed in 953us (1084us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787826831.577163:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:1.0:1787826831.578936:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.578982:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134161408 00000100:00100000:2.0:1787826831.578990:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134161408 00000100:00100000:2.0:1787826831.579036:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:2.0:1787826831.579047:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+9:14044:x1874672134161408:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826831.579059:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826831.579077:0:10061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a7953a70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467457 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826831.579415:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826831.579451:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=206s v=(0 0) 00010000:00010000:2.0:1787826831.579457:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826831.579466:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a7953a70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467457 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.579493:0:10061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a7953a70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467457 expref: 10 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.579505:0:10061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2200, rc 0) 00000100:00100000:2.0:1787826831.579549:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:14044:x1874672134161408:12345-192.168.203.6@tcp:101:bash.0 Request processed in 507us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.579554:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:1.0:1787826831.581020:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826831.581055:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134161664 00000100:00100000:0.0:1787826831.581060:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134161664 00000100:00100000:0.0:1787826831.581095:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:0.0:1787826831.581102:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+24:14044:x1874672134161664:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:0.0:1787826831.581339:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+25:14044:x1874672134161664:12345-192.168.203.6@tcp:35:bash.0 Request processed in 237us (321us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787826831.581347:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:2.0:1787826831.584559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.584595:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134161920 00000100:00100000:3.0:1787826831.584604:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134161920 00000100:00100000:3.0:1787826831.584655:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:3.0:1787826831.584667:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+25:14044:x1874672134161920:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826831.584688:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826831.584709:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953a77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346745e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.584797:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.584810:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.584820:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.584842:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.584850:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.584857:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826831.585167:0:6487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x8:0x0], index 0: 0 00010000:00010000:3.0:1787826831.585528:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176200/0xc0fefc09a7953a8c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585536:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176200/0xc0fefc09a7953a8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585542:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176200/0xc0fefc09a7953a8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585567:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585572:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585576:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585580:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826831.585584:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585597:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585607:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826831.585610:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826831.585613:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585620:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953a7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826831.585634:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c30bdae7 reply state 00000000f2eb1bbe transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585644:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585650:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1b739652 (ffff8d54605a1c00) 00010000:00010000:3.0:1787826831.585652:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826831.585655:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826831.585682:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953a77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346745e expref: 28 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585697:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176200/0xc0fefc09a7953a8c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346745e expref: 27 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.585704:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7:0x0].0x0 (ffff8d54605a1e00) 00010000:00010000:3.0:1787826831.585707:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826831.585709:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5482176200, rc 0) 00000100:00100000:3.0:1787826831.585766:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+28:14044:x1874672134161920:12345-192.168.203.6@tcp:101:bash.0 Request processed in 1101us (1213us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787826831.585781:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:0.0:1787826831.588564:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.588659:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134162048 00000100:00100000:2.0:1787826831.588666:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134162048 00000100:00100000:2.0:1787826831.588713:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:2.0:1787826831.588725:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:14044:x1874672134162048:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826831.588740:0:9498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826831.588758:0:9498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a7953a9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467465 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826831.589265:0:9498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826831.589288:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=206s v=(0 0) 00010000:00010000:3.0:1787826831.589293:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826831.589304:0:9498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a7953a9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 11 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.589320:0:9498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a7953a9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 11 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.589333:0:9498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2600, rc 0) 00000100:00100000:3.0:1787826831.589379:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:14044:x1874672134162048:12345-192.168.203.6@tcp:101:bash.0 Request processed in 658us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826831.589384:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:3.0:1787826831.591256:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.591291:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134162304 00000100:00100000:2.0:1787826831.591299:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134162304 00000100:00100000:2.0:1787826831.591335:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:0.0:1787826831.591346:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1787826831.591351:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+28:14044:x1874672134162304:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:0.0:1787826831.591356:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1787826831.591608:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+29:14044:x1874672134162304:12345-192.168.203.6@tcp:35:bash.0 Request processed in 259us (357us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787826831.591616:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:2.0:1787826831.592989:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.593033:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134162560 00000100:00100000:3.0:1787826831.593039:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134162560 00000100:00100000:3.0:1787826831.593081:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:3.0:1787826831.593100:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+29:14044:x1874672134162560:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826831.593117:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826831.593135:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953aa1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346746c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593200:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593236:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593244:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593256:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593260:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593264:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826831.593543:0:6486:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9:0x0], index 0: 0 00010000:00010000:3.0:1787826831.593666:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a7953ab6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593675:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a7953ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593683:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a7953ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593714:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593721:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593728:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593741:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826831.593753:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593762:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593775:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826831.593778:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826831.593782:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593789:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953aa8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826831.593803:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0aa83f9 reply state 00000000c2bd252f transno 4294967325 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593813:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593820:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x532e4152 (ffff8d54605a1200) 00010000:00010000:3.0:1787826831.593823:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826831.593835:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826831.593858:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953aa1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346746c expref: 32 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593869:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a7953ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346746c expref: 31 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.593894:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8:0x0].0x0 (ffff8d54605a1f00) 00010000:00010000:3.0:1787826831.593898:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826831.593904:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030a00, rc 0) 00000100:00100000:3.0:1787826831.593951:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+32:14044:x1874672134162560:12345-192.168.203.6@tcp:101:bash.0 Request processed in 854us (965us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787826831.593957:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:3.0:1787826831.595613:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826831.595689:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134162688 00000100:00100000:1.0:1787826831.595698:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134162688 00000100:00100000:1.0:1787826831.595747:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:1.0:1787826831.595758:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:14044:x1874672134162688:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:1.0:1787826831.595772:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826831.595786:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044874d85/0xc0fefc09a7953ac4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467473 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826831.596153:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826831.596170:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=206s v=(0 0) 00010000:00010000:1.0:1787826831.596174:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826831.596183:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044874d85/0xc0fefc09a7953ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467473 expref: 12 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826831.596210:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044874d85/0xc0fefc09a7953ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467473 expref: 12 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826831.596245:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6600, rc 0) 00000100:00100000:1.0:1787826831.596293:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:14044:x1874672134162688:12345-192.168.203.6@tcp:101:bash.0 Request processed in 537us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826831.596300:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:2.0:1787826831.597799:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.597825:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134162944 00000100:00100000:3.0:1787826831.597830:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134162944 00000100:00100000:3.0:1787826831.597859:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:3.0:1787826831.597865:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+32:14044:x1874672134162944:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:3.0:1787826831.598063:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+33:14044:x1874672134162944:12345-192.168.203.6@tcp:35:bash.0 Request processed in 197us (266us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787826831.598070:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:2.0:1787826831.599157:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826831.599205:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134163200 00000100:00100000:0.0:1787826831.599211:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134163200 00000100:00100000:0.0:1787826831.599467:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:0.0:1787826831.599478:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53434761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+33:14044:x1874672134163200:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1787826831.599495:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826831.599512:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953acb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346747a expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.599609:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.599623:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.599633:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.599647:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.599654:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.599660:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826831.599935:0:10060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa:0x0], index 0: 0 00010000:00010000:0.0:1787826831.600046:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a7953ae0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600063:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a7953ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600079:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a7953ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600109:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600116:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600122:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600128:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826831.600131:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600138:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600149:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787826831.600151:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826831.600155:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600162:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953ad2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826831.600172:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b35ee0c reply state 00000000dc86c08f transno 4294967327 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600188:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600194:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4bf9e852 (ffff8d53436db700) 00010000:00010000:0.0:1787826831.600197:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826831.600199:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826831.600249:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1e00/0xc0fefc09a7953acb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346747a expref: 36 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600262:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a7953ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346747a expref: 35 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.600268:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff8d53436db000) 00010000:00010000:0.0:1787826831.600270:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826831.600272:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1400, rc 0) 00000100:00100000:0.0:1787826831.600317:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53434761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+36:14044:x1874672134163200:12345-192.168.203.6@tcp:101:bash.0 Request processed in 843us (1162us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787826831.600324:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:0.0:1787826831.601822:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.601875:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134163328 00000100:00100000:2.0:1787826831.601882:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134163328 00000100:00100000:2.0:1787826831.601922:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:2.0:1787826831.601930:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:14044:x1874672134163328:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826831.601941:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826831.601954:0:10061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953aee lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467481 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826831.602272:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826831.602288:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=206s v=(0 0) 00010000:00010000:2.0:1787826831.602292:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826831.602298:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953aee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467481 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.602308:0:10061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953aee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467481 expref: 13 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.602316:0:10061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3c00, rc 0) 00000100:00100000:2.0:1787826831.602354:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+13:14044:x1874672134163328:12345-192.168.203.6@tcp:101:bash.0 Request processed in 425us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.602369:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:2.0:1787826831.603627:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826831.603736:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134163584 00000100:00100000:0.0:1787826831.603743:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134163584 00000100:00100000:0.0:1787826831.603779:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:0.0:1787826831.603788:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545046dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:14044:x1874672134163584:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:0.0:1787826831.603994:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545046dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+37:14044:x1874672134163584:12345-192.168.203.6@tcp:35:bash.0 Request processed in 207us (368us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787826831.604002:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:1.0:1787826831.605098:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.605146:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134163840 00000100:00100000:3.0:1787826831.605152:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134163840 00000100:00100000:3.0:1787826831.605187:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:3.0:1787826831.605196:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+37:14044:x1874672134163840:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826831.605210:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826831.605252:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953af5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467488 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605325:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605344:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605351:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605361:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605366:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605370:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826831.605607:0:6487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb:0x0], index 0: 0 00010000:00010000:3.0:1787826831.605732:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7400/0xc0fefc09a7953b0a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605739:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7400/0xc0fefc09a7953b0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605746:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7400/0xc0fefc09a7953b0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605771:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605778:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605784:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605794:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826831.605798:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605805:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605815:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826831.605818:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826831.605821:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605827:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953afc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826831.605838:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a25ab98 reply state 00000000ed86c85a transno 4294967329 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605846:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605852:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x59102352 (ffff8d54745a7300) 00010000:00010000:3.0:1787826831.605853:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826831.605856:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826831.605878:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953af5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467488 expref: 40 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605887:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7400/0xc0fefc09a7953b0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467488 expref: 39 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.605903:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8d54745a7900) 00010000:00010000:3.0:1787826831.605905:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826831.605907:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7400, rc 0) 00000100:00100000:3.0:1787826831.605949:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+40:14044:x1874672134163840:12345-192.168.203.6@tcp:101:bash.0 Request processed in 754us (852us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787826831.605957:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:3.0:1787826831.607574:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.607624:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134163968 00000100:00100000:2.0:1787826831.607635:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134163968 00000100:00100000:2.0:1787826831.607678:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 71 00000100:00100000:2.0:1787826831.607684:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e39a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+13:14044:x1874672134163968:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826831.607694:0:9498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826831.607704:0:9498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001444e1c5/0xc0fefc09a7953b18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346748f expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826831.608058:0:9498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826831.608089:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=206s v=(0 0) 00010000:00010000:2.0:1787826831.608094:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826831.608103:0:9498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444e1c5/0xc0fefc09a7953b18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346748f expref: 14 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.608119:0:9498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001444e1c5/0xc0fefc09a7953b18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346748f expref: 14 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.608130:0:9498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3000, rc 0) 00000100:00100000:2.0:1787826831.608174:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e39a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:14044:x1874672134163968:12345-192.168.203.6@tcp:101:bash.0 Request processed in 489us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.608187:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 71 00000100:00100000:2.0:1787826831.609392:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.609425:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134164224 00000100:00100000:3.0:1787826831.609430:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134164224 00000100:00100000:3.0:1787826831.609480:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:3.0:1787826831.609488:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+40:14044:x1874672134164224:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:3.0:1787826831.609700:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+41:14044:x1874672134164224:12345-192.168.203.6@tcp:35:bash.0 Request processed in 212us (308us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787826831.609708:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:1.0:1787826831.612288:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.612390:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134164480 00000100:00100000:3.0:1787826831.612400:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134164480 00000100:00100000:3.0:1787826831.612462:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:3.0:1787826831.612473:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+41:14044:x1874672134164480:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826831.612498:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826831.612518:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6200/0xc0fefc09a7953b1f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467496 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.612616:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.612635:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.612644:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.612656:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.612663:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.612670:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826831.612978:0:6486:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc:0x0], index 0: 0 00010000:00010000:3.0:1787826831.613110:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6800/0xc0fefc09a7953b34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613120:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6800/0xc0fefc09a7953b34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613128:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6800/0xc0fefc09a7953b34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613158:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613162:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613167:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613175:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e1c7800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826831.613178:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613183:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613192:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826831.613194:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826831.613197:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613201:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7800/0xc0fefc09a7953b26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826831.613210:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b40eff30 reply state 00000000e9d3a626 transno 4294967331 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613234:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613237:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d464a52 (ffff8d54745a7200) 00010000:00010000:3.0:1787826831.613239:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826831.613241:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826831.613265:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6200/0xc0fefc09a7953b1f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467496 expref: 44 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613279:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6800/0xc0fefc09a7953b34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467496 expref: 43 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826831.613296:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8d54745a7e00) 00010000:00010000:3.0:1787826831.613299:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826831.613301:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6800, rc 0) 00000100:00100000:3.0:1787826831.613358:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+44:14044:x1874672134164480:12345-192.168.203.6@tcp:101:bash.0 Request processed in 887us (1080us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787826831.613365:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:0.0:1787826831.615294:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826831.615340:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134164608 00000100:00100000:1.0:1787826831.615348:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134164608 00000100:00100000:1.0:1787826831.615396:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 72 00000100:00100000:1.0:1787826831.615406:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:14044:x1874672134164608:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:1.0:1787826831.615418:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826831.615435:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953b42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346749d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826831.616178:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826831.616202:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=206s v=(0 0) 00010000:00010000:1.0:1787826831.616206:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826831.616251:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953b42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346749d expref: 15 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826831.616268:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953b42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346749d expref: 15 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826831.616292:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7200, rc 0) 00000100:00100000:1.0:1787826831.616353:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+15:14044:x1874672134164608:12345-192.168.203.6@tcp:101:bash.0 Request processed in 948us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826831.616360:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 72 00000100:00100000:2.0:1787826831.617782:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826831.617827:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134164864 00000100:00100000:0.0:1787826831.617846:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134164864 00000100:00100000:0.0:1787826831.617885:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:0.0:1787826831.617903:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+44:14044:x1874672134164864:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:0.0:1787826831.618163:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+45:14044:x1874672134164864:12345-192.168.203.6@tcp:35:bash.0 Request processed in 263us (384us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787826831.618170:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:2.0:1787826831.621005:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826831.621078:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134165120 00000100:00100000:0.0:1787826831.621088:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134165120 00000100:00100000:0.0:1787826831.621148:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:0.0:1787826831.621158:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+45:14044:x1874672134165120:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1787826831.621179:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826831.621200:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953b49 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674a4 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621335:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621346:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621356:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621382:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621390:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621408:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826831.621692:0:10060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd:0x0], index 0: 0 00010000:00010000:0.0:1787826831.621799:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a7953b5e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621808:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a7953b5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621815:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a7953b5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621844:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621848:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621853:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621856:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826831.621859:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621865:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621875:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787826831.621878:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826831.621896:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621903:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7953b50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826831.621916:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2bd96a0 reply state 00000000568a0c55 transno 4294967333 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621927:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621931:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfd049252 (ffff8d53436db200) 00010000:00010000:0.0:1787826831.621933:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826831.621936:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826831.621964:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a7953b49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674a4 expref: 48 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621978:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a7953b5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674a4 expref: 47 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826831.621985:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8d53436dbd00) 00010000:00010000:0.0:1787826831.621987:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826831.621989:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0a00, rc 0) 00000100:00100000:0.0:1787826831.622052:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+48:14044:x1874672134165120:12345-192.168.203.6@tcp:101:bash.0 Request processed in 896us (1055us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787826831.622060:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:3.0:1787826831.623551:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826831.623600:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134165248 00000100:00100000:2.0:1787826831.623606:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134165248 00000100:00100000:2.0:1787826831.623649:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 73 00000100:00100000:2.0:1787826831.623659:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+15:14044:x1874672134165248:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826831.623672:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826831.623685:0:10061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bf8770d/0xc0fefc09a7953b6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674ab expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826831.624021:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826831.624037:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=206s v=(0 0) 00010000:00010000:2.0:1787826831.624041:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826831.624048:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bf8770d/0xc0fefc09a7953b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 16 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.624058:0:10061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004bf8770d/0xc0fefc09a7953b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 16 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826831.624067:0:10061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2c00, rc 0) 00000100:00100000:2.0:1787826831.624113:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:14044:x1874672134165248:12345-192.168.203.6@tcp:101:bash.0 Request processed in 455us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.624120:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 73 00000100:00100000:2.0:1787826831.625271:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826831.625329:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134165504 00000100:00100000:3.0:1787826831.625341:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134165504 00000100:00100000:3.0:1787826831.625403:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1787826831.625415:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+48:14044:x1874672134165504:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:3.0:1787826831.625830:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+49:14044:x1874672134165504:12345-192.168.203.6@tcp:35:bash.0 Request processed in 416us (559us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1787826831.625838:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:1.0:1787826831.953715:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143669760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.953762:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143670144:0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.953775:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826831.953807:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826831.953813:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143669760 00000100:00100000:3.0:1787826831.953819:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143669760 00000100:00100000:1.0:1787826831.953840:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143670272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.953846:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453335680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143670656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.953874:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787826831.953885:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826831.953898:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143669760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.953908:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826831.953923:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143671168:0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.953945:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143670784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.953960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826831.953969:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143669760:12345-0@lo:400:kworker.0 Request processed in 84us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826831.953977:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787826831.953989:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826831.953995:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787826831.954006:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143670016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.954023:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143671296:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954038:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143669888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.954039:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826831.954067:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826831.954079:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143670528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954102:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670144 00000100:00100000:3.0:1787826831.954107:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670144 00000100:00100000:2.0:1787826831.954114:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826831.954147:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143669760:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954150:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670656 00000100:00100000:2.0:1787826831.954154:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143671040:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954156:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670656 00000100:00100000:3.0:1787826831.954190:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671168 00000100:00100000:3.0:1787826831.954193:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671168 00000100:00100000:2.0:1787826831.954198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826831.954209:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670784 00000100:00100000:3.0:1787826831.954241:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670784 00000100:00100000:3.0:1787826831.954263:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671296 00000100:00100000:3.0:1787826831.954266:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671296 00000100:00100000:2.0:1787826831.954277:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670272 00000100:00100000:2.0:1787826831.954284:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670272 00000100:00100000:1.0:1787826831.954288:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787826831.954299:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787826831.954306:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143670144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954312:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343475a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143670656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.954323:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670016 00000100:00100000:2.0:1787826831.954328:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670016 00000100:00100000:2.0:1787826831.954350:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787826831.954360:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143670272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954365:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343475a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143670656:12345-0@lo:400:kworker.0 Request processed in 57us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826831.954377:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787826831.954378:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143670144:12345-0@lo:400:kworker.0 Request processed in 76us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826831.954389:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787826831.954397:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787826831.954408:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53434770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143671168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.954414:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143670272:12345-0@lo:400:kworker.0 Request processed in 56us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.954423:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787826831.954432:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787826831.954454:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143670784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.954459:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787826831.954461:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53434770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143671168:12345-0@lo:400:kworker.0 Request processed in 55us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826831.954474:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787826831.954475:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143670016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954489:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787826831.954498:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143671296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.954517:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143670784:12345-0@lo:400:kworker.0 Request processed in 66us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.954526:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143670016:12345-0@lo:400:kworker.0 Request processed in 57us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.954538:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787826831.954540:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143671296:12345-0@lo:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826831.954547:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787826831.954555:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787826831.954566:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670528 00000100:00100000:2.0:1787826831.954572:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670528 00000100:00100000:3.0:1787826831.954610:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671040 00000100:00080000:1.0:1787826831.954612:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826831.954614:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671040 00000100:00080000:1.0:1787826831.954622:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826831.954626:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1787826831.954628:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826831.954634:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826831.954639:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143670528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954650:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826831.954660:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143671040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.954680:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826831.954691:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143670528:12345-0@lo:400:kworker.0 Request processed in 55us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826831.954700:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826831.954709:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143671040:12345-0@lo:400:kworker.0 Request processed in 50us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826831.954720:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143670400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954722:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787826831.954737:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143670016:0@lo:400:kworker.0 00010000:00080000:2.0:1787826831.954756:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533352c0 x1874672143670528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826831.954765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826831.954777:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143670528:0@lo:400:kworker.0 00010000:00080000:2.0:1787826831.954791:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81c000 x1874672143671040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826831.954797:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670400 00000100:00100000:3.0:1787826831.954802:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670400 00000100:00100000:2.0:1787826831.954803:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143671040:0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.954805:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143670912:0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.954823:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143670144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826831.954840:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453335680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143670656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954843:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826831.954852:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826831.954857:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143671168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954858:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143670400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.954908:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143670912 00000100:00100000:3.0:1787826831.954910:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143670400:12345-0@lo:400:kworker.0 Request processed in 56us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826831.954914:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143670912 00000100:00100000:3.0:1787826831.954920:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787826831.954942:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143670272:0@lo:400:kworker.0 00010000:00080000:2.0:1787826831.954958:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5453337480 x1874672143670784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826831.954962:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787826831.954974:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143670784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.954977:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143670912:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787826831.954985:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787826831.954993:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81d680 x1874672143671296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826831.955002:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143671296:0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.955020:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143670400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826831.955025:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143670912:12345-0@lo:400:kworker.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826831.955034:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787826831.955041:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000004:00080000:1.0:1787826831.955048:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d5343b13c00, transno 12884901889 00000100:00100000:1.0:1787826831.955069:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143670912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.955101:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143669888 00000100:00100000:1.0:1787826831.955105:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143669888 00000100:00100000:1.0:1787826831.955140:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787826831.955148:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143669888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826831.955191:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143669888:12345-0@lo:400:kworker.0 Request processed in 44us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826831.955198:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787826831.955230:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453337840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143669888:0@lo:400:kworker.0 00000020:01000004:0.0:1787826832.269339:0:16873:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787826832.269383:0:16873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.269410:0:16873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.269418:0:16873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.269425:0:16873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.269454:0:16873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787826832.269460:0:16873:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787826832.269476:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826832.269485:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826832.269487:0:16873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826832.269494:0:16873:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1787826832.269498:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6e00 already unused, calling callback (ffffffffc13fec20) 00000100:00080000:0.0:1787826832.269499:0:16873:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1787826832.269503:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.269515:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826832.269523:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826832.269526:0:16873:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1787826832.269544:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826832.269547:0:7427:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787826832.269550:0:7427:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1787826832.269562:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143671424:0@lo:39:umount.0 00010000:00010000:3.0:1787826832.269578:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.269586:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826832.269610:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.269618:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6e00/0xc0fefc09a795393c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953943 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826832.269626:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826832.269626:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143671552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826832.269631:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826832.269635:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826832.269640:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826832.269654:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671424 00000100:00100000:1.0:1787826832.269662:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671424 00000100:00100000:2.0:1787826832.269675:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826832.269725:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787826832.269736:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143671424:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826832.269758:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953958 00000100:00080000:1.0:1787826832.269765:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8d546e143000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787826832.269781:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671552 00000100:00100000:0.0:1787826832.269786:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671552 00010000:00010000:3.0:1787826832.269787:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826832.269821:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787826832.269830:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143671552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826832.269831:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143671424:12345-0@lo:39:umount.0 Request processed in 95us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826832.269842:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1787826832.269843:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1787826832.269852:0:6487:0:(genops.c:885:class_export_put()) final put ffff8d546e141000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:3.0:1787826832.269854:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1787826832.269861:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1c00/0xc0fefc09a7953943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795393c expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.269875:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826832.269882:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143671424:0@lo:39:umount.0 00000020:00000080:2.0:1787826832.269892:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d546e141000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1787826832.269907:0:16873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826832.269911:0:16873:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826832.269912:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3617:x1874672143671552:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826832.269916:0:16873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787826832.269924:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:2.0:1787826832.269958:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d546e143000 for lustre-MDT0000 00000100:00100000:1.0:1787826832.269996:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143671552:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787826832.270744:0:16873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787826832.270747:0:16873:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787826832.270751:0:16873:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787826832.270761:0:16873:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd6000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787826832.270793:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143671680:0@lo:39:umount.0 00000100:00100000:0.0:1787826832.270822:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826832.270864:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671680 00000100:00100000:1.0:1787826832.270869:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671680 00000100:00100000:1.0:1787826832.270907:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787826832.270914:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143671680:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826832.270927:0:10060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795396d 00000100:00080000:1.0:1787826832.270943:0:10060:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd7800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787826832.270991:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143671680:12345-0@lo:39:umount.0 Request processed in 77us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826832.270995:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826832.271000:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:00000080:1.0:1787826832.271008:0:10060:0:(genops.c:885:class_export_put()) final put ffff8d5442bd4000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00080000:3.0:1787826832.271017:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b3840 x1874672143671680/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826832.271039:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd6000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1787826832.271049:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5442bd4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:3.0:1787826832.271057:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143671680:0@lo:39:umount.0 00000100:00080000:0.0:1787826832.271077:0:16873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826832.271081:0:16873:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000020:00000080:2.0:1787826832.271092:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5442bd7800 for lustre-MDT0001 00000100:00100000:0.0:1787826832.271096:0:16873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787826832.272060:0:16873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272071:0:16873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272078:0:16873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272085:0:16873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272103:0:16873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826832.272109:0:16873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272115:0:16873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272122:0:16873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826832.272133:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826832.272142:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272144:0:16873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826832.272160:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6400 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826832.272166:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.272172:0:16873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826832.272175:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826832.272178:0:16873:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:00010000:1.0:1787826832.272191:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826832.272197:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826832.272200:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:01000004:0.0:1787826832.272202:0:16873:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 10000000:01000000:1.0:1787826832.272203:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787826832.272206:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000000:0.0:1787826832.272209:0:16873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:0.0:1787826832.272236:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787826832.272240:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:0.0:1787826832.272243:0:16873:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:3.0:1787826832.272254:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2400 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:1.0:1787826832.272258:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826832.272260:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826832.272276:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826832.272280:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826832.272289:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826832.272294:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787826832.272297:0:7427:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787826832.272299:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826832.272300:0:7427:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787826832.272309:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547d2d6400/0xc0fefc09a79538fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953904 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826832.272322:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826832.272323:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143671808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826832.272324:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826832.272325:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826832.272329:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826832.272339:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826832.272356:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826832.272363:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143671936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826832.272376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826832.272405:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826832.272430:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a795392e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953935 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826832.272454:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671808 00000100:00100000:1.0:1787826832.272460:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143671936 00000100:00100000:2.0:1787826832.272461:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671808 00010000:00010000:3.0:1787826832.272464:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826832.272466:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143671936 00010000:00010000:3.0:1787826832.272468:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826832.272472:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826832.272505:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826832.272515:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143671936:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826832.272521:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787826832.272524:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826832.272535:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5442b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143671808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826832.272540:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d544148f000/0xc0fefc09a7953935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795392e expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.272547:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826832.272561:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a7953904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a79538fd expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826832.272564:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826832.272575:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826832.272605:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3619:x1874672143671936:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826832.272613:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787826832.272625:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5442b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143671808:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826832.272635:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787826832.272659:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143671936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826832.272660:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143671808:0@lo:103:ldlm_bl.0 00002000:00000080:0.0:1787826832.274142:0:16873:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1787826832.274169:0:16873:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:0.0:1787826832.274537:0:16873:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1787826832.274546:0:16873:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d534260f000 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 15 (0 0 11) 0 0 0 0: 0000000000000000 12884901891 stale:0 00000020:00080000:0.0:1787826832.274552:0:16873:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d534260e800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 12884901889 stale:0 00000020:00080000:0.0:1787826832.274557:0:16873:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5448684800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:0.0:1787826832.274562:0:16873:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5450eecd28) has exports, disconnecting them 00000020:00080000:0.0:1787826832.274567:0:16873:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d534260f000), last request at 1787826831 00000020:00000080:0.0:1787826832.274576:0:16873:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953927 00000020:00010000:0.0:1787826832.274583:0:16873:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d534260f000: total 0 00000100:00080000:0.0:1787826832.274587:0:16873:0:(import.c:65:import_set_state_nolock()) ffff8d534260b000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787826832.274621:0:6473:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d534260f000: total 0 00000020:00080000:0.0:1787826832.274645:0:16873:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d534260f000): rc 0 00000020:00080000:0.0:1787826832.274649:0:16873:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d534260e800), last request at 1787826831 00000020:00000080:0.0:1787826832.274652:0:16873:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953920 00000100:00080000:0.0:1787826832.274657:0:16873:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd2800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787826832.274665:0:6473:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d534260f000, canceled 0 locks, left on hash table 11. 00000020:00080000:0.0:1787826832.274674:0:16873:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d534260e800): rc 0 00000020:00000080:0.0:1787826832.274677:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d534260e800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1787826832.274698:0:16873:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5448684800), last request at 1787826831 00010000:00010000:1.0:1787826832.274698:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826832.274712:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a7953a9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 12 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787826832.274713:0:16873:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953919 00000100:00080000:0.0:1787826832.274721:0:16873:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826832.274737:0:16873:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5448684800): rc 0 00000020:00000080:0.0:1787826832.274739:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d5448684800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1787826832.274748:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044874d85/0xc0fefc09a7953ac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467473 expref: 11 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826832.274754:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787826832.274768:0:16873:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5450eecd28) has no exports 00010000:00010000:3.0:1787826832.274781:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001444e1c5/0xc0fefc09a7953b18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346748f expref: 10 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787826832.274813:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534260e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00010000:00010000:3.0:1787826832.274817:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953aee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467481 expref: 9 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.274837:0:16873:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a795399e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 9 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787826832.274859:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448684800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00010000:00010000:0.0:1787826832.274861:0:16873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a795399e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 8 pid: 15896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.274868:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953b42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346749d expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787826832.274896:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5442bd2800 for lustre-OST0000 00002000:00010000:3.0:1787826832.274899:0:6473:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:3.0:1787826832.274903:0:6473:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787826831 00000020:00000080:2.0:1787826832.274906:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5442bd1000 for lustre-OST0000 00002000:00010000:3.0:1787826832.274906:0:6473:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787826831 00002000:00010000:3.0:1787826832.274912:0:6473:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787826832.274919:0:16873:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000c2993422/0xc0fefc09a79539f2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x54907400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346742d expref: 6 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.274932:0:16873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2993422/0xc0fefc09a79539f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44907400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346742d expref: 6 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.274943:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bf8770d/0xc0fefc09a7953b6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 5 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.274965:0:16873:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000c835f654/0xc0fefc09a7953a1c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40106400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 4 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826832.274976:0:16873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c835f654/0xc0fefc09a7953a1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44907400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 4 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.274983:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953a46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467449 expref: 4 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.275007:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a7953a70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467457 expref: 2 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826832.275024:0:6473:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d534260f000, canceled 10 locks, left on hash table 0. 00000020:00000080:3.0:1787826832.281103:0:6473:0:(genops.c:885:class_export_put()) final put ffff8d534260f000/2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:3.0:1787826832.281130:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826832.281134:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826832.281136:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826832.281168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534260f000/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:2.0:1787826832.281226:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d534260b000 for lustre-OST0000 00000020:01000000:0.0:1787826832.281798:0:16873:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5342baf240 - data ffff8d54699cb948/ffff8d5450a5ec00 00000020:01000000:0.0:1787826832.281912:0:16873:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5460468ba0 - data ffff8d547fcb1e58/ffff8d5444cbe000 00100000:10000000:0.0:1787826832.287767:0:16873:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787826832.291820:0:16873:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953912 00000020:00000080:2.0:1787826832.291837:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d545139d000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787826832.291853:0:16873:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e5800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787826832.291857:0:16873:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e5800 2 00000020:00000080:1.0:1787826832.291859:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d545139d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1787826832.291860:0:16873:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d547f8e5800 from lustre-OST0000 00000020:00000080:2.0:1787826832.291894:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826832.291921:0:16873:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787826832.291925:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d546eeb3800/lustre-OST0000_UUID 00000020:00000080:2.0:1787826832.291928:0:16873:0:(genops.c:844:class_export_destroy()) destroying export ffff8d546eeb3800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787826832.291935:0:16873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787826832.292001:0:16873:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1787826832.292005:0:16873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787826832.292015:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826832.292021:0:16873:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787826832.292028:0:16873:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d53444b0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826832.292039:0:16873:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d53437f3370) has exports, disconnecting them 00000020:00080000:2.0:1787826832.292044:0:16873:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d53444b0000), last request at 1787826821 00000020:00000080:2.0:1787826832.292048:0:16873:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953951 00000020:00080000:2.0:1787826832.292059:0:16873:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d53444b0000): rc 0 00000020:00000080:2.0:1787826832.292064:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d53444b0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787826832.292084:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444b0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787826832.293269:0:16873:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787826832.293273:0:16873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826832.293276:0:16873:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787826832.293280:0:16873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826832.293314:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53444b2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787826832.293426:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826832.293450:0:16873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787826832.293453:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d5342a62000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787826832.293455:0:16873:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5342a62000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787826832.293463:0:16873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787826832.293527:0:16873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787826832.293531:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826832.293535:0:16873:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787826832.293540:0:16873:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d5442bd4800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787826832.293545:0:16873:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d53444fcd28) has exports, disconnecting them 00000020:00080000:3.0:1787826832.293550:0:16873:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d5442bd4800), last request at 1787826821 00000020:00000080:3.0:1787826832.293553:0:16873:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953966 00000020:00080000:3.0:1787826832.293570:0:16873:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5442bd4800): rc 0 00000020:00000080:3.0:1787826832.293572:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d5442bd4800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787826832.293589:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5442bd4800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787826832.294262:0:16873:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787826832.294265:0:16873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826832.294267:0:16873:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787826832.294271:0:16873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826832.294375:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5442bd6000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787826832.294548:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826832.294557:0:16873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787826832.294560:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d5442bd6800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787826832.294563:0:16873:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5442bd6800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787826832.294568:0:16873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787826832.294630:0:16873:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e5800 1 00000020:00000080:2.0:1787826832.294634:0:16873:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79538f6 00000020:00000080:2.0:1787826832.294639:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d546e144800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787826832.294649:0:16873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787826832.294657:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826832.294660:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d546e144800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787826832.294664:0:16873:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787826832.294669:0:16873:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d53444f99b8) has no exports 00000020:00000080:2.0:1787826832.309981:0:16873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826832.309994:0:16873:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787826832.309998:0:16873:0:(genops.c:885:class_export_put()) final put ffff8d547f8e7000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787826832.310001:0:16873:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f8e7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787826832.310006:0:16873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787826832.310098:0:16873:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d547f8e5000 00000020:02000400:2.0:1787826832.310155:0:16873:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787826832.593410:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826832.785422:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826832.785470:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826832.785494:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134165632 00000100:00100000:0.0:1787826832.785504:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134165632 00000100:00100000:1.0:1787826832.785511:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826832.785543:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826832.785565:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166016 00000100:00100000:3.0:1787826832.785571:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166016 00000100:00100000:0.0:1787826832.785575:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 360 00000100:00100000:1.0:1787826832.785587:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826832.785592:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134165632:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826832.785653:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134165760 00000100:00100000:2.0:1787826832.785658:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134165760 00000100:00100000:0.0:1787826832.785674:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134165632:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826832.785684:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 360 00000100:00100000:2.0:1787826832.785704:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134165888 00000100:00100000:2.0:1787826832.785709:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134165888 00000100:00100000:2.0:1787826832.785746:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 159 00000100:00100000:2.0:1787826832.785759:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+49:2393:x1874672134165760:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826832.785801:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+49:2393:x1874672134165760:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826832.785808:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 159 00000100:00100000:2.0:1787826832.785822:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 160 00000100:00100000:2.0:1787826832.785829:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134165888:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826832.785853:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134165888:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826832.785859:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 160 00000100:00100000:3.0:1787826832.785907:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166144 00000100:00100000:3.0:1787826832.785912:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166144 00000100:00100000:0.0:1787826832.785918:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 74 00000100:00100000:0.0:1787826832.785925:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1874672134166016:12345-192.168.203.6@tcp:400:kworker.0 00000020:00080000:0.0:1787826832.785934:0:9498:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:3.0:1787826832.785951:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:3.0:1787826832.785965:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134166144:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826832.785966:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1874672134166016:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (452us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826832.785980:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 74 00000100:00080000:1.0:1787826832.785988:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826832.785994:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826832.786007:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134166144:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826832.786015:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:0.0:1787826832.794731:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826832.794785:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166272 00000100:00100000:3.0:1787826832.794795:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166272 00000100:00100000:3.0:1787826832.794840:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:3.0:1787826832.794849:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134166272:12345-192.168.203.6@tcp:8:ptlrpcd_01_01.0 00010000:00020000:3.0:1787826832.794886:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826832.806749:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134166272:12345-192.168.203.6@tcp:8:ptlrpcd_01_01.0 Request processed in 11896us (12020us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826832.806761:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:1.0:1787826833.489396:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143672064:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787826833.489402:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 208352185705ns, next at 209352182279ns, rc = 0 00000100:00100000:0.0:1787826833.489404:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143672192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826833.489444:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143672576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826833.489479:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826833.489488:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826833.489527:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672192 00000100:00100000:3.0:1787826833.489529:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672064 00000100:00100000:2.0:1787826833.489535:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672192 00000100:00100000:3.0:1787826833.489536:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672064 00000100:00100000:0.0:1787826833.489542:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143672448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826833.489573:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826833.489583:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787826833.489587:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672448 00000100:00100000:3.0:1787826833.489592:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672448 00000100:00100000:2.0:1787826833.489597:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143672192:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826833.489599:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143672320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826833.489603:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826833.489610:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3617:x1874672143672064:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1787826833.489617:0:8403:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826833.489630:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000004:00000024:2.0:1787826833.489634:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826833.489635:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826833.489646:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143672448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826833.489669:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787826833.489677:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826833.489683:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3617:x1874672143672064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (203us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826833.489693:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787826833.489700:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143672192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:02020000:0.0:1787826833.489706:0:3617:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1787826833.489712:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672320 00000100:00100000:2.0:1787826833.489713:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787826833.489718:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672320 00000100:00100000:3.0:1787826833.489721:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143672448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826833.489730:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787826833.489753:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787826833.489765:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143672320:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787826833.489778:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787826833.489783:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826833.489790:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826833.489814:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143672192:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1787826833.489828:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e154000 x1874672143672448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826833.489841:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143672448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826833.489841:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143672320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826833.489853:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1787826833.489865:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d54533e4000 x1874672143672320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826833.489869:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672576 00000100:00100000:2.0:1787826833.489874:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672576 00000100:00100000:1.0:1787826833.489881:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143672320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826833.489900:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787826833.489906:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143672576:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:2.0:1787826833.489911:0:16591:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826833.489939:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143672576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (150us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826833.489945:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:02020000:3.0:1787826833.489957:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787826833.489961:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787826833.489966:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787826833.489970:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826833.492873:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826833.492878:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826833.492881:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1787826833.492906:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1787826833.492909:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826833.492912:0:3617:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 198 00000100:00080000:0.0:1787826833.492918:0:3617:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826833.492944:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d54533e4000 x1874672143672704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826833.492975:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143672704:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:2.0:1787826833.493019:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826833.493071:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672704 00000100:00100000:1.0:1787826833.493077:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672704 00000100:00100000:1.0:1787826833.493108:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787826833.493115:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143672704:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1787826833.493134:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826833.493184:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143672704:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 68us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826833.493192:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787826833.493227:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826833.493232:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826833.493237:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143672704:0@lo:8:ptlrpcd_00_01.0 00000004:00080000:3.0:1787826833.500100:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1787826833.500107:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826833.500115:0:3618:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 198 00000100:00080000:3.0:1787826833.500124:0:3618:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826833.500156:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547d2b03c0 x1874672143672832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826833.500255:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143672832:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:2.0:1787826833.500316:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826833.500354:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672832 00000100:00100000:3.0:1787826833.500360:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672832 00000100:00100000:3.0:1787826833.500388:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787826833.500393:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143672832:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:3.0:1787826833.500409:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826833.500460:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143672832:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 64us (142us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826833.500467:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787826833.500500:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826833.500506:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826833.500510:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143672832:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:1.0:1787826833.617390:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826834.514044:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143672960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826834.514117:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826834.514256:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672960 00000100:00100000:0.0:1787826834.514264:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672960 00000100:00100000:0.0:1787826834.514305:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787826834.514312:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143672960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826834.514345:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826834.514401:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143672960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826834.514408:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787826834.514592:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143672960:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826834.641475:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826835.026525:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1787826835.026559:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967334 is committed 00000004:00080000:0.0:1787826835.026597:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:3.0:1787826835.026624:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026636:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026642:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026646:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.026650:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026657:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026672:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3509f068 (ffff8d54605a1800) 00010000:00010000:3.0:1787826835.026683:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.026689:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026696:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a79539ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026722:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026729:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026735:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026740:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.026743:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026749:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026757:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x95f49252 (ffff8d54605a1600) 00010000:00010000:3.0:1787826835.026758:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.026760:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026764:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a79539dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026773:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026782:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026785:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026788:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.026789:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026793:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026797:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2ef3d52 (ffff8d54605a1300) 00010000:00010000:3.0:1787826835.026798:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.026800:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026804:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953a07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026812:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026816:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026819:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026822:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.026827:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026830:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026835:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8ac02452 (ffff8d53428dea00) 00010000:00010000:3.0:1787826835.026836:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.026837:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026841:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7953a31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026859:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026862:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026865:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026868:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.026870:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026873:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026877:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x427acf52 (ffff8d53436dba00) 00010000:00010000:3.0:1787826835.026879:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.026884:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026888:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7953a5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026900:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026905:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026917:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026922:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.026925:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026930:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026938:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1b739652 (ffff8d54605a1c00) 00010000:00010000:3.0:1787826835.026941:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.026943:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026949:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953a85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026963:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026978:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026984:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026989:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.026992:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.026999:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027007:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x532e4152 (ffff8d54605a1200) 00010000:00010000:3.0:1787826835.027010:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.027013:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027019:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953aaf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027034:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027040:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027055:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027061:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.027069:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027077:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027085:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4bf9e852 (ffff8d53436db700) 00010000:00010000:3.0:1787826835.027088:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.027090:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027096:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1600/0xc0fefc09a7953ad9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027111:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027116:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027121:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027127:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.027129:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027136:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027143:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x59102352 (ffff8d54745a7300) 00010000:00010000:3.0:1787826835.027145:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.027154:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027160:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953b03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027174:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027180:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027186:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027190:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e1c7c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.027193:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027199:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027207:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d464a52 (ffff8d54745a7200) 00010000:00010000:3.0:1787826835.027209:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.027246:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027253:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7c00/0xc0fefc09a7953b2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027268:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027284:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027291:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027298:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826835.027301:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027308:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027317:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfd049252 (ffff8d53436db200) 00010000:00010000:3.0:1787826835.027319:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826835.027322:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.027327:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a7953b57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826835.665360:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826836.689349:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826837.073471:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143673088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.073484:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143673216:0@lo:400:kworker.0 00000100:00080000:3.0:1787826837.073497:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826837.073502:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826837.073506:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826837.073513:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 208 00000100:00080000:3.0:1787826837.073518:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826837.073525:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826837.073546:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826837.073546:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826837.073546:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143673344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826837.073563:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f74e580 x1874672143673728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826837.073592:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826837.073606:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143673600:0@lo:400:kworker.0 00000100:00100000:2.0:1787826837.073625:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143673728:0@lo:8:kworker.0 00000100:00100000:0.0:1787826837.073635:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673216 00000100:00100000:0.0:1787826837.073643:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673216 00000100:00080000:3.0:1787826837.073644:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826837.073650:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826837.073652:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787826837.073658:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826837.073660:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 208 00000100:00080000:3.0:1787826837.073666:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826837.073671:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826837.073682:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826837.073685:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826837.073688:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f74cf00 x1874672143674240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826837.073693:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787826837.073694:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143673856:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.073705:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143673216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826837.073714:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143674240:0@lo:8:kworker.0 00000100:00100000:1.0:1787826837.073728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826837.073744:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673728 00000100:00100000:3.0:1787826837.073749:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673728 00000100:00100000:1.0:1787826837.073766:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143674368:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.073770:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143673216:12345-0@lo:400:kworker.0 Request processed in 63us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826837.073774:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826837.073776:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673856 00000100:00100000:3.0:1787826837.073782:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673856 00000100:00100000:0.0:1787826837.073784:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787826837.073818:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826837.073826:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143674240 00000100:00100000:0.0:1787826837.073829:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143674240 00000100:00100000:2.0:1787826837.073836:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143674368 00000100:00100000:2.0:1787826837.073841:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143674368 00000100:00100000:1.0:1787826837.073853:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673088 00000100:00100000:3.0:1787826837.073853:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787826837.073863:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787826837.073868:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673088 00000100:00100000:3.0:1787826837.073868:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143673856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.073872:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143673728:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826837.073884:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00010000:00020000:0.0:1787826837.073894:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826837.073895:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143674368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826837.073906:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787826837.073915:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143673088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826837.073923:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143673856:12345-0@lo:400:kworker.0 Request processed in 59us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826837.073932:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787826837.073952:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826837.073958:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143674240:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826837.073963:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143674368:12345-0@lo:400:kworker.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826837.073966:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143673728:12345-0@lo:8:kworker.0 Request processed in 93us (285us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826837.073966:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143673088:12345-0@lo:400:kworker.0 Request processed in 52us (421us total) trans 0 rc 0/0 00010000:00020000:3.0:1787826837.073973:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826837.073979:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787826837.073979:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787826837.073992:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787826837.074013:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673344 00000100:00100000:1.0:1787826837.074018:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673344 00000100:00080000:0.0:1787826837.074022:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1787826837.074025:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673600 00000100:00100000:3.0:1787826837.074029:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143674240:12345-0@lo:8:kworker.0 Request processed in 66us (258us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826837.074031:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673600 00000100:00080000:0.0:1787826837.074032:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826837.074040:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143674240:0@lo:8:kworker.0 00000100:00100000:3.0:1787826837.074044:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787826837.074045:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787826837.074055:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787826837.074057:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143673344:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826837.074059:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826837.074064:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143673728:0@lo:8:kworker.0 00000100:00100000:2.0:1787826837.074065:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787826837.074082:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826837.074091:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143673600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826837.074095:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143673344:12345-0@lo:400:kworker.0 Request processed in 39us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826837.074103:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787826837.074111:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143673472:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.074112:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143673216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826837.074147:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143673600:12345-0@lo:400:kworker.0 Request processed in 62us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826837.074158:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787826837.074159:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787826837.074160:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f74e940 x1874672143674368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826837.074160:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143673344:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.074172:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143674368:0@lo:400:kworker.0 00010000:00080000:0.0:1787826837.074188:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f74c3c0 x1874672143673856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826837.074189:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673472 00000100:00100000:1.0:1787826837.074193:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673472 00000100:00100000:3.0:1787826837.074194:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143674112:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.074202:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143673856:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.074240:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143673600:0@lo:400:kworker.0 00000100:00100000:1.0:1787826837.074241:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787826837.074248:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143673472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.074251:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143673088:0@lo:400:kworker.0 00000100:00100000:3.0:1787826837.074264:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826837.074292:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143673984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826837.074307:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143673472:12345-0@lo:400:kworker.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826837.074314:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787826837.074319:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143673472:0@lo:400:kworker.0 00000100:00100000:0.0:1787826837.074320:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826837.074331:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143674112 00000100:00100000:1.0:1787826837.074336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143674112 00000100:00100000:2.0:1787826837.074338:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143673984 00000100:00100000:2.0:1787826837.074344:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143673984 00000100:00080000:0.0:1787826837.074378:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826837.074378:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1787826837.074383:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826837.074387:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143674112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826837.074392:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787826837.074415:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143673984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826837.074442:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143674112:12345-0@lo:400:kworker.0 Request processed in 55us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826837.074449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:2.0:1787826837.074463:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f74e1c0 x1874672143674112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826837.074474:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143673984:12345-0@lo:400:kworker.0 Request processed in 70us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826837.074478:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143674112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826837.074487:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787826837.074802:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143673984:0@lo:400:kworker.0 00010000:00010000:1.0:1787826837.713375:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826837.905092:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826837.905144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826837.905156:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167040 00000100:00100000:0.0:1787826837.905167:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167040 00000100:00100000:0.0:1787826837.905258:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 80 00000100:00100000:0.0:1787826837.905269:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134167040:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:3.0:1787826837.905278:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00020000:0.0:1787826837.905297:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826837.905316:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826837.905345:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134167040:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 78us (262us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826837.905352:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 80 00000100:00100000:1.0:1787826837.905412:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166912 00000100:00100000:3.0:1787826837.905417:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826837.905419:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166912 00000100:00100000:2.0:1787826837.905453:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166656 00000100:00100000:2.0:1787826837.905460:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166656 00000100:00100000:1.0:1787826837.905473:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166784 00000100:00100000:1.0:1787826837.905478:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166784 00000100:00100000:2.0:1787826837.905503:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 362 00000100:00100000:3.0:1787826837.905514:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167168 00000100:00100000:2.0:1787826837.905515:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134166656:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826837.905518:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 165 00000100:00100000:3.0:1787826837.905520:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167168 00000100:00100000:1.0:1787826837.905531:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134166912:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787826837.905564:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826837.905569:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826837.905570:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826837.905582:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 78 00000100:00100000:3.0:1787826837.905594:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134167168:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826837.905601:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134166656:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 86us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826837.905602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:1.0:1787826837.905610:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134166912:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 78us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826837.905618:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 362 00000100:00100000:0.0:1787826837.905620:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2390:x1874672134166784:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826837.905627:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 165 00000100:00100000:3.0:1787826837.906179:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134167168:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 587us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826837.906187:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 78 00000100:00100000:0.0:1787826837.906450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2390:x1874672134166784:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 835us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826837.906459:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:0.0:1787826838.609384:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826838.609428:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826838.609428:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143674752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826838.609499:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826838.609506:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826838.609559:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143674752 00000100:00100000:3.0:1787826838.609564:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143674496 00000100:00100000:1.0:1787826838.609567:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143674752 00000100:00100000:3.0:1787826838.609571:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143674496 00000100:00100000:2.0:1787826838.609573:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826838.609583:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143674624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826838.609613:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826838.609627:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787826838.609628:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143674624 00000100:00100000:3.0:1787826838.609633:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143674624 00000100:00100000:1.0:1787826838.609642:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143674752:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826838.609659:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787826838.609667:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787826838.609674:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143674496:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:1.0:1787826838.609678:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826838.609681:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143674624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826838.609698:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787826838.609708:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826838.609754:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143674496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826838.609763:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143674752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826838.609767:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787826838.609768:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143674624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826838.609779:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787826838.609783:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1787826838.609804:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d545aa7e580 x1874672143674496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826838.609813:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f63480 x1874672143674624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826838.609844:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143674624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826838.609846:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826838.609865:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143674752:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787826838.737429:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826839.633446:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143674880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826839.633508:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826839.633642:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143674880 00000100:00100000:0.0:1787826839.633649:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143674880 00000100:00100000:0.0:1787826839.633704:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787826839.633713:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143674880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826839.633744:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826839.633794:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143674880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826839.633801:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787826839.633831:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143674880:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826839.761353:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826840.785336:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826841.809396:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826842.193473:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826842.193480:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826842.193483:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826842.193491:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 211 00000100:00080000:3.0:1787826842.193497:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826842.193504:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826842.193519:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143675392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826842.193528:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f703480 x1874672143675648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826842.193585:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826842.193589:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826842.193591:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826842.193595:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 211 00000100:00080000:3.0:1787826842.193599:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826842.193603:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826842.193618:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f701e00 x1874672143676160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826842.193630:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826842.193652:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143675648:0@lo:8:kworker.0 00000100:00100000:3.0:1787826842.193680:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143675264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826842.193723:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826842.193732:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826842.193779:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f702940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143675904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826842.193783:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143676160:0@lo:8:kworker.0 00000100:00100000:3.0:1787826842.193852:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143675136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826842.193890:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826842.193901:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143676032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826842.193921:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f702580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143675776:0@lo:400:kworker.0 00000100:00100000:2.0:1787826842.193949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826842.193986:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826842.193992:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675392 00000100:00100000:0.0:1787826842.193996:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826842.194001:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143675008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826842.194001:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675392 00000100:00100000:2.0:1787826842.194058:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826842.194059:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675648 00000100:00100000:0.0:1787826842.194066:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675648 00000100:00100000:2.0:1787826842.194098:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143675520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826842.194101:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676160 00000100:00100000:0.0:1787826842.194107:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676160 00000100:00100000:0.0:1787826842.194131:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787826842.194142:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826842.194150:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143675648:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787826842.194171:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826842.194346:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143675648:12345-0@lo:8:kworker.0 Request processed in 199us (624us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826842.194354:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787826842.194388:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826842.194393:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143676288:0@lo:400:kworker.0 00000100:00100000:0.0:1787826842.194403:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143676160:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787826842.194426:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826842.194438:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826842.194479:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143676160:12345-0@lo:8:kworker.0 Request processed in 80us (667us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826842.194486:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787826842.194497:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676288 00000100:00100000:2.0:1787826842.194598:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675136 00000100:00100000:2.0:1787826842.194606:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675136 00000100:00100000:0.0:1787826842.194612:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676288 00000100:00100000:0.0:1787826842.194667:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787826842.194673:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676032 00000100:00100000:0.0:1787826842.194681:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143676288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826842.194682:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676032 00000100:00100000:2.0:1787826842.194727:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787826842.194737:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143675136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826842.194866:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143675136:12345-0@lo:400:kworker.0 Request processed in 130us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826842.194875:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787826842.194894:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787826842.194903:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143676032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826842.194910:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143676288:12345-0@lo:400:kworker.0 Request processed in 229us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826842.194945:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143676032:12345-0@lo:400:kworker.0 Request processed in 43us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826842.194952:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787826842.194974:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675264 00000100:00100000:2.0:1787826842.194978:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675264 00000100:00100000:2.0:1787826842.195006:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675520 00000100:00100000:2.0:1787826842.195008:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675520 00000100:00100000:2.0:1787826842.195033:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787826842.195038:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143675264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826842.195075:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143675264:12345-0@lo:400:kworker.0 Request processed in 36us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826842.195081:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787826842.195091:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787826842.195097:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143675520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826842.195122:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143675520:12345-0@lo:400:kworker.0 Request processed in 26us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826842.195142:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787826842.195144:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787826842.195186:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826842.195191:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826842.195202:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143675520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826842.195856:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787826842.195870:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143675392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826842.195984:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675008 00000100:00100000:1.0:1787826842.195991:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675008 00000100:00100000:1.0:1787826842.196296:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787826842.196306:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143675008:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787826842.196410:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f7003c0 x1874672143676288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826842.196423:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143676288:0@lo:400:kworker.0 00000100:00080000:0.0:1787826842.197179:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826842.197190:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00010000:00080000:2.0:1787826842.197191:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f700000 x1874672143676032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826842.197201:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143675648:0@lo:8:kworker.0 00000100:00100000:1.0:1787826842.197239:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143675008:12345-0@lo:400:kworker.0 Request processed in 934us (3179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826842.197247:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143675392:12345-0@lo:400:kworker.0 Request processed in 1378us (3617us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826842.197254:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787826842.197254:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787826842.197260:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1787826842.197267:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826842.197273:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143676160:0@lo:8:kworker.0 00000100:00100000:0.0:1787826842.197318:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826842.197336:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826842.197354:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675776 00000100:00100000:1.0:1787826842.197360:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675776 00000100:00100000:2.0:1787826842.197373:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143676032:0@lo:400:kworker.0 00000100:00100000:0.0:1787826842.197396:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143675136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826842.197414:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143675392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826842.197416:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143675264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826842.197431:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787826842.197438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143675904 00000100:00100000:0.0:1787826842.197445:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143675904 00000100:00100000:1.0:1787826842.197445:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143675776:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787826842.197483:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826842.197487:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143675008:0@lo:400:kworker.0 00000100:00080000:3.0:1787826842.197491:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826842.197514:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143675776:12345-0@lo:400:kworker.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826842.197518:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787826842.197526:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787826842.197532:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143675904:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826842.197585:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f702580 x1874672143675776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826842.197599:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f702580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143675776:0@lo:400:kworker.0 00000100:00100000:0.0:1787826842.197607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143675904:12345-0@lo:400:kworker.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826842.197617:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787826842.197634:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f702940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143675904:0@lo:400:kworker.0 00010000:00010000:1.0:1787826842.834135:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826843.025324:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826843.025380:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826843.025400:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167296 00000100:00100000:0.0:1787826843.025410:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167296 00000100:00100000:3.0:1787826843.025438:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826843.025466:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826843.025472:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 364 00000100:00100000:0.0:1787826843.025485:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134167296:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826843.025500:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826843.025525:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167424 00000100:00100000:3.0:1787826843.025529:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167424 00000100:00100000:1.0:1787826843.025538:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167552 00000100:00100000:1.0:1787826843.025543:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167552 00000100:00100000:0.0:1787826843.025553:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134167296:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826843.025561:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 364 00000100:00100000:3.0:1787826843.025596:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 171 00000100:00100000:1.0:1787826843.025604:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 172 00000100:00100000:3.0:1787826843.025609:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f702940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2391:x1874672134167424:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826843.025618:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134167552:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:2.0:1787826843.025633:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826843.025639:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826843.025652:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167680 00000100:00100000:2.0:1787826843.025658:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167680 00000100:00100000:3.0:1787826843.025658:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f702940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2391:x1874672134167424:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826843.025676:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 171 00000100:00100000:2.0:1787826843.025685:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167808 00000100:00100000:1.0:1787826843.025690:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134167552:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826843.025696:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167808 00000100:00100000:1.0:1787826843.025702:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 172 00000100:00100000:3.0:1787826843.025724:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:3.0:1787826843.025731:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134167680:12345-192.168.203.6@tcp:8:kworker.0 00010000:00020000:3.0:1787826843.025752:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826843.025800:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134167680:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 67us (361us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826843.025849:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 81 00000100:00100000:2.0:1787826843.025856:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134167808:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826843.025897:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134167808:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 40us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826843.025908:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 81 00000100:00080000:2.0:1787826843.025924:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826843.026019:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:3.0:1787826843.729390:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143676544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826843.729391:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143676416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826843.729471:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826843.729485:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826843.729506:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143676672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826843.729542:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826843.729550:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676544 00000100:00100000:3.0:1787826843.729556:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676544 00000100:00100000:0.0:1787826843.729568:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676416 00000100:00100000:0.0:1787826843.729573:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676416 00000100:00100000:3.0:1787826843.729604:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787826843.729606:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676672 00000100:00100000:0.0:1787826843.729610:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676672 00000100:00100000:1.0:1787826843.729612:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787826843.729618:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143676544:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826843.729623:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143676416:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826843.729629:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826843.729636:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143676672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826843.729651:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787826843.729651:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787826843.729652:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787826843.729701:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143676416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826843.729707:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143676544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826843.729713:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787826843.729720:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787826843.729722:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143676672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826843.729731:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1787826843.729754:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d545aa7e580 x1874672143676672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826843.729773:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143676544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826843.729774:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143676672:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787826843.729794:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e157480 x1874672143676416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826843.729806:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143676416:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826843.857331:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826844.754414:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826844.754442:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143676800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826844.754516:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826844.754604:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676800 00000100:00100000:0.0:1787826844.754625:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676800 00000100:00100000:0.0:1787826844.754694:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787826844.754704:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143676800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826844.754742:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826844.754837:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143676800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826844.754844:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787826844.754941:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143676800:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826844.883311:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826845.552588:0:17294:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826845.552592:0:17294:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787826845.552593:0:17294:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787826845.552719:0:17294:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d5442bd0800 00000020:01000004:2.0:1787826845.552733:0:17294:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787826845.552746:0:17294:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826845.552758:0:17294:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d53444f99b8) 00000020:00000080:2.0:1787826845.552773:0:17294:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787826845.577787:0:17294:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787826845.579600:0:17294:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787826845.579868:0:17294:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787826845.579994:0:17294:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787826845.580141:0:17294:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787826845.580375:0:17294:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787826845.580527:0:17294:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787826845.581262:0:17294:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787826845.581441:0:17294:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787826845.581451:0:17294:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787826845.581459:0:17294:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953b7a 00000020:01000004:2.0:1787826845.581464:0:17294:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787826845.581482:0:17294:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787826845.581485:0:17294:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787826845.581498:0:17294:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787826845.581524:0:17294:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787826845.581528:0:17294:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787826845.586465:0:17294:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787826845.586500:0:17294:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787826845.586503:0:17294:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787826845.586504:0:17294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826845.586505:0:17294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826845.586506:0:17294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826845.586507:0:17294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826845.586508:0:17294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826845.586509:0:17294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826845.586510:0:17294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826845.586511:0:17294:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787826845.586513:0:17294:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787826845.586515:0:17294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826845.586515:0:17294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826845.586516:0:17294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826845.586517:0:17294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826845.586517:0:17294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826845.586518:0:17294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826845.586519:0:17294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826845.586519:0:17294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826845.586520:0:17294:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787826845.586543:0:17294:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787826845.586562:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143676928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826845.586627:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.586670:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5450f03300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.586691:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143676928 00000100:00100000:1.0:1787826845.586699:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143676928 00000100:00100000:1.0:1787826845.586755:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787826845.586764:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:17294:x1874672143676928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787826845.586804:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787826845.586808:0:6479:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787826845.586812:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787826845.587114:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:17294:x1874672143676928:12345-0@lo:253:mount.lustre.0 Request processed in 350us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.587140:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787826845.587146:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143676928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826845.587159:0:17294:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787826845.587161:0:17294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826845.587163:0:17294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826845.587165:0:17294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826845.587167:0:17294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826845.587168:0:17294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826845.587176:0:17294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826845.587177:0:17294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826845.587178:0:17294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826845.587179:0:17294:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787826845.587199:0:17294:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d5442bd0800 from lustre-OST0000 10000000:01000000:2.0:1787826845.587241:0:17294:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787826845.587244:0:17294:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787826845.587252:0:17294:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:2.0:1787826845.587260:0:17294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826845.587323:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826845.587363:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.587389:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826845.587420:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677056 00000100:00100000:0.0:1787826845.587426:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677056 00000100:00100000:0.0:1787826845.587463:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787826845.587471:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:17294:x1874672143677056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826845.587550:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:17294:x1874672143677056:12345-0@lo:501:mount.lustre.0 Request processed in 80us (186us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826845.587567:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787826845.587579:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677056:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787826845.587595:0:17294:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787826845.587613:0:17294:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787826845.587618:0:17294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.587626:0:17294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826845.587650:0:17294:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d5442bd0800 10000000:01000000:2.0:1787826845.587655:0:17294:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787826845.587659:0:17294:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787826845.587661:0:17294:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826845.587665:0:17294:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787826845.587667:0:17294:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787826845.587686:0:17294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.587699:0:17294:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.587708:0:17294:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826845.587721:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826845.587749:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.587769:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.587792:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677184 00000100:00100000:1.0:1787826845.587796:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677184 00000100:00100000:1.0:1787826845.587817:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787826845.587822:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:17294:x1874672143677184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826845.587828:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826845.587844:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953b88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953b81 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.587865:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953b81 expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.587875:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953b81 expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.587884:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7000, rc 0) 00000100:00100000:1.0:1787826845.587915:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677184:12345-0@lo:101:mount.lustre.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.587930:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787826845.587930:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826845.587946:0:17294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.587956:0:17294:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826845.588556:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:2.0:1787826845.588909:0:17294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826845.589931:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1787826845.589950:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:2.0:1787826845.589958:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:2.0:1787826845.589965:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:2.0:1787826845.589971:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:2.0:1787826845.589981:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:2.0:1787826845.589993:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:2.0:1787826845.590008:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:2.0:1787826845.590021:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:2.0:1787826845.590035:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:2.0:1787826845.590050:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:2.0:1787826845.590057:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:2.0:1787826845.590067:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:2.0:1787826845.590070:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:2.0:1787826845.590129:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826845.590170:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.590205:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.590251:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677312 00000100:00100000:1.0:1787826845.590257:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677312 00000100:00100000:1.0:1787826845.590294:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787826845.590301:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826845.590406:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677312:12345-0@lo:501:mount.lustre.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.590412:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787826845.590421:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826845.590447:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826845.590475:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.590495:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.590508:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677440 00000100:00100000:1.0:1787826845.590516:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677440 00000100:00100000:1.0:1787826845.590538:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787826845.590542:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826845.590599:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677440:12345-0@lo:503:mount.lustre.0 Request processed in 56us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.590605:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787826845.590617:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787826845.590868:0:17294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826845.590900:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826845.590925:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.590940:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826845.590970:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677568 00000100:00100000:0.0:1787826845.590975:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677568 00000100:00100000:0.0:1787826845.591015:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787826845.591032:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826845.591120:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677568:12345-0@lo:502:mount.lustre.0 Request processed in 98us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826845.591127:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787826845.591137:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826845.591266:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1787826845.591282:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:2.0:1787826845.591289:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:2.0:1787826845.591296:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:2.0:1787826845.591302:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:2.0:1787826845.591309:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:2.0:1787826845.591316:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:2.0:1787826845.591322:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:2.0:1787826845.591328:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:2.0:1787826845.591335:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:2.0:1787826845.591363:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:2.0:1787826845.591370:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:2.0:1787826845.591385:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826845.591412:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.591436:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.591454:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677696 00000100:00100000:1.0:1787826845.591462:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677696 00000100:00100000:1.0:1787826845.591506:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787826845.591514:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826845.591585:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677696:12345-0@lo:502:mount.lustre.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.591593:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787826845.591601:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826845.591642:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:2.0:1787826845.591649:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787826845.592061:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826845.592068:0:17298:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787826845.592074:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826845.592076:0:17298:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787826845.592082:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826845.592094:0:17298:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5450eecd28) 00000020:00000080:1.0:1787826845.592115:0:17298:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787826845.592122:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826845.592180:0:17298:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5442bd0800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787826845.592188:0:17298:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826845.592195:0:17298:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953b96 00010000:00010000:1.0:1787826845.594702:0:17298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1787826845.595054:0:17298:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 12884901888 lx: 1874672143596416 gen 0 00000001:00080000:1.0:1787826845.595083:0:17298:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 12884901889 srv lr: 12884901888 lx: 1874672143666816 gen 0 00000001:00080000:1.0:1787826845.595098:0:17298:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 12884901891 srv lr: 12884901888 lx: 1874672134159488 gen 0 00000001:00000004:1.0:1787826845.595118:0:17298:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901891 00080000:10000000:1.0:1787826845.596096:0:17298:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:3.0:1787826845.596891:0:17298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787826845.596902:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826845.596914:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826845.596916:0:17298:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787826845.596923:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787826845.596926:0:17298:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787826845.596928:0:17298:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826845.596931:0:17298:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826845.596933:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787826845.596936:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826845.596938:0:17298:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787826845.596941:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826845.596944:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826845.596946:0:17298:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787826845.596950:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787826845.596951:0:17298:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787826845.596953:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826845.596955:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826845.596955:0:17298:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787826845.596957:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826845.596958:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826845.596960:0:17298:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787826845.596962:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787826845.596978:0:17298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826845.596980:0:17298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826845.596981:0:17298:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787826845.596984:0:17298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000020:01000000:2.0:1787826845.597056:0:17294:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787826845.597090:0:17294:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787826845.597110:0:17294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.597122:0:17294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826845.597133:0:17294:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5442bd0800 from 1 10000000:01000000:2.0:1787826845.597137:0:17294:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826845.597183:0:17294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.597192:0:17294:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.597207:0:17294:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826845.597252:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826845.597326:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826845.597390:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677824 00000100:00100000:1.0:1787826845.597397:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677824 00000100:00100000:2.0:1787826845.597403:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.597441:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787826845.597452:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:17294:x1874672143677824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826845.597464:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826845.597475:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7400/0xc0fefc09a7953bb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953bb2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.597498:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7400/0xc0fefc09a7953bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953bb2 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.597509:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7400/0xc0fefc09a7953bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953bb2 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.597517:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7400, rc 0) 00000100:00100000:1.0:1787826845.597559:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143677824:12345-0@lo:101:mount.lustre.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.597566:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787826845.597592:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826845.597604:0:17294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.597611:0:17294:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826845.598408:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:3.0:1787826845.598637:0:17294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826845.598827:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:3.0:1787826845.598852:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:3.0:1787826845.598866:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:3.0:1787826845.598879:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:3.0:1787826845.598892:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:3.0:1787826845.598909:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:3.0:1787826845.598914:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:3.0:1787826845.598985:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826845.599038:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.599077:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.599096:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143677952 00000100:00100000:1.0:1787826845.599105:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143677952 00000100:00100000:1.0:1787826845.599160:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787826845.599174:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143677952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826845.599308:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143677952:12345-0@lo:501:mount.lustre.0 Request processed in 137us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.599317:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787826845.599321:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143677952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826845.599367:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826845.599405:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.599426:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826845.599444:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678080 00000100:00100000:0.0:1787826845.599450:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678080 00000100:00100000:0.0:1787826845.599491:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787826845.599501:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143678080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826845.599573:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143678080:12345-0@lo:503:mount.lustre.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826845.599587:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787826845.599599:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787826845.599839:0:17294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787826845.599874:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826845.599902:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.599922:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.599950:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678208 00000100:00100000:1.0:1787826845.599962:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678208 00000100:00100000:1.0:1787826845.599997:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1787826845.600008:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143678208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826845.600103:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826845.600106:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143678208:12345-0@lo:502:mount.lustre.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.600116:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000040:00080000:3.0:1787826845.600246:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1787826845.600270:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:3.0:1787826845.600285:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:3.0:1787826845.600300:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:3.0:1787826845.600316:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000100:00100000:3.0:1787826845.600351:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826845.600389:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.600412:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.600430:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678336 00000100:00100000:1.0:1787826845.600436:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678336 00000100:00100000:1.0:1787826845.600460:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787826845.600465:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143678336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826845.600536:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143678336:12345-0@lo:502:mount.lustre.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.600543:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787826845.600554:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f701e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826845.600603:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:2.0:1787826845.600613:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1787826845.601013:0:17302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826845.601022:0:17302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826845.601025:0:17302:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787826845.601032:0:17302:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5442bd0800 00000020:00000080:1.0:1787826845.601035:0:17302:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787826845.601044:0:17302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826845.601046:0:17302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826845.601048:0:17302:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787826845.601051:0:17302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826845.601054:0:17302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826845.601056:0:17302:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787826845.601060:0:17302:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5442bd0800 00000020:00000080:1.0:1787826845.601071:0:17302:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787826845.601123:0:17302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826845.601126:0:17302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826845.601127:0:17302:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787826845.601130:0:17302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 7 count 7 00000020:01000000:2.0:1787826845.601203:0:17294:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787826845.601280:0:17294:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826845.601298:0:17294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.601308:0:17294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826845.601371:0:17294:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787826845.601375:0:17294:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d5442bd0800 10000000:01000000:2.0:1787826845.601379:0:17294:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d5442bd0800 10000000:01000000:2.0:1787826845.601385:0:17294:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826845.601390:0:17294:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5442bd0800 from 1 10000000:01000000:2.0:1787826845.601393:0:17294:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826845.601418:0:17294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.601427:0:17294:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.601447:0:17294:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826845.601463:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826845.601502:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.601552:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.601554:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678464 00000100:00100000:1.0:1787826845.601569:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678464 00000100:00100000:1.0:1787826845.601607:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787826845.601617:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:17294:x1874672143678464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826845.601640:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826845.601661:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953bc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953bc0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.601685:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953bc0 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.601701:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953bc0 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.601710:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7e00, rc 0) 00000100:00100000:1.0:1787826845.601755:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678464:12345-0@lo:101:mount.lustre.0 Request processed in 140us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.601762:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787826845.602131:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826845.602144:0:17294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.602154:0:17294:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826845.603300:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000040:00080000:2.0:1787826845.603511:0:17294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826845.603679:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:2.0:1787826845.603700:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:2.0:1787826845.603709:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:2.0:1787826845.603723:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:2.0:1787826845.603747:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:2.0:1787826845.603764:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:2.0:1787826845.603784:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:2.0:1787826845.603796:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:2.0:1787826845.603819:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:2.0:1787826845.603838:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:2.0:1787826845.603859:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:2.0:1787826845.603884:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:2.0:1787826845.603896:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:2.0:1787826845.603920:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:2.0:1787826845.603936:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:2.0:1787826845.603950:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:2.0:1787826845.603967:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:2.0:1787826845.603983:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:2.0:1787826845.604000:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:2.0:1787826845.604011:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:2.0:1787826845.604023:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:2.0:1787826845.604033:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:2.0:1787826845.604045:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:2.0:1787826845.604057:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:2.0:1787826845.604071:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 160 off12472 00000040:00080000:2.0:1787826845.604082:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12696 00000040:00080000:2.0:1787826845.604099:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12920 00000040:00080000:2.0:1787826845.604133:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off13000 00000040:00080000:2.0:1787826845.604153:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13224 00000040:00080000:2.0:1787826845.604355:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13448 00000040:00080000:2.0:1787826845.604380:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13536 00000040:00080000:2.0:1787826845.604400:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13664 00000040:00080000:2.0:1787826845.604422:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13808 00000040:00080000:2.0:1787826845.604439:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13936 00000040:00080000:2.0:1787826845.604456:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14160 00000040:00080000:2.0:1787826845.604472:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14384 00000040:00080000:2.0:1787826845.604490:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14464 00000040:00080000:2.0:1787826845.604508:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14688 00000040:00080000:2.0:1787826845.604523:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14912 00000040:00080000:2.0:1787826845.604542:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 88 off15000 00000040:00080000:2.0:1787826845.604564:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 128 off15128 00000040:00080000:2.0:1787826845.604581:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].42, 144 off15272 00000040:00080000:2.0:1787826845.604599:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].43, 128 off15400 00000040:00080000:2.0:1787826845.604633:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].44, 224 off15624 00000040:00080000:2.0:1787826845.604653:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].45, 224 off15848 00000040:00080000:2.0:1787826845.604667:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].46, 80 off15928 00000040:00080000:2.0:1787826845.604697:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].47, 224 off16152 00000040:00080000:2.0:1787826845.604714:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].48, 232 off16384 00000040:00080000:2.0:1787826845.604846:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].49, 224 off16608 00000040:00080000:2.0:1787826845.604870:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].50, 120 off16728 00000040:00080000:2.0:1787826845.604889:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].51, 224 off16952 00000040:00080000:2.0:1787826845.604894:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 51 count 51 00000100:00100000:2.0:1787826845.604965:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826845.605018:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.605063:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54745843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826845.605069:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678592 00000100:00100000:3.0:1787826845.605076:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678592 00000100:00100000:3.0:1787826845.605118:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787826845.605127:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826845.605245:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678592:12345-0@lo:501:mount.lustre.0 Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826845.605258:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826845.605260:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787826845.605297:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826845.605334:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.605369:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54745843c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.605381:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678720 00000100:00100000:1.0:1787826845.605387:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678720 00000100:00100000:1.0:1787826845.605421:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787826845.605431:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826845.605526:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678720:12345-0@lo:503:mount.lustre.0 Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826845.605534:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826845.605536:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000040:00080000:2.0:1787826845.605826:0:17294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826845.605869:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826845.605906:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.605923:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.605945:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678848 00000100:00100000:1.0:1787826845.605951:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678848 00000100:00100000:1.0:1787826845.605987:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787826845.605995:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826845.606100:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678848:12345-0@lo:502:mount.lustre.0 Request processed in 105us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826845.606110:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826845.606122:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000040:00080000:2.0:1787826845.606267:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:2.0:1787826845.606296:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:2.0:1787826845.606317:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:2.0:1787826845.606337:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:2.0:1787826845.606373:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:2.0:1787826845.606401:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:2.0:1787826845.606416:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:2.0:1787826845.606432:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:2.0:1787826845.606457:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:2.0:1787826845.606472:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:2.0:1787826845.606485:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:2.0:1787826845.606499:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:2.0:1787826845.606513:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:2.0:1787826845.606526:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:2.0:1787826845.606540:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:2.0:1787826845.606553:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:2.0:1787826845.606566:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:2.0:1787826845.606578:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:2.0:1787826845.606590:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:2.0:1787826845.606600:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:2.0:1787826845.606611:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:2.0:1787826845.606634:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:2.0:1787826845.606652:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:2.0:1787826845.606664:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:2.0:1787826845.606678:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 160 off12472 00000040:00080000:2.0:1787826845.606692:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12696 00000040:00080000:2.0:1787826845.606704:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12920 00000040:00080000:2.0:1787826845.606717:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off13000 00000040:00080000:2.0:1787826845.606729:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13224 00000040:00080000:2.0:1787826845.606742:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13448 00000040:00080000:2.0:1787826845.606753:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13536 00000040:00080000:2.0:1787826845.606766:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13664 00000040:00080000:2.0:1787826845.606778:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13808 00000040:00080000:2.0:1787826845.606792:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13936 00000040:00080000:2.0:1787826845.606804:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14160 00000040:00080000:2.0:1787826845.606818:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14384 00000040:00080000:2.0:1787826845.606832:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14464 00000040:00080000:2.0:1787826845.606856:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14688 00000040:00080000:2.0:1787826845.606870:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14912 00000040:00080000:2.0:1787826845.606883:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 88 off15000 00000040:00080000:2.0:1787826845.606895:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 128 off15128 00000040:00080000:2.0:1787826845.606916:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].42, 144 off15272 00000040:00080000:2.0:1787826845.606928:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].43, 128 off15400 00000040:00080000:2.0:1787826845.606939:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].44, 224 off15624 00000040:00080000:2.0:1787826845.606953:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].45, 224 off15848 00000040:00080000:2.0:1787826845.606970:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].46, 80 off15928 00000040:00080000:2.0:1787826845.606985:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].47, 224 off16152 00000040:00080000:2.0:1787826845.606998:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].48, 232 off16384 00000100:00100000:2.0:1787826845.607024:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826845.607060:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.607084:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826845.607098:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143678976 00000100:00100000:3.0:1787826845.607103:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143678976 00000100:00100000:3.0:1787826845.607137:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787826845.607145:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826845.607259:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143678976:12345-0@lo:502:mount.lustre.0 Request processed in 114us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.607269:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787826845.607270:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143678976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826845.607400:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].49, 224 off16608 00000040:00080000:2.0:1787826845.607425:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].50, 120 off16728 00000100:00100000:2.0:1787826845.607444:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143679104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826845.607475:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.607497:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826845.607507:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143679104 00000100:00100000:3.0:1787826845.607513:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143679104 00000100:00100000:3.0:1787826845.607542:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787826845.607549:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143679104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826845.607633:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143679104:12345-0@lo:502:mount.lustre.0 Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.607641:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787826845.607644:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143679104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826845.607685:0:17294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].51, 224 off16952 00000040:00080000:2.0:1787826845.607692:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787826845.608069:0:17305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787826845.608082:0:17305:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d53444fcd28) 00000020:00000080:2.0:1787826845.608100:0:17305:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787826845.608173:0:17305:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5442bd0800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826845.608177:0:17305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5442bd0800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826845.608179:0:17305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd0800 3 00010000:00080000:2.0:1787826845.608204:0:17305:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d547d17f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1787826845.609800:0:17305:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:2.0:1787826845.609953:0:17305:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826845.610013:0:17305:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826845.610026:0:17305:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a7953bd5 00000100:00080000:2.0:1787826845.610037:0:17305:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826845.610041:0:17305:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d547d17f800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826845.610069:0:17305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d545326ad00 x1874672143679232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826845.610101:0:17305:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787826845.610185:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826845.610189:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826845.610191:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826845.610196:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 217 00000100:00080000:2.0:1787826845.610200:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826845.610204:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826845.610240:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53439c0f00 x1874672143679872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826845.610245:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143679360:0@lo:400:kworker.0 00000100:00080000:2.0:1787826845.610284:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826845.610287:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826845.610289:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826845.610293:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 217 00000100:00080000:2.0:1787826845.610296:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826845.610300:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826845.610303:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143679232:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826845.610311:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.610315:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547d36f480 x1874672143680384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826845.610358:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.610364:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143679744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826845.610371:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143680000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610390:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143679872:0@lo:8:kworker.0 00000100:00100000:2.0:1787826845.610400:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826845.610415:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.610429:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143680512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610429:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453269a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143679488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826845.610461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.610464:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.610487:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143680128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826845.610492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143679360 00000100:00100000:2.0:1787826845.610492:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787826845.610499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143679360 00000100:00100000:2.0:1787826845.610499:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143679616:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610514:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.610529:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826845.610547:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143679232 00000100:00100000:1.0:1787826845.610551:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143679232 00000100:00100000:3.0:1787826845.610552:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680128 00000100:00100000:2.0:1787826845.610555:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143680256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610557:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680128 00000100:00100000:1.0:1787826845.610568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143679616 00000100:00100000:1.0:1787826845.610574:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143679616 00000100:00100000:2.0:1787826845.610583:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.610604:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680256 00000100:00100000:3.0:1787826845.610608:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680256 00000100:00100000:2.0:1787826845.610612:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680000 00000100:00100000:1.0:1787826845.610616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787826845.610617:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680000 00000100:00100000:1.0:1787826845.610629:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143679360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610635:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787826845.610641:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f701e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1874672143679232:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826845.610647:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680512 00000100:00100000:2.0:1787826845.610649:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680512 00010000:00080000:3.0:1787826845.610659:0:10060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000100:00100000:2.0:1787826845.610677:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826845.610690:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143680000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826845.610691:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143679360:12345-0@lo:400:kworker.0 Request processed in 62us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.610704:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000020:00000080:3.0:1787826845.610717:0:10060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a7953bdc 00000100:00100000:1.0:1787826845.610723:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000004:00100000:3.0:1787826845.610732:0:10060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787826845.610733:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143679616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826845.610736:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143680000:12345-0@lo:400:kworker.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826845.610746:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826845.610761:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787826845.610762:0:10060:0:(import.c:65:import_set_state_nolock()) ffff8d544558e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826845.610769:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143680512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826845.610788:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143679616:12345-0@lo:400:kworker.0 Request processed in 57us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.610796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787826845.610806:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f701e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143679232:12345-0@lo:38:llog_process_th.0 Request processed in 162us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826845.610814:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143680512:12345-0@lo:400:kworker.0 Request processed in 47us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.610815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787826845.610823:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787826845.610824:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787826845.610829:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143680128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610842:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787826845.610851:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143680256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826845.610878:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143679616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826845.610879:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143680128:12345-0@lo:400:kworker.0 Request processed in 52us (362us total) trans 0 rc 0/0 00010000:00080000:2.0:1787826845.610892:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53439c12c0 x1874672143680256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826845.610892:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143680256:12345-0@lo:400:kworker.0 Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.610898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787826845.610907:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787826845.610908:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143680256:0@lo:400:kworker.0 00010000:00080000:2.0:1787826845.610920:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d36cb40 x1874672143680512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826845.610934:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143679744 00000100:00100000:2.0:1787826845.610936:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143680512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610938:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143679744 00010000:00080000:1.0:1787826845.610955:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53439c2580 x1874672143680000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826845.610963:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143679488 00000100:00100000:1.0:1787826845.610968:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143680000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610968:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143679488 00000100:00100000:1.0:1787826845.610986:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143679360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.610992:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787826845.611001:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.611041:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143679744:12345-0@lo:400:kworker.0 Request processed in 43us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.611047:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787826845.611055:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143679744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.611059:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787826845.611064:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143679488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.611103:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143679488:12345-0@lo:400:kworker.0 Request processed in 39us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.611110:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787826845.611132:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826845.611136:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826845.611138:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826845.611244:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453269a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143679488:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.611257:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143680128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826845.611277:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.611303:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143680384:0@lo:8:kworker.0 00000020:01000004:2.0:1787826845.611308:0:17305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00100000:1.0:1787826845.611310:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143679872 00000100:00100000:1.0:1787826845.611316:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143679872 00000020:00000080:2.0:1787826845.611319:0:17305:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d53444f8000) 00000100:00100000:3.0:1787826845.611328:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787826845.611337:0:17305:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:1.0:1787826845.611355:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680384 00000100:00100000:1.0:1787826845.611358:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680384 00000100:00100000:3.0:1787826845.611370:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826845.611377:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00100000:1.0:1787826845.611378:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787826845.611384:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143679872:12345-0@lo:8:kworker.0 00000100:00080000:3.0:1787826845.611386:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787826845.611392:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787826845.611395:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d547d17f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826845.611402:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143679232:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1787826845.611412:0:17305:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5442bd0800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826845.611416:0:17305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5442bd0800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826845.611419:0:17305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd0800 3 00000100:00100000:1.0:1787826845.611430:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143679872:12345-0@lo:8:kworker.0 Request processed in 43us (150us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787826845.611431:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787826845.611441:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143680384:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787826845.611442:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1787826845.611446:0:17305:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d54438ab800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00000100:00100000:3.0:1787826845.611480:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143680384:12345-0@lo:8:kworker.0 Request processed in 39us (152us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787826845.611487:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787826845.611513:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826845.611517:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826845.611520:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143680384:0@lo:8:kworker.0 00000100:00080000:3.0:1787826845.611537:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826845.611541:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826845.611543:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143679872:0@lo:8:kworker.0 00010000:00010000:2.0:1787826845.613087:0:17305:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:2.0:1787826845.613373:0:17305:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826845.613414:0:17305:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826845.613425:0:17305:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a7953bea 00000100:00080000:2.0:1787826845.613434:0:17305:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826845.613439:0:17305:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d54438ab800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826845.613467:0:17305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547d36cb40 x1874672143680640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826845.613493:0:17305:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787826845.613518:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143680640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826845.613585:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.613647:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680640 00000100:00100000:3.0:1787826845.613652:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680640 00000100:00100000:3.0:1787826845.613693:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826845.613699:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1874672143680640:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787826845.613718:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1787826845.613746:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a7953bf1 00000004:00100000:3.0:1787826845.613758:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826845.613793:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d5445589800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1787826845.613822:0:17305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 52 count 51 00000100:00100000:3.0:1787826845.613865:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143680640:12345-0@lo:38:llog_process_th.0 Request processed in 163us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.613873:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787826845.613879:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d36cb40 x1874672143680640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826845.613891:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826845.613898:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000020:01000000:3.0:1787826845.613902:0:17294:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00080000:0.0:1787826845.613905:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787826845.613911:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787826845.613914:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d54438ab800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826845.613922:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143680640:0@lo:38:llog_process_th.0 10000000:01000000:3.0:1787826845.613941:0:17294:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787826845.613959:0:17294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.613970:0:17294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787826845.614019:0:17294:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787826845.614022:0:17294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826845.614028:0:17294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826845.614029:0:17294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826845.614031:0:17294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826845.614033:0:17294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826845.614034:0:17294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826845.614035:0:17294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826845.614037:0:17294:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787826845.614040:0:17294:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787826845.614043:0:17294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787826845.614044:0:17294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826845.614045:0:17294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826845.614046:0:17294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826845.614047:0:17294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826845.614049:0:17294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826845.614050:0:17294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826845.614051:0:17294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826845.614052:0:17294:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787826845.614068:0:17294:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787826845.614079:0:17294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143680768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787826845.614118:0:17294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826845.614141:0:17294:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5451ec5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826845.614162:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680768 00000100:00100000:2.0:1787826845.614169:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680768 00000100:00100000:2.0:1787826845.614203:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787826845.614210:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143680768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826845.614257:0:9479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787826845.614267:0:9479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826845.616769:0:9479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826845.616794:0:9479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787826845.616816:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826845.616822:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826845.616841:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.616860:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.616869:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.616875:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.616895:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.616929:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.616943:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826845.616962:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143680896:0@lo:104: 00000100:00100000:2.0:1787826845.617009:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:17294:x1874672143680768:12345-0@lo:253:mount.lustre.0 Request processed in 2798us (2890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826845.617017:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.617020:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787826845.617041:0:17294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:17294:1874672143680768:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787826845.617058:0:17294:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787826845.617061:0:17294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826845.617063:0:17294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826845.617065:0:17294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826845.617067:0:17294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826845.617068:0:17294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826845.617070:0:17294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826845.617072:0:17294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:1.0:1787826845.617074:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826845.617075:0:17294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826845.617078:0:17294:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1787826845.617091:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1787826845.617095:0:17294:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787826845.617105:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143681024:0@lo:104: 00000100:00100000:1.0:1787826845.617133:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.617156:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143680896 00000100:00100000:2.0:1787826845.617160:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143680896 00010000:00010000:1.0:1787826845.617174:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.617186:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 9 pid: 6479 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826845.617193:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143681024 00000100:00100000:2.0:1787826845.617196:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143681024 00000100:00100000:1.0:1787826845.617198:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143681152:192.168.203.6@tcp:104: 00000100:00100000:2.0:1787826845.617240:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787826845.617252:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e057c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143680896:12345-0@lo:104: 00000100:00100000:3.0:1787826845.617256:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787826845.617267:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826845.617271:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143681024:12345-0@lo:104: 00010000:00010000:3.0:1787826845.617287:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826845.617289:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547575e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826845.617326:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143680896:0@lo:104: 00010000:00010000:2.0:1787826845.617327:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826845.617334:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e057c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143680896:12345-0@lo:104: Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826845.617353:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787826845.617358:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143681024:0@lo:104: 00010000:00010000:3.0:1787826845.617360:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787826845.617369:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143681024:12345-0@lo:104: Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.617377:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787826845.617403:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826845.617409:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617414:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148fa00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826845.617417:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617425:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826845.617432:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826845.617447:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826845.617478:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617483:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826845.617501:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617505:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148fa00/0xc0fefc09a7953990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953997 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826845.617511:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143681280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826845.617515:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826845.617519:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.617522:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826845.617523:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d544148ea00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826845.617527:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617531:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826845.617536:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826845.617541:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1787826845.617543:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826845.617565:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617572:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826845.617591:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143681280 00000100:00100000:1.0:1787826845.617596:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143681280 00010000:00010000:2.0:1787826845.617597:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617602:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d544148ea00/0xc0fefc09a7953982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617615:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826845.617617:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617618:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826845.617620:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826845.617646:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826845.617651:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143681280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826845.617662:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826845.617668:0:13703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617680:0:13703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826845.617684:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143681408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826845.617698:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a0600/0xc0fefc09a7953997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953990 expref: 24 pid: 6479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826845.617710:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826845.617721:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826845.617754:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3618:x1874672143681280:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826845.617761:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787826845.617765:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143681280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826845.617780:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143681408 00000100:00100000:3.0:1787826845.617786:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143681408 00010000:00010000:3.0:1787826845.617803:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826845.617828:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787826845.617837:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143681408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826845.617847:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826845.617851:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.617862:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.617873:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1200/0xc0fefc09a7953989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953982 expref: 23 pid: 9479 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.617884:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826845.617915:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3619:x1874672143681408:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.617922:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787826845.617933:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143681408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826845.618693:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143681152:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787826845.618707:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826845.619049:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826845.619082:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134167936 00000100:00100000:3.0:1787826845.619087:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134167936 00010000:00010000:3.0:1787826845.619107:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 10 pid: 6479 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826845.619190:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 51 00000100:00100000:3.0:1787826845.619196:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134167936:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826845.619203:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826845.619207:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 10 pid: 6479 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619228:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 10 pid: 6479 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619239:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7600/0xc0fefc09a795397b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346741f expref: 10 pid: 6479 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619253:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619262:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826845.619273:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002452480s 00010000:00010000:3.0:1787826845.619277:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619282:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619286:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619290:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619299:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7a00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826845.619303:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619310:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619327:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826845.619336:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826845.619363:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.619373:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826845.619379:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7a00/0xc0fefc09a7953bf8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826845.619380:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134167936:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 183us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826845.619393:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 51 00010000:00080000:0.0:1787826845.622055:0:17294:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 12884901891 00010000:00080000:0.0:1787826845.622939:0:17310:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 17310 00010000:00080000:0.0:1787826845.622951:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787826845.622954:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:3.0:1787826845.623013:0:17294:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787826845.623050:0:17294:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787826845.623067:0:17294:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787826845.623086:0:17294:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787826845.624029:0:17294:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826845.624280:0:17294:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826845.906307:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787826845.942874:0:17359:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826845.943096:0:17359:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787826846.674322:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.674439:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168064 00000100:00100000:0.0:1787826846.674453:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168064 00000100:00100000:0.0:1787826846.674629:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 384 00000100:00100000:0.0:1787826846.674676:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+9:10866:x1874672134168064:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826846.674698:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826846.674729:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674b2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.674786:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.674807:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.674818:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1600, rc 0) 00000100:00100000:0.0:1787826846.674954:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134168064:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 293us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.674962:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 384 00000100:00100000:2.0:1787826846.676303:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.676434:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168192 00000100:00100000:3.0:1787826846.676443:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168192 00000100:00100000:3.0:1787826846.676492:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 385 00000100:00100000:3.0:1787826846.676502:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134168192:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787826846.676525:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1787826846.676557:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787826846.676561:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787826846.678128:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134168192:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 1624us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826846.678148:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 385 00000100:00100000:1.0:1787826846.679507:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826846.679577:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168320 00000100:00100000:2.0:1787826846.679585:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168320 00000100:00100000:2.0:1787826846.679638:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:2.0:1787826846.679645:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134168320:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826846.679672:0:8399:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d53444e8000, cookie 0xc0fefc09a7953bab 00010000:00080000:2.0:1787826846.679678:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t8589934593 exp ffff8d53444e8000 cur 221 last 1787826845 00010000:02000400:2.0:1787826846.679687:0:8399:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:2.0:1787826846.683246:0:8399:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:3.0:1787826846.683375:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d53444e8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 258048 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787826846.683388:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787826846.683527:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d544558d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826846.683600:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134168320:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 Request processed in 3954us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826846.683610:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:2.0:1787826846.687023:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826846.687063:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826846.687197:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826846.687569:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826846.688770:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168448 00000100:00100000:1.0:1787826846.688780:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168448 00000100:00100000:1.0:1787826846.688830:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168576 00000100:00100000:1.0:1787826846.688833:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168576 00000100:00100000:1.0:1787826846.688846:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168704 00000100:00100000:1.0:1787826846.688849:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168704 00000100:00100000:3.0:1787826846.688872:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 87 00000100:00100000:1.0:1787826846.688885:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168832 00000100:00100000:3.0:1787826846.688885:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2389:x1874672134168448:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787826846.688890:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168832 00000100:00100000:0.0:1787826846.688925:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 88 00000100:00100000:2.0:1787826846.688926:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.688936:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134168576:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1787826846.688943:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00080000:0.0:1787826846.688946:0:8402:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547d36cb40 x1874672134168576/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826846.688955:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00080000:3.0:1787826846.688960:0:8401:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547d36f480 x1874672134168448/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826846.688966:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134168576:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 31us (1901us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826846.688966:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134168960 00000100:00100000:1.0:1787826846.688972:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134168960 00000100:00100000:2.0:1787826846.688978:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.688982:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 88 00000100:00100000:3.0:1787826846.688992:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2389:x1874672134168448:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 109us (1974us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826846.688995:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169088 00000100:00100000:1.0:1787826846.688997:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169216 00000100:00100000:0.0:1787826846.689001:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169088 00000100:00100000:1.0:1787826846.689003:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169216 00000100:00100000:3.0:1787826846.689003:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 87 00000100:00100000:3.0:1787826846.689016:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169344 00000100:00100000:3.0:1787826846.689022:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169344 00000100:00100000:0.0:1787826846.689031:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 89 00000100:00100000:2.0:1787826846.689038:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 90 00000100:00100000:0.0:1787826846.689040:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134168704:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787826846.689045:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 91 00000100:00100000:2.0:1787826846.689047:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134168832:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787826846.689060:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134168960:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787826846.689061:0:8399:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547f700b40 x1874672134168832/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826846.689062:0:8402:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d5341f63480 x1874672134168704/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826846.689078:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134168704:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 39us (1880us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826846.689078:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134168832:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 33us (1509us total) trans 0 rc 0/-999 00010000:00080000:3.0:1787826846.689131:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1787826846.689142:0:9498:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547f703840 x1874672134168960/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826846.689149:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 90 00000100:00100000:0.0:1787826846.689158:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 89 00000100:00100000:2.0:1787826846.689167:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 92 00000100:00100000:1.0:1787826846.689176:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134168960:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 118us (248us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826846.689176:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:2.0:1787826846.689177:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134169088:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787826846.689195:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 91 00000100:00100000:3.0:1787826846.689195:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134169216:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787826846.689196:0:8399:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d53439c0f00 x1874672134169088/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826846.689200:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:1.0:1787826846.689233:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 94 00010000:00080000:3.0:1787826846.689239:0:10061:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d53439c2940 x1874672134169216/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826846.689249:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134169344:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1787826846.689250:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134169088:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 72us (301us total) trans 0 rc 0/-999 00010000:00080000:0.0:1787826846.689252:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787826846.689266:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1787826846.689267:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 92 00010000:00080000:1.0:1787826846.689269:0:9498:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d53439c2580 x1874672134169344/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826846.689270:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134169216:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 76us (307us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826846.689292:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2389:x1874672134169344:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 49us (317us total) trans 0 rc 0/-999 00010000:00080000:0.0:1787826846.689298:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1787826846.689300:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:1.0:1787826846.689309:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 94 10000000:01000000:0.0:1787826846.929286:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826846.929292:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 9 10000000:01000000:0.0:1787826846.929296:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826846.929317:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826846.929342:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.929353:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.929362:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826846.929382:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143681536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826846.929437:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826846.929478:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143681536 00000100:00100000:0.0:1787826846.929480:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826846.929485:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143681536 00000100:00100000:3.0:1787826846.929530:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787826846.929539:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143681536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826846.929552:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.929564:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953c06 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.929588:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.929598:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.929606:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7c00, rc 0) 00000100:00100000:3.0:1787826846.929646:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143681536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826846.929654:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787826846.929675:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143681536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826846.929689:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.929729:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826846.929783:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143681664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826846.929827:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826846.929844:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826846.929867:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143681664 00000100:00100000:2.0:1787826846.929873:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143681664 00000100:00100000:2.0:1787826846.929911:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787826846.929919:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143681664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826846.929935:0:9479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826846.929951:0:9479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826846.929955:0:9479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787826846.930057:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143681664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826846.930063:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787826846.930068:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143681664:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787826846.930109:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 14, was 0): DISCONN 00010000:00080000:0.0:1787826846.930120:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:0.0:1787826846.930125:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826846.930131:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826846.930154:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f74c3c0 x1874672143681792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1787826846.930197:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:3.0:1787826846.930199:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143681792:0@lo:8:ll_cfg_requeue.0 00010000:00010000:0.0:1787826846.930205:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.930234:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826846.930244:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 00000100:00100000:3.0:1787826846.930245:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787826846.930248:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 9 10000000:01000000:0.0:1787826846.930252:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826846.930270:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.930271:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143681792 00000100:00100000:2.0:1787826846.930276:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143681792 00010000:00010000:0.0:1787826846.930291:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.930300:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.930307:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787826846.930315:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143681792:12345-0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1787826846.930320:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143681920:0@lo:101:ll_cfg_requeue.0 00010000:00080000:2.0:1787826846.930348:0:8401:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d53444e8800, cookie 0xc0fefc09a7953b9d 00010000:00080000:2.0:1787826846.930355:0:8401:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d53444e8800 cur 221 last 1787826845 00000100:00100000:0.0:1787826846.930370:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1787826846.930370:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d53444e8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787826846.930376:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787826846.930378:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787826846.930407:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826846.930422:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143681920 00000100:00100000:3.0:1787826846.930427:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143681920 00000100:00100000:3.0:1787826846.930451:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787826846.930458:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143681920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826846.930464:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.930472:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953c14 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.930499:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.930507:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.930512:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6200, rc 0) 00000100:00100000:3.0:1787826846.930543:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143681920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826846.930548:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787826846.930558:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143681920:0@lo:101:ll_cfg_requeue.0 00000100:00080000:2.0:1787826846.930562:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8d5343592000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1787826846.930574:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.930583:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.930603:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143681792:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 288us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826846.930615:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787826846.930629:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143682048:0@lo:256:ll_cfg_requeue.0 00010000:00080000:3.0:1787826846.930643:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74c3c0 x1874672143681792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826846.930657:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00100000:0.0:1787826846.930666:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826846.930666:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1787826846.930672:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1787826846.930674:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:3.0:1787826846.930678:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00080000:3.0:1787826846.930682:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1787826846.930687:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682048 00000100:00100000:0.0:1787826846.930688:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826846.930692:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682048 00000100:00100000:2.0:1787826846.930724:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787826846.930732:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143682048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826846.930744:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826846.930757:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826846.930760:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787826846.930793:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143681792:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826846.930807:0:17487:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1787826846.930811:0:17487:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:0.0:1787826846.930816:0:17487:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:0.0:1787826846.930864:0:17487:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1787826846.930872:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143682048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826846.930881:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787826846.930888:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143682048:0@lo:256:ll_cfg_requeue.0 00000100:00080000:3.0:1787826846.930924:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 14, was 0): DISCONN 00000100:00100000:2.0:1787826846.930927:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143682176:0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787826846.930935:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:3.0:1787826846.930940:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826846.930946:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826846.930957:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826846.930970:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f7d7840 x1874672143682304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826846.930983:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682176 00000100:00100000:0.0:1787826846.930989:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682176 00000100:00100000:2.0:1787826846.931010:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143682304:0@lo:8:ll_cfg_requeue.0 10000000:01000000:3.0:1787826846.931019:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787826846.931026:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826846.931027:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1787826846.931036:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.931043:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826846.931047:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143682176:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787826846.931062:0:8399:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d53439c12c0 x1874672143682176/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:447/0 lens 224/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826846.931080:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682304 00000100:00100000:0.0:1787826846.931081:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143682176:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (123us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826846.931086:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682304 00000100:00100000:0.0:1787826846.931096:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826846.931109:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787826846.931115:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143682304:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826846.931130:0:8399:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d53444eb000, cookie 0xc0fefc09a7953ba4 00010000:00080000:0.0:1787826846.931134:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d53444eb000 cur 221 last 1787826845 00002000:00100000:0.0:1787826846.931144:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d53444eb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787826846.931148:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787826846.931150:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1787826846.931167:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d5448300800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826846.931203:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143682304:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.931209:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1787826846.931256:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f7d7840 x1874672143682304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826846.931268:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00010000:00080000:0.0:1787826846.931269:0:17310:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787826846.931276:0:17310:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 12884901892 00000100:00080000:2.0:1787826846.931276:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00010000:00080000:0.0:1787826846.931281:0:17310:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 12884901892 00000100:00080000:2.0:1787826846.931282:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787826846.931287:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00010000:00080000:0.0:1787826846.931288:0:17310:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 12884901892 00000100:00080000:2.0:1787826846.931291:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 12884901889 last 0 00000100:00080000:2.0:1787826846.931296:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1787826846.931410:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143682304:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826846.931422:0:17489:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787826846.931426:0:17489:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1787826846.931435:0:17489:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1787826846.931467:0:17489:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1787826846.931504:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143682432:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826846.931525:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826846.931544:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682432 00000100:00100000:2.0:1787826846.931547:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682432 00000100:00100000:2.0:1787826846.931572:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787826846.931577:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143682432:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787826846.931584:0:8401:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f7d7840 x1874672143682432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:447/0 lens 224/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826846.931597:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143682432:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 21us (71us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826846.931602:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1787826846.931606:0:17310:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 12884901892 00010000:00080000:3.0:1787826846.931610:0:17310:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:3.0:1787826846.931615:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.931616:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.931622:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547d36cb40 x1874672134168576/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.931634:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.931651:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000219ad041/0xc0fefc09a7953c22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346749d expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931670:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000219ad041/0xc0fefc09a7953c22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346749d expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931698:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000219ad041/0xc0fefc09a7953c22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346749d expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931709:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7000, rc 0) 00010000:00080000:3.0:1787826846.931758:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00080000:3.0:1787826846.931769:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.931771:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.931778:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547d36f480 x1874672134168448/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.931790:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.931804:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7450bf9/0xc0fefc09a7953c29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674ab expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931818:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7450bf9/0xc0fefc09a7953c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931828:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7450bf9/0xc0fefc09a7953c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931835:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7800, rc 0) 00010000:00080000:3.0:1787826846.931857:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.931864:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.931866:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.931872:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547f700b40 x1874672134168832/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.931893:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.931904:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a68c511/0xc0fefc09a7953c30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467481 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931916:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a68c511/0xc0fefc09a7953c30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467481 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931980:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a68c511/0xc0fefc09a7953c30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467481 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.931989:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6c00, rc 0) 00010000:00080000:3.0:1787826846.932012:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.932019:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.932021:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.932027:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d5341f63480 x1874672134168704/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.932039:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.932049:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011f78d82/0xc0fefc09a7953c37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346748f expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932064:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011f78d82/0xc0fefc09a7953c37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346748f expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932075:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011f78d82/0xc0fefc09a7953c37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346748f expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932096:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6a00, rc 0) 00010000:00080000:3.0:1787826846.932113:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.932118:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.932120:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.932126:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547f703840 x1874672134168960/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.932136:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.932148:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003847f0c2/0xc0fefc09a7953c3e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467473 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932163:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003847f0c2/0xc0fefc09a7953c3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467473 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932173:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003847f0c2/0xc0fefc09a7953c3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467473 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932179:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6e00, rc 0) 00010000:00080000:3.0:1787826846.932194:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.932200:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.932202:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.932207:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d53439c0f00 x1874672134169088/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.932237:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.932250:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c024253e/0xc0fefc09a7953c45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467465 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932285:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c024253e/0xc0fefc09a7953c45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932293:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c024253e/0xc0fefc09a7953c45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932299:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7a00, rc 0) 00010000:00080000:3.0:1787826846.932316:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.932323:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.932325:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.932341:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d53439c2940 x1874672134169216/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.932350:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.932360:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a591388b/0xc0fefc09a7953c4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467457 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932370:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a591388b/0xc0fefc09a7953c4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467457 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932378:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a591388b/0xc0fefc09a7953c4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467457 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932383:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6400, rc 0) 00010000:00080000:3.0:1787826846.932398:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.932402:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.932408:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.932412:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d53439c2580 x1874672134169344/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.932420:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.932429:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e2b47f7/0xc0fefc09a7953c53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467449 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932439:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e2b47f7/0xc0fefc09a7953c53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467449 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932446:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e2b47f7/0xc0fefc09a7953c53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467449 expref: 13 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.932453:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7600, rc 0) 00010000:00080000:3.0:1787826846.932474:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.932481:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1787826846.933734:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.933777:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.933798:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169472 00000100:00100000:3.0:1787826846.933805:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169600 00000100:00100000:0.0:1787826846.933806:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169472 00000100:00100000:3.0:1787826846.933811:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169600 00000100:00100000:0.0:1787826846.933860:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 97 00000100:00100000:3.0:1787826846.933869:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 98 00000100:00100000:0.0:1787826846.933874:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2389:x1874672134169472:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787826846.933884:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2389:x1874672134169600:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787826846.933901:0:8399:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547f7d5e00 x1874672134169600/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826846.933902:0:9498:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547f7d6580 x1874672134169472/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826846.933928:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2389:x1874672134169600:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 47us (149us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826846.933929:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2389:x1874672134169472:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 59us (234us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826846.933939:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 98 00000100:00100000:0.0:1787826846.933953:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 97 00010000:00080000:3.0:1787826846.933959:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.933966:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547f7d5e00 x1874672134169600/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.933977:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.933987:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467418 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.933999:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 15 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.934009:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 15 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.934017:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7e00, rc 0) 00010000:00080000:3.0:1787826846.934057:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.934064:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826846.934066:0:17310:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826846.934070:0:17310:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547f7d6580 x1874672134169472/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826846.934090:0:17310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826846.934102:0:17310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372bf048/0xc0fefc09a7953c61 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346743b expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.934118:0:17310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372bf048/0xc0fefc09a7953c61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 15 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.934130:0:17310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000372bf048/0xc0fefc09a7953c61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 15 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.934147:0:17310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6000, rc 0) 00010000:00080000:3.0:1787826846.934174:0:17310:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826846.934259:0:17310:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1787826846.934962:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.935000:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169728 00000100:00100000:0.0:1787826846.935005:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169728 00000100:00100000:0.0:1787826846.935033:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:0.0:1787826846.935040:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2389:x1874672134169728:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1787826846.935050:0:8401:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f7d4f00 x1874672134169728/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 224/0 e 0 to 0 dl 1787826857 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826846.935065:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2389:x1874672134169728:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 Request processed in 26us (108us total) trans 0 rc 0/-999 00010000:00080000:3.0:1787826846.935072:0:17310:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000100:00100000:0.0:1787826846.935073:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 86 00000001:00000004:3.0:1787826846.935189:0:17310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869184 00000001:00100000:0.0:1787826846.936558:0:17295:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:0.0:1787826846.936566:0:17295:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787826846.936572:0:17295:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:3.0:1787826846.936775:0:17310:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:3.0:1787826846.936787:0:17310:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d53439c12c0 x1874672143682176/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:447/0 lens 224/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826846.936857:0:17310:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d547f7d7840 x1874672143682432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:447/0 lens 224/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826846.936891:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826846.936901:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d547f74e940 x1874672143682176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826862 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826846.936910:0:17310:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d547f7d4f00 x1874672134169728/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 224/0 e 0 to 0 dl 1787826857 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826846.936919:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d547f74e940 x1874672143682176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826862 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826846.936929:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1787826846.936942:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1787826846.936946:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00010000:02000000:3.0:1787826846.936955:0:17310:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:1.0:1787826846.937172:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143682688:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787826846.937233:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826846.937258:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5443801900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826846.937283:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143682560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826846.937311:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826846.937372:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682560 00000100:00100000:1.0:1787826846.937377:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682560 00000100:00100000:1.0:1787826846.937412:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787826846.937419:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143682560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826846.937435:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 258048 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787826846.937476:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143682560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826846.937482:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787826846.937588:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143682560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826846.937635:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682688 00000100:00100000:1.0:1787826846.937639:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682688 00000100:00100000:1.0:1787826846.937664:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787826846.937671:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143682688:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1787826846.939062:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787826846.939068:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787826846.939112:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143682688:12345-0@lo:7:osp-pre-0-1.0 Request processed in 1441us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826846.939120:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787826846.939169:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143682688:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787826846.939178:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00080000:2.0:1787826846.940431:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009f8725f1): req@ffff8d546e156580 x1874672143672576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787826849 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826846.940454:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143682176:0@lo:400:ldlm_lock_repla.0 00000100:00080000:2.0:1787826846.940485:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826846.940492:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d545326ad00 x1874672143682432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826862 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826846.940515:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d545326ad00 x1874672143682432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826862 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826846.940516:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826846.940527:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1787826846.940544:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1787826846.940548:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1787826846.940554:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000084d4e318): req@ffff8d547d2b0b40 x1874672143672064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787826849 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826846.940571:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143682432:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787826846.940607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826846.940635:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143682816:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787826846.940642:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 221803425845ns, next at 222803423081ns, rc = 0 00000100:00100000:0.0:1787826846.940669:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826846.940673:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453269a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143682944:0@lo:7:osp-pre-0-0.0 00000100:00100000:0.0:1787826846.940700:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672576 00000100:00100000:0.0:1787826846.940705:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672576 00000100:00100000:2.0:1787826846.940714:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826846.940729:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143672064 00000100:00100000:0.0:1787826846.940732:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143672064 00000100:00100000:2.0:1787826846.940736:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826846.940768:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682816 00000100:00100000:0.0:1787826846.940772:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682816 00000100:00100000:2.0:1787826846.940793:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143682944 00000100:00100000:0.0:1787826846.940794:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787826846.940799:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143682944 00000100:00100000:0.0:1787826846.940812:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143672576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826846.940830:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 258048 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787826846.940835:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787826846.940845:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e39b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:9503:x1874672143682944:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:0.0:1787826846.940882:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143672576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.940889:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787826846.940906:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787826846.940914:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1874672143672064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826846.940926:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 258048 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787826846.940961:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1874672143672064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.940968:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787826846.940981:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787826846.940987:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143682816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826846.940996:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 258048 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787826846.941021:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143682816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826846.941022:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826846.941031:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787826846.941037:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143683072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826846.941069:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143682816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826846.941082:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826846.941085:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143672064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826846.941161:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143683072 00000100:00100000:2.0:1787826846.941166:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143683072 00000100:00100000:2.0:1787826846.941193:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787826846.941201:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143683072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826846.941246:0:8401:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00000100:00100000:2.0:1787826846.941660:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143672576:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1787826846.942067:0:10061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787826846.942072:0:10061:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:0.0:1787826846.942113:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e39b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143682944:12345-0@lo:7:osp-pre-0-0.0 Request processed in 1270us (1399us total) trans 0 rc 0/0 00002000:00010000:2.0:1787826846.942129:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 29, mtime: 0x6a901277, atime: 0x0, ctime: 0x6a901277, blocks: 0x8 00000100:00100000:0.0:1787826846.942133:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:2.0:1787826846.942140:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826846.942157:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 14 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826846.942164:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=221s v=(0 0) 00010000:00010000:2.0:1787826846.942167:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826846.942170:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826846.942190:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 14 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826846.942206:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 14 pid: 17310 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.942246:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143683200:192.168.203.6@tcp:104: 00000100:00100000:2.0:1787826846.942312:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826846.942437:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453269a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143682944:0@lo:7:osp-pre-0-0.0 00000004:00080000:2.0:1787826846.942446:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x21:0x0] 00000100:00100000:2.0:1787826846.945438:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826846.945479:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826846.945559:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166528 00000100:00100000:2.0:1787826846.945573:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166528 00000100:00100000:1.0:1787826846.945604:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134166400 00000100:00100000:1.0:1787826846.945611:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134166400 00000100:00100000:2.0:1787826846.945614:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 102 00000100:00100000:2.0:1787826846.945625:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:0:x1874672134166528:12345-192.168.203.6@tcp:16:kworker.0 00002000:00100000:1.0:1787826846.945650:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->5) req@ffff8d5453269a40 x1874672134166400/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826846.945661:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453269a40 with x1874672134166400 ext(0->5) 00002000:00010000:1.0:1787826846.945672:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453269a40 00000100:00100000:1.0:1787826846.945693:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:1.0:1787826846.945707:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:0:x1874672134166400:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:1.0:1787826846.945775:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143683200:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826846.945793:0:8401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.946037:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:0:x1874672134166528:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 413us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826846.946046:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 102 00000100:00100000:1.0:1787826846.946476:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+17:0:x1874672134166400:12345-192.168.203.6@tcp:4:bash.0 Request processed in 769us (1042us total) trans 17179869185 rc 0/0 00000100:00100000:1.0:1787826846.946484:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 4 00002000:00100000:1.0:1787826846.946491:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->5) req@ffff8d5453269a40 x1874672134166400/t17179869185(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826846.946500:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453269a40 with x1874672134166400 ext(0->5) 00002000:00010000:1.0:1787826846.946506:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453269a40 00000100:00100000:2.0:1787826846.947540:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826846.947564:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.947579:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169856 00000100:00100000:0.0:1787826846.947586:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169856 00010000:00010000:3.0:1787826846.947602:0:17310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00000100:00100000:2.0:1787826846.947603:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00010000:3.0:1787826846.947610:0:17310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787826846.947613:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 17 pid: 17310 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.947625:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134169984 00000100:00100000:2.0:1787826846.947629:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134169984 00000100:00100000:0.0:1787826846.947647:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 52 00002000:00100000:2.0:1787826846.947654:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->5) req@ffff8d5453268780 x1874672134169984/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826846.947661:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2391:x1874672134169856:12345-192.168.203.6@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1787826846.947673:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453268780 with x1874672134169984 ext(0->5) 00002000:00010000:2.0:1787826846.947677:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453268780 00010000:00010000:0.0:1787826846.947678:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826846.947686:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 18 pid: 17310 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.947702:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 18 pid: 17310 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.947703:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:2.0:1787826846.947714:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134169984:12345-192.168.203.6@tcp:4:bash.0 00010000:00010000:0.0:1787826846.947731:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4f46886/0xc0fefc09a7953c5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467418 expref: 18 pid: 17310 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.947744:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787826846.947749:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787826846.947754:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.947764:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.947801:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826846.947812:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134170112 00000100:00100000:2.0:1787826846.947817:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134170112 00000100:00100000:0.0:1787826846.947827:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2391:x1874672134169856:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 173us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.947833:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 52 00000100:00100000:2.0:1787826846.947851:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 103 00010000:00010000:0.0:1787826846.947859:0:8401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826846.947860:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2391:x1874672134170112:12345-192.168.203.6@tcp:16:kworker.0 00010000:00010000:0.0:1787826846.947874:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.947881:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.947887:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826846.947905:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826846.948011:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143683072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6809us (6929us total) trans 17179869186 rc 0/0 00000100:00100000:0.0:1787826846.948019:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000004:00080000:2.0:1787826846.948311:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d545326b480/2, rc 0, transno 17179869186 00000100:00100000:2.0:1787826846.948318:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143683072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826846.948412:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2390:x1874672134169984:12345-192.168.203.6@tcp:4:bash.0 Request processed in 700us (846us total) trans 17179869187 rc 0/0 00000100:00100000:2.0:1787826846.948432:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00002000:00100000:2.0:1787826846.948437:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->5) req@ffff8d5453268780 x1874672134169984/t17179869187(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826846.948443:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453268780 with x1874672134169984 ext(0->5) 00002000:00010000:2.0:1787826846.948445:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453268780 00010000:00010000:3.0:1787826846.948544:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826846.948552:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.948561:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2a00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826846.948605:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.948617:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.948639:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.948647:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d1b588/0xc0fefc09a7953c68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826846.948663:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826846.948666:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826846.948669:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787826846.948702:0:17310:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787826846.948706:0:17310:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000001:00080000:0.0:1787826846.949097:0:17295:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869187 is committed 00000001:00080000:0.0:1787826846.949105:0:17295:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869186 is committed 00000100:00100000:2.0:1787826846.949167:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2391:x1874672134170112:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 1308us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826846.949172:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 103 00000100:00100000:2.0:1787826846.950210:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.950268:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134170240 00000100:00100000:2.0:1787826846.950275:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.950276:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134170240 00000100:00100000:0.0:1787826846.950299:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134170368 00000100:00100000:0.0:1787826846.950304:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134170368 00002000:00100000:3.0:1787826846.950310:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x7:0x0] (0->5) req@ffff8d546e15f480 x1874672134170240/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826846.950320:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15f480 with x1874672134170240 ext(0->5) 00002000:00010000:3.0:1787826846.950325:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15f480 00000100:00100000:0.0:1787826846.950350:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 104 00000100:00100000:0.0:1787826846.950362:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2393:x1874672134170368:12345-192.168.203.6@tcp:16:kworker.0 00000100:00100000:3.0:1787826846.950373:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:3.0:1787826846.950384:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2393:x1874672134170240:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:0.0:1787826846.950657:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2393:x1874672134170368:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 297us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.950662:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 104 00000100:00100000:0.0:1787826846.951126:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134170240:12345-192.168.203.6@tcp:4:bash.0 Request processed in 744us (918us total) trans 17179869188 rc 0/0 00000100:00100000:0.0:1787826846.951133:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00002000:00100000:0.0:1787826846.951142:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x7:0x0] (0->5) req@ffff8d546e15f480 x1874672134170240/t17179869188(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826846.951150:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15f480 with x1874672134170240 ext(0->5) 00002000:00010000:0.0:1787826846.951154:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15f480 00000100:00100000:2.0:1787826846.951428:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.951458:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134170624 00000100:00100000:0.0:1787826846.951463:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134170624 00000100:00100000:2.0:1787826846.951469:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.951490:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:0.0:1787826846.951496:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134170624:12345-192.168.203.6@tcp:16:kworker.0 00000100:00100000:3.0:1787826846.951497:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134170496 00000100:00100000:3.0:1787826846.951510:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134170496 00002000:00100000:3.0:1787826846.951575:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8:0x0] (0->5) req@ffff8d546e15c780 x1874672134170496/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826846.951583:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15c780 with x1874672134170496 ext(0->5) 00002000:00010000:3.0:1787826846.951587:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15c780 00000100:00100000:3.0:1787826846.951618:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:3.0:1787826846.951628:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2392:x1874672134170496:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:0.0:1787826846.951732:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2392:x1874672134170624:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 234us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.951740:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:3.0:1787826846.952077:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134170496:12345-192.168.203.6@tcp:4:bash.0 Request processed in 451us (608us total) trans 17179869189 rc 0/0 00000100:00100000:3.0:1787826846.952086:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00002000:00100000:3.0:1787826846.952093:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8:0x0] (0->5) req@ffff8d546e15c780 x1874672134170496/t17179869189(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826846.952102:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15c780 with x1874672134170496 ext(0->5) 00002000:00010000:3.0:1787826846.952106:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15c780 00000100:00100000:2.0:1787826846.952695:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.952736:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134170752 00000100:00100000:3.0:1787826846.952741:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134170752 00000100:00100000:2.0:1787826846.952747:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00002000:00100000:3.0:1787826846.952765:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9:0x0] (0->5) req@ffff8d547d357480 x1874672134170752/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826846.952775:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d357480 with x1874672134170752 ext(0->5) 00000100:00100000:0.0:1787826846.952778:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134170880 00002000:00010000:3.0:1787826846.952780:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d357480 00000100:00100000:0.0:1787826846.952783:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134170880 00000100:00100000:3.0:1787826846.952803:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:3.0:1787826846.952812:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2390:x1874672134170752:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:0.0:1787826846.952818:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 106 00000100:00100000:0.0:1787826846.952827:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2391:x1874672134170880:12345-192.168.203.6@tcp:16:kworker.0 00000100:00100000:0.0:1787826846.953113:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2391:x1874672134170880:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 286us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.953122:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 106 00000100:00100000:3.0:1787826846.953401:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134170752:12345-192.168.203.6@tcp:4:bash.0 Request processed in 590us (705us total) trans 17179869190 rc 0/0 00000100:00100000:3.0:1787826846.953410:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 8 00002000:00100000:3.0:1787826846.953417:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9:0x0] (0->5) req@ffff8d547d357480 x1874672134170752/t17179869190(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826846.953425:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d357480 with x1874672134170752 ext(0->5) 00002000:00010000:3.0:1787826846.953429:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d357480 00000100:00100000:3.0:1787826846.954129:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.954162:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.954163:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171136 00000100:00100000:0.0:1787826846.954169:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171136 00000100:00100000:3.0:1787826846.954188:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171008 00000100:00100000:3.0:1787826846.954193:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171008 00000100:00100000:0.0:1787826846.954207:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 107 00002000:00100000:3.0:1787826846.954237:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa:0x0] (0->5) req@ffff8d547f7d5e00 x1874672134171008/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826846.954248:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+21:2392:x1874672134171136:12345-192.168.203.6@tcp:16:kworker.0 00002000:00100000:3.0:1787826846.954250:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7d5e00 with x1874672134171008 ext(0->5) 00002000:00010000:3.0:1787826846.954258:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7d5e00 00000100:00100000:3.0:1787826846.954279:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:3.0:1787826846.954289:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+21:2393:x1874672134171008:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:0.0:1787826846.954634:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+21:2392:x1874672134171136:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 417us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.954642:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 107 00000100:00100000:3.0:1787826846.954991:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134171008:12345-192.168.203.6@tcp:4:bash.0 Request processed in 704us (829us total) trans 17179869191 rc 0/0 00000100:00100000:3.0:1787826846.954999:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 9 00002000:00100000:3.0:1787826846.955005:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa:0x0] (0->5) req@ffff8d547f7d5e00 x1874672134171008/t17179869191(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826846.955014:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7d5e00 with x1874672134171008 ext(0->5) 00002000:00010000:3.0:1787826846.955017:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7d5e00 00000100:00100000:3.0:1787826846.955951:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.955982:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.956011:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171392 00000100:00100000:0.0:1787826846.956018:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171392 00000100:00100000:1.0:1787826846.956031:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171264 00000100:00100000:1.0:1787826846.956037:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171264 00000100:00100000:0.0:1787826846.956053:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 108 00000100:00100000:0.0:1787826846.956063:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+23:2391:x1874672134171392:12345-192.168.203.6@tcp:16:kworker.0 00002000:00100000:1.0:1787826846.956071:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xb:0x0] (0->5) req@ffff8d547f7d7840 x1874672134171264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826846.956081:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7d7840 with x1874672134171264 ext(0->5) 00002000:00010000:1.0:1787826846.956085:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7d7840 00000100:00100000:1.0:1787826846.956114:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:1.0:1787826846.956123:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+23:2390:x1874672134171264:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:3.0:1787826846.956370:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+23:2391:x1874672134171392:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 307us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826846.956378:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 108 00000100:00100000:3.0:1787826846.957008:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2390:x1874672134171264:12345-192.168.203.6@tcp:4:bash.0 Request processed in 884us (1022us total) trans 17179869192 rc 0/0 00000100:00100000:3.0:1787826846.957017:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 10 00002000:00100000:3.0:1787826846.957032:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xb:0x0] (0->5) req@ffff8d547f7d7840 x1874672134171264/t17179869192(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826846.957038:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7d7840 with x1874672134171264 ext(0->5) 00002000:00010000:3.0:1787826846.957041:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7d7840 00000100:00100000:3.0:1787826846.957364:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.957391:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826846.957397:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171648 00000100:00100000:0.0:1787826846.957401:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171648 00000100:00100000:1.0:1787826846.957420:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171520 00000100:00100000:1.0:1787826846.957424:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171520 00000100:00100000:0.0:1787826846.957442:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 109 00002000:00100000:1.0:1787826846.957447:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc:0x0] (0->5) req@ffff8d5444f0a1c0 x1874672134171520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826846.957456:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2392:x1874672134171648:12345-192.168.203.6@tcp:16:kworker.0 00002000:00100000:1.0:1787826846.957471:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f0a1c0 with x1874672134171520 ext(0->5) 00002000:00010000:1.0:1787826846.957475:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f0a1c0 00000100:00100000:1.0:1787826846.957501:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:1.0:1787826846.957509:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2393:x1874672134171520:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:0.0:1787826846.957694:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2392:x1874672134171648:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 240us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826846.957701:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 109 00000100:00100000:1.0:1787826846.958068:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134171520:12345-192.168.203.6@tcp:4:bash.0 Request processed in 558us (674us total) trans 17179869193 rc 0/0 00000100:00100000:1.0:1787826846.958076:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 11 00002000:00100000:1.0:1787826846.958084:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc:0x0] (0->5) req@ffff8d5444f0a1c0 x1874672134171520/t17179869193(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826846.958093:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f0a1c0 with x1874672134171520 ext(0->5) 00002000:00010000:1.0:1787826846.958096:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f0a1c0 00000100:00100000:3.0:1787826846.958633:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826846.958664:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826846.958672:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171776 00000100:00100000:1.0:1787826846.958677:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171776 00002000:00100000:1.0:1787826846.958699:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xd:0x0] (0->6) req@ffff8d5444f09e00 x1874672134171776/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/0 e 0 to 0 dl 1787826857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826846.958709:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f09e00 with x1874672134171776 ext(0->6) 00002000:00010000:1.0:1787826846.958713:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f09e00 00000100:00100000:2.0:1787826846.958718:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134171904 00000100:00100000:2.0:1787826846.958724:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134171904 00000100:00100000:1.0:1787826846.958736:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:1.0:1787826846.958747:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2393:x1874672134171776:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:2.0:1787826846.958758:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 110 00000100:00100000:2.0:1787826846.958768:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2392:x1874672134171904:12345-192.168.203.6@tcp:16:kworker.0 00000100:00100000:2.0:1787826846.959130:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2392:x1874672134171904:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 363us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826846.959138:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 110 00000100:00100000:2.0:1787826846.962022:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134171776:12345-192.168.203.6@tcp:4:bash.0 Request processed in 3267us (3378us total) trans 17179869194 rc 0/0 00000100:00100000:2.0:1787826846.962033:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00002000:00100000:2.0:1787826846.962043:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xd:0x0] (0->6) req@ffff8d5444f09e00 x1874672134171776/t17179869194(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:447/0 lens 496/448 e 0 to 0 dl 1787826857 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826846.962056:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f09e00 with x1874672134171776 ext(0->6) 00002000:00010000:2.0:1787826846.962060:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f09e00 00000001:02000400:2.0:1787826847.825054:0:17650:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787826847.953350:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826848.145256:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826848.145398:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172032 00000100:00100000:0.0:1787826848.145407:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172032 00000100:00100000:0.0:1787826848.145504:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 390 00000100:00100000:0.0:1787826848.145514:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134172032:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826848.145588:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134172032:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 76us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826848.145596:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 390 00000100:00100000:2.0:1787826848.145730:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826848.145765:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826848.145777:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172160 00000100:00100000:0.0:1787826848.145781:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172160 00000100:00100000:2.0:1787826848.145794:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826848.145806:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172288 00000100:00100000:1.0:1787826848.145813:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172288 00000100:00100000:2.0:1787826848.145824:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826848.145828:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00100000:0.0:1787826848.145837:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2391:x1874672134172160:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826848.145845:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172416 00000100:00100000:2.0:1787826848.145848:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172416 00000100:00100000:1.0:1787826848.145859:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 178 00000100:00100000:1.0:1787826848.145870:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134172288:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826848.145880:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172544 00000100:00100000:0.0:1787826848.145883:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2391:x1874672134172160:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826848.145884:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172544 00000100:00100000:0.0:1787826848.145892:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00080000:0.0:1787826848.145911:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826848.145912:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 87 00000100:00080000:0.0:1787826848.145915:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826848.145918:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826848.145920:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826848.145920:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134172416:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826848.145926:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134172288:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 54us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826848.145936:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 178 00000100:00100000:0.0:1787826848.145942:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 88 00000100:00100000:2.0:1787826848.145967:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134172416:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826848.145975:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 87 00000100:00100000:0.0:1787826848.146023:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134172544:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826848.146056:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134172544:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 106us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826848.146063:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 88 00000020:00000004:2.0:1787826848.168626:0:17702:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826848.168832:0:17702:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787826848.473664:0:17753:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826848.473850:0:17753:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826848.849486:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143683584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826848.849551:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826848.849614:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143683584 00000100:00100000:3.0:1787826848.849627:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143683584 00000100:00100000:0.0:1787826848.849630:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826848.849640:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143683456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826848.849674:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826848.849714:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787826848.849727:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143683456 00000100:00100000:3.0:1787826848.849730:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143683584:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826848.849737:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143683456 00000100:00100000:2.0:1787826848.849763:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826848.849776:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143683328:0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1787826848.849780:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00080000:0.0:1787826848.849783:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826848.849810:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787826848.849819:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826848.849824:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143683456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826848.849857:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826848.849882:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143683584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826848.849893:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787826848.849930:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143683456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826848.849939:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787826848.849942:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143683328 00000100:00100000:1.0:1787826848.849947:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143683328 00000100:00080000:2.0:1787826848.849999:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787826848.850000:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0d680 x1874672143683456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826848.850007:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787826848.850018:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143683328:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826848.850025:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143683456:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826848.850032:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826848.850045:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143683584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826848.850077:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143683328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826848.850085:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1787826848.850108:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74f0c0 x1874672143683328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826848.850137:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143683328:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826848.977417:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826849.788561:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826849.788737:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172672 00000100:00100000:3.0:1787826849.788752:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172672 00000100:00100000:3.0:1787826849.788831:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 72 00000100:00100000:3.0:1787826849.788843:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:14477:x1874672134172672:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787826849.788882:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826849.788967:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:14477:x1874672134172672:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 119us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826849.788975:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 72 00000100:00100000:1.0:1787826849.790654:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826849.790728:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172800 00000100:00100000:0.0:1787826849.790740:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172800 00000100:00100000:0.0:1787826849.790807:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 73 00000100:00100000:0.0:1787826849.790820:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14477:x1874672134172800:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787826849.790863:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826849.790942:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14477:x1874672134172800:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 124us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826849.790952:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 73 00000100:00100000:2.0:1787826849.792456:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826849.792575:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134172928 00000100:00100000:1.0:1787826849.792585:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134172928 00000100:00100000:1.0:1787826849.792635:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:1.0:1787826849.792643:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+28:14477:x1874672134172928:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787826849.792673:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 76420544 pending 200704 free 3923472384 avail 3691950080 00000100:00100000:1.0:1787826849.792765:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+28:14477:x1874672134172928:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826849.792773:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:2.0:1787826849.793570:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826849.793639:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173056 00000100:00100000:3.0:1787826849.793649:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173056 00000100:00100000:3.0:1787826849.793699:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 106 00000100:00100000:3.0:1787826849.793727:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14477:x1874672134173056:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826849.793750:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826849.793809:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14477:x1874672134173056:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826849.793818:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 106 00000100:00100000:2.0:1787826849.873469:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143683712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826849.873554:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826849.873591:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143683712 00000100:00100000:0.0:1787826849.873601:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143683712 00000100:00100000:0.0:1787826849.873670:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787826849.873683:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143683712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826849.873710:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826849.873762:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143683712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826849.873776:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787826849.873853:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143683712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826850.001395:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826850.898563:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826850.898583:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143683840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826850.898610:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143684352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.898661:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826850.898673:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826850.898728:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143684224:0@lo:400:kworker.0 00000100:00100000:3.0:1787826850.898733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143684864:0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.898761:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684352 00000100:00100000:1.0:1787826850.898768:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143684096:0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.898770:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684352 00000100:00100000:0.0:1787826850.898775:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826850.898810:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143684736:0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.898814:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826850.898822:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787826850.898834:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143684352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.898846:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143684608:0@lo:400:kworker.0 00000100:00100000:3.0:1787826850.898846:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143683840 00000100:00100000:3.0:1787826850.898853:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143683840 00000100:00100000:0.0:1787826850.898854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826850.898887:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143685248:0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.898903:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826850.898903:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1787826850.898909:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143684352:12345-0@lo:400:kworker.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826850.898918:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787826850.898931:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826850.898932:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143683840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.898935:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143685120:0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.898939:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684096 00000100:00100000:2.0:1787826850.898945:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684096 00000100:00100000:2.0:1787826850.898977:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787826850.898978:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684224 00000100:00100000:0.0:1787826850.898983:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684224 00000100:00100000:1.0:1787826850.898984:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826850.898988:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143684096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826850.898995:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143683840:12345-0@lo:400:kworker.0 Request processed in 67us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826850.899005:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1787826850.899022:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826850.899024:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684736 00000100:00100000:0.0:1787826850.899028:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684736 00000100:00100000:1.0:1787826850.899032:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143683968:0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.899040:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143684096:12345-0@lo:400:kworker.0 Request processed in 54us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826850.899047:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787826850.899064:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143685248 00000100:00100000:1.0:1787826850.899064:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826850.899069:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143685248 00000100:00100000:2.0:1787826850.899073:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684608 00000100:00100000:2.0:1787826850.899078:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684608 00000100:00100000:1.0:1787826850.899081:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143684480:0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899091:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143683968 00000100:00100000:0.0:1787826850.899096:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143683968 00000100:00100000:1.0:1787826850.899111:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826850.899124:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143685120 00000100:00100000:0.0:1787826850.899126:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787826850.899130:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143685120 00000100:00100000:3.0:1787826850.899135:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684480 00000100:00100000:0.0:1787826850.899137:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143684224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.899138:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143684992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826850.899142:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684480 00000100:00100000:1.0:1787826850.899174:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826850.899178:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787826850.899188:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787826850.899192:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143684608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899199:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143684224:12345-0@lo:400:kworker.0 Request processed in 62us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826850.899204:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143685120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.899235:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143684096:0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899247:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787826850.899271:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143684608:12345-0@lo:400:kworker.0 Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826850.899272:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00010000:00080000:1.0:1787826850.899272:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d138b40 x1874672143684608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826850.899287:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143684736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.899290:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787826850.899298:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143684608:0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.899326:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684992 00000100:00100000:2.0:1787826850.899331:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684992 00000100:00100000:1.0:1787826850.899351:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787826850.899353:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143684736:12345-0@lo:400:kworker.0 Request processed in 67us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826850.899364:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143684480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899365:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787826850.899372:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787826850.899384:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143684992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899390:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787826850.899401:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143685120:12345-0@lo:400:kworker.0 Request processed in 202us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826850.899402:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143685248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826850.899414:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787826850.899418:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143684480:12345-0@lo:400:kworker.0 Request processed in 57us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826850.899426:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787826850.899437:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143684992:12345-0@lo:400:kworker.0 Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826850.899445:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787826850.899471:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143684480:0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899472:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143685248:12345-0@lo:400:kworker.0 Request processed in 71us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826850.899482:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787826850.899489:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869186 gen 2 00000004:00080000:1.0:1787826850.899495:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d545326b480, transno 17179869186 00000100:00100000:2.0:1787826850.899497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787826850.899510:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143683968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.899511:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143684992:0@lo:400:kworker.0 00000100:00080000:0.0:1787826850.899515:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826850.899521:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826850.899527:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787826850.899540:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533e5a40 x1874672143685120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826850.899550:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143685120:0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.899560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143683968:12345-0@lo:400:kworker.0 Request processed in 52us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826850.899568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787826850.899578:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143684224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.899582:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143683968:0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899599:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143684736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899614:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143685248:0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.899621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826850.899629:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143683840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826850.899646:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143685376:0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899661:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143684864 00000100:00100000:0.0:1787826850.899666:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143684864 00000100:00100000:1.0:1787826850.899676:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826850.899704:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143685376 00000100:00100000:0.0:1787826850.899709:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143685376 00000100:00100000:1.0:1787826850.899709:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143684352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.899737:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787826850.899744:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787826850.899749:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143684864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826850.899755:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143685376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826850.899808:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143684864:12345-0@lo:400:kworker.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826850.899809:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143685376:12345-0@lo:400:kworker.0 Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826850.899823:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787826850.899828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1787826850.899842:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787826850.899872:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d139e00 x1874672143684864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826850.899885:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143684864:0@lo:400:kworker.0 00010000:00080000:3.0:1787826850.899909:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d545aa7c780 x1874672143685376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826850.899919:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143685376:0@lo:400:kworker.0 00010000:00010000:3.0:1787826851.025404:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826851.632558:0:17946:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:2.0:1787826852.050620:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826852.168093:0:17994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1787826852.433344:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826852.433366:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143685504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826852.433412:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826852.433426:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143685632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826852.433458:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826852.433490:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826852.433512:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143685504 00000100:00100000:3.0:1787826852.433522:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143685504 00000100:00100000:0.0:1787826852.433538:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143685632 00000100:00100000:0.0:1787826852.433555:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143685632 00000100:00080000:1.0:1787826852.433558:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826852.433590:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787826852.433600:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787826852.433606:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143685504:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826852.433613:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143685632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826852.433640:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 76420544 pending 200704 free 3923472384 avail 3691950080 00002000:00000024:3.0:1787826852.433640:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 76420544 pending 200704 free 3923472384 avail 3691950080 00000100:00100000:0.0:1787826852.433697:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143685632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826852.433707:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787826852.433710:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143685504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826852.433720:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787826852.433743:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143685632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826852.433754:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143685504:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1787826852.946415:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1787826852.946444:0:17295:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869194 is committed 00010000:00010000:1.0:1787826853.073507:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826853.265433:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.265491:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173184 00000100:00100000:3.0:1787826853.265501:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173184 00000100:00100000:0.0:1787826853.265532:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.265582:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.265582:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 392 00000100:00100000:2.0:1787826853.265599:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173312 00000100:00100000:3.0:1787826853.265602:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134173184:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826853.265606:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173312 00000100:00100000:0.0:1787826853.265636:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.265691:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173440 00000100:00100000:3.0:1787826853.265695:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134173184:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.265697:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173440 00000100:00100000:0.0:1787826853.265699:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.265714:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 392 00000100:00100000:2.0:1787826853.265740:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 185 00000100:00100000:2.0:1787826853.265749:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2390:x1874672134173312:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826853.265771:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173568 00000100:00100000:1.0:1787826853.265784:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173568 00000100:00100000:2.0:1787826853.265792:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2390:x1874672134173312:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826853.265799:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826853.265807:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 185 00000100:00080000:3.0:1787826853.265808:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826853.265814:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826853.265840:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 186 00000100:00100000:2.0:1787826853.265855:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134173440:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826853.265857:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173696 00000100:00100000:1.0:1787826853.265864:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173696 00000100:00100000:0.0:1787826853.265882:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:0.0:1787826853.265895:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134173568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826853.265903:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134173440:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.265916:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 186 00000100:00100000:1.0:1787826853.265933:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 94 00000100:00100000:0.0:1787826853.265941:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134173568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826853.265954:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134173696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826853.265955:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:1.0:1787826853.266038:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134173696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826853.266056:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826853.266069:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 94 00000100:00100000:0.0:1787826853.487227:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.487300:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173824 00000100:00100000:2.0:1787826853.487308:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173824 00000100:00100000:2.0:1787826853.487348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 74 00000100:00100000:2.0:1787826853.487355:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+17:14945:x1874672134173824:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787826853.487385:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826853.487450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+17:14945:x1874672134173824:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.487457:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 74 00000100:00100000:2.0:1787826853.488231:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.488270:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134173952 00000100:00100000:0.0:1787826853.488274:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134173952 00000100:00100000:0.0:1787826853.488314:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:0.0:1787826853.488322:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14945:x1874672134173952:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787826853.488341:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826853.488387:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14945:x1874672134173952:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826853.488412:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:3.0:1787826853.489528:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826853.489579:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134174080 00000100:00100000:1.0:1787826853.489583:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134174080 00000100:00100000:1.0:1787826853.489610:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 109 00000100:00100000:1.0:1787826853.489616:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+14:14945:x1874672134174080:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787826853.489634:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 76219840 pending 0 free 3923472384 avail 3691749376 00000100:00100000:1.0:1787826853.489668:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+14:14945:x1874672134174080:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826853.489675:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 109 00000100:00100000:2.0:1787826853.490314:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.490356:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134174208 00000100:00100000:3.0:1787826853.490360:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134174208 00000100:00100000:3.0:1787826853.490398:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 110 00000100:00100000:3.0:1787826853.490414:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14945:x1874672134174208:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826853.490431:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826853.490462:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:14945:x1874672134174208:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826853.490474:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 110 00000100:00100000:2.0:1787826853.506054:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.506106:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134174464 00000100:00100000:3.0:1787826853.506113:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134174464 00000100:00100000:3.0:1787826853.506163:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 76 00000100:00100000:3.0:1787826853.506169:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+17:14964:x1874672134174464:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:3.0:1787826853.506184:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826853.506199:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953c6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674b9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.506330:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953c76 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.506340:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953c76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.506349:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953c76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826853.506357:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x3:0x0]: returning size 6 00010000:00010000:3.0:1787826853.506483:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953c6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b9 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.506497:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953c76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b9 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.506519:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8d54605a1000) 00010000:00010000:3.0:1787826853.506522:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826853.506526:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7200, rc 0) 00000100:00100000:3.0:1787826853.506573:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+19:14964:x1874672134174464:12345-192.168.203.6@tcp:101:grep.0 Request processed in 403us (525us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787826853.506578:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 76 00000100:00100000:0.0:1787826853.507756:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.508009:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134174592 00000100:00100000:3.0:1787826853.508015:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134174592 00000100:00100000:3.0:1787826853.508060:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:3.0:1787826853.508070:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2390:x1874672134174592:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826853.508081:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826853.508088:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00010000:3.0:1787826853.508099:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953c76 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b9 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826853.508110:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134174720 00010000:00010000:3.0:1787826853.508114:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8d54605a1000) 00000100:00100000:0.0:1787826853.508116:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134174720 00010000:00010000:3.0:1787826853.508120:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826853.508151:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 111 00000100:00100000:0.0:1787826853.508159:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2391:x1874672134174720:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:0.0:1787826853.508171:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826853.508186:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d950ce59/0xc0fefc09a7953c84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674c0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826853.508196:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134174592:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 126us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826853.508202:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 15 00002000:00010000:0.0:1787826853.508765:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:0.0:1787826853.508782:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=228s v=(0 0) 00010000:00010000:0.0:1787826853.508786:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826853.508794:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d950ce59/0xc0fefc09a7953c84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674c0 expref: 15 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.508819:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d950ce59/0xc0fefc09a7953c84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674c0 expref: 15 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.508830:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0e00, rc 0) 00000100:00100000:0.0:1787826853.508863:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2391:x1874672134174720:12345-192.168.203.6@tcp:101:grep.0 Request processed in 705us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826853.508870:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 111 00000100:00100000:2.0:1787826853.510368:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826853.510443:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134174848 00000100:00100000:1.0:1787826853.510450:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134174848 00002000:00100000:1.0:1787826853.510494:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8d534243da40 x1874672134174848/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:454/0 lens 488/0 e 0 to 0 dl 1787826864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826853.510505:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243da40 with x1874672134174848 ext(0->4095) 00002000:00010000:1.0:1787826853.510510:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243da40 00000100:00100000:1.0:1787826853.510535:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:1.0:1787826853.510544:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2393:x1874672134174848:12345-192.168.203.6@tcp:3:grep.0 00000100:00100000:1.0:1787826853.510965:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2393:x1874672134174848:12345-192.168.203.6@tcp:3:grep.0 Request processed in 421us (599us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826853.510973:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00002000:00100000:1.0:1787826853.510981:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8d534243da40 x1874672134174848/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:454/0 lens 488/4536 e 0 to 0 dl 1787826864 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826853.510991:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243da40 with x1874672134174848 ext(0->4095) 00002000:00010000:1.0:1787826853.510995:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243da40 00000100:00100000:0.0:1787826853.512417:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.512480:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134175104 00000100:00100000:2.0:1787826853.512494:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134175104 00000100:00100000:2.0:1787826853.512528:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:2.0:1787826853.512537:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:14964:x1874672134175104:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:2.0:1787826853.512712:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+19:14964:x1874672134175104:12345-192.168.203.6@tcp:35:grep.0 Request processed in 176us (296us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787826853.512721:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:2.0:1787826853.518446:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.518500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134175360 00000100:00100000:0.0:1787826853.518518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134175360 00000100:00100000:0.0:1787826853.518556:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 77 00000100:00100000:0.0:1787826853.518563:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+19:14968:x1874672134175360:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:0.0:1787826853.518583:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826853.518602:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a7953c8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.518705:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a7953c92 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.518715:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a7953c92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.518722:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a7953c92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826853.518729:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x4:0x0]: returning size 6 00010000:00010000:0.0:1787826853.518828:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a7953c8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674c7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.518853:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a7953c92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674c7 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.518864:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x4:0x0].0x0 (ffff8d54605a1400) 00010000:00010000:0.0:1787826853.518866:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826853.518870:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1a00, rc 0) 00000100:00100000:0.0:1787826853.518926:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+21:14968:x1874672134175360:12345-192.168.203.6@tcp:101:grep.0 Request processed in 362us (484us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787826853.518943:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 77 00000100:00100000:0.0:1787826853.520533:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.520579:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134175488 00000100:00100000:3.0:1787826853.520585:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134175488 00000100:00100000:3.0:1787826853.520632:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:3.0:1787826853.520653:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5442b16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+21:2390:x1874672134175488:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826853.520665:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.520683:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a7953c92 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674c7 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.520706:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x4:0x0].0x0 (ffff8d54605a1400) 00010000:00010000:3.0:1787826853.520711:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826853.520747:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5442b16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134175488:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826853.520755:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:3.0:1787826853.521386:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.521424:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134175744 00000100:00100000:0.0:1787826853.521429:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134175744 00000100:00100000:0.0:1787826853.521459:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:0.0:1787826853.521468:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:14968:x1874672134175744:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:0.0:1787826853.521678:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+21:14968:x1874672134175744:12345-192.168.203.6@tcp:35:grep.0 Request processed in 211us (291us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787826853.521685:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:2.0:1787826853.527632:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.527711:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134176000 00000100:00100000:0.0:1787826853.527720:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134176000 00000100:00100000:0.0:1787826853.527779:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 78 00000100:00100000:0.0:1787826853.527789:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+21:14971:x1874672134176000:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:0.0:1787826853.527810:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826853.527829:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a7953ca0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674ce expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.527926:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a7953ca7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.527939:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a7953ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.527950:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a7953ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826853.527962:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x5:0x0]: returning size 6 00010000:00010000:0.0:1787826853.528067:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a7953ca0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ce expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.528098:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a7953ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ce expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.528104:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0x0 (ffff8d53428de600) 00010000:00010000:0.0:1787826853.528106:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826853.528109:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0400, rc 0) 00000100:00100000:0.0:1787826853.528152:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+23:14971:x1874672134176000:12345-192.168.203.6@tcp:101:grep.0 Request processed in 367us (531us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1787826853.528157:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 78 00000100:00100000:2.0:1787826853.529702:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.529744:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134176128 00000100:00100000:0.0:1787826853.529751:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134176128 00000100:00100000:0.0:1787826853.529797:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:0.0:1787826853.529806:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+23:2392:x1874672134176128:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826853.529819:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826853.529839:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a7953ca7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ce expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.529853:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0x0 (ffff8d53428de600) 00010000:00010000:0.0:1787826853.529857:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826853.529894:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134176128:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826853.529904:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:3.0:1787826853.530995:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.531042:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134176384 00000100:00100000:2.0:1787826853.531047:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134176384 00000100:00100000:2.0:1787826853.531081:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:2.0:1787826853.531088:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450468c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:14971:x1874672134176384:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:2.0:1787826853.531329:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450468c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+23:14971:x1874672134176384:12345-192.168.203.6@tcp:35:grep.0 Request processed in 240us (336us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787826853.531337:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:2.0:1787826853.537199:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.537266:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134176640 00000100:00100000:3.0:1787826853.537274:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134176640 00000100:00100000:3.0:1787826853.537342:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 79 00000100:00100000:3.0:1787826853.537353:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+23:14974:x1874672134176640:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:3.0:1787826853.537374:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826853.537393:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953cb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674d5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.537496:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953cbc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.537510:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953cbc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.537520:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953cbc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826853.537530:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x6:0x0]: returning size 6 00010000:00010000:3.0:1787826853.537619:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953cb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674d5 expref: 26 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.537652:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953cbc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674d5 expref: 25 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.537660:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6:0x0].0x0 (ffff8d53436db600) 00010000:00010000:3.0:1787826853.537663:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826853.537666:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c6600, rc 0) 00000100:00100000:3.0:1787826853.537719:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+25:14974:x1874672134176640:12345-192.168.203.6@tcp:101:grep.0 Request processed in 367us (528us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787826853.537725:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 79 00000100:00100000:0.0:1787826853.539651:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.539746:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134176768 00000100:00100000:2.0:1787826853.539753:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134176768 00000100:00100000:2.0:1787826853.539793:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:2.0:1787826853.539802:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2391:x1874672134176768:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826853.539815:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826853.539842:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953cbc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674d5 expref: 25 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.539854:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6:0x0].0x0 (ffff8d53436db600) 00010000:00010000:2.0:1787826853.539865:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826853.539939:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2391:x1874672134176768:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 138us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.539946:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:0.0:1787826853.542664:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.542705:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134177024 00000100:00100000:3.0:1787826853.542714:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134177024 00000100:00100000:3.0:1787826853.542772:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:3.0:1787826853.542781:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+24:14974:x1874672134177024:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:3.0:1787826853.543059:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+25:14974:x1874672134177024:12345-192.168.203.6@tcp:35:grep.0 Request processed in 278us (401us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1787826853.543066:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:2.0:1787826853.543484:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.543532:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134177152 00000100:00100000:3.0:1787826853.543537:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134177152 00000100:00100000:3.0:1787826853.543573:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 121 00000100:00100000:3.0:1787826853.543580:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2390:x1874672134177152:12345-192.168.203.6@tcp:63:ll_sa.0 00010000:00010000:3.0:1787826853.543603:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826853.543619:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953cca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674dc expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543713:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543737:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543748:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543761:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543769:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543775:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543811:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543817:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543823:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543828:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.543832:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543838:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543850:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.543858:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.543863:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543869:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953cd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543880:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543887:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543893:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543898:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.543900:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543912:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543917:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3b9f9252 (ffff8d5450fb5200) 00010000:00010000:3.0:1787826853.543919:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.543921:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543925:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953cd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543951:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953cca lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674dc expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543977:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.543980:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826853.543984:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953cca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674dc expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.543992:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e1c7e00, rc -2) 00000100:00100000:3.0:1787826853.544027:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2390:x1874672134177152:12345-192.168.203.6@tcp:63:ll_sa.0 Request processed in 448us (544us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826853.544034:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 121 00000100:00100000:0.0:1787826853.549804:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.549856:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.549868:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134177536 00000100:00100000:2.0:1787826853.549878:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134177536 00000100:00100000:1.0:1787826853.549921:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134177408 00000100:00100000:1.0:1787826853.549927:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134177408 00000100:00100000:2.0:1787826853.549948:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:2.0:1787826853.549961:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134177536:12345-192.168.203.6@tcp:63:ll_sa.0 00000100:00100000:1.0:1787826853.549975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 80 00000100:00100000:1.0:1787826853.549985:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e157c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:14978:x1874672134177408:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:1.0:1787826853.549996:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826853.550002:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826853.550019:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7600/0xc0fefc09a7953cdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550019:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953ce6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674f1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550081:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550095:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550106:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.550119:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a7953cf4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550128:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.550132:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a7953cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550140:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.550145:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a7953cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550153:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826853.550158:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x7:0x0]: returning size 6 00010000:00010000:2.0:1787826853.550200:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550207:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550247:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550264:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826853.550269:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550277:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.550297:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d7600/0xc0fefc09a7953cdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ea expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550301:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826853.550309:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826853.550314:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.550321:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a7953cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ea expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550323:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953ced lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.550342:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7:0x0].0x0 (ffff8d54605a1e00) 00010000:00010000:1.0:1787826853.550345:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826853.550346:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.550349:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d6e00, rc 0) 00010000:00010000:2.0:1787826853.550358:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550365:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550376:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826853.550379:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550386:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550395:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbacd9252 (ffff8d53428de700) 00010000:00010000:2.0:1787826853.550398:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826853.550400:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550407:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953cfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826853.550417:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e157c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+29:14978:x1874672134177408:12345-192.168.203.6@tcp:101:grep.0 Request processed in 434us (559us total) trans 4294967343 rc 0/0 00010000:00010000:2.0:1787826853.550432:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953ce6 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674f1 expref: 29 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826853.550439:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 80 00010000:00010000:2.0:1787826853.550449:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826853.550453:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826853.550458:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953ce6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674f1 expref: 28 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.550468:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3e00, rc -2) 00000100:00100000:2.0:1787826853.550518:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2393:x1874672134177536:12345-192.168.203.6@tcp:63:ll_sa.0 Request processed in 559us (721us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826853.550525:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:0.0:1787826853.554331:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.554408:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134177664 00000100:00100000:2.0:1787826853.554424:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134177664 00000100:00100000:2.0:1787826853.554476:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:2.0:1787826853.554486:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2393:x1874672134177664:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826853.554500:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826853.554523:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547d2d6e00/0xc0fefc09a7953cf4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ea expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.554539:0:13703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7:0x0].0x0 (ffff8d54605a1e00) 00010000:00010000:2.0:1787826853.554544:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826853.554619:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134177664:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.554626:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1787826853.554987:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.555035:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134177920 00000100:00100000:2.0:1787826853.555039:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134177920 00000100:00100000:2.0:1787826853.555070:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:2.0:1787826853.555085:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+26:14978:x1874672134177920:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:2.0:1787826853.555361:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+27:14978:x1874672134177920:12345-192.168.203.6@tcp:35:grep.0 Request processed in 278us (375us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787826853.555366:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:0.0:1787826853.560694:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.560750:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134178176 00000100:00100000:2.0:1787826853.560760:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134178176 00000100:00100000:2.0:1787826853.560821:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 81 00000100:00100000:2.0:1787826853.560831:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+27:14979:x1874672134178176:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:2.0:1787826853.560854:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826853.560872:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953d09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674f8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.560992:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953d10 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.561003:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953d10 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.561012:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953d10 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826853.561021:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x8:0x0]: returning size 6 00010000:00010000:2.0:1787826853.561114:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953d09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674f8 expref: 30 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.561126:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953d10 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674f8 expref: 29 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.561132:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8:0x0].0x0 (ffff8d54605a1f00) 00010000:00010000:2.0:1787826853.561134:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826853.561136:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2c00, rc 0) 00000100:00100000:2.0:1787826853.561181:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+29:14979:x1874672134178176:12345-192.168.203.6@tcp:101:grep.0 Request processed in 353us (497us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1787826853.561186:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 81 00000100:00100000:0.0:1787826853.562745:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826853.562809:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134178304 00000100:00100000:1.0:1787826853.562817:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134178304 00000100:00100000:1.0:1787826853.562860:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:1.0:1787826853.562867:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+29:2391:x1874672134178304:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826853.562877:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826853.562904:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953d10 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674f8 expref: 29 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.562918:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8:0x0].0x0 (ffff8d54605a1f00) 00010000:00010000:1.0:1787826853.562922:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826853.562966:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134178304:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 99us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826853.562973:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:3.0:1787826853.563558:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.563601:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134178560 00000100:00100000:0.0:1787826853.563606:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134178560 00000100:00100000:0.0:1787826853.563631:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:0.0:1787826853.563641:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+28:14979:x1874672134178560:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:0.0:1787826853.563835:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+29:14979:x1874672134178560:12345-192.168.203.6@tcp:35:grep.0 Request processed in 196us (277us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787826853.563840:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:0.0:1787826853.571005:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.571055:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134178816 00000100:00100000:3.0:1787826853.571063:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134178816 00000100:00100000:3.0:1787826853.571119:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 82 00000100:00100000:3.0:1787826853.571130:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+29:14980:x1874672134178816:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:3.0:1787826853.571150:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826853.571168:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674ff expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.571304:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d25 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.571318:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.571329:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826853.571361:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x9:0x0]: returning size 6 00010000:00010000:3.0:1787826853.571458:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ff expref: 32 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.571476:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ff expref: 31 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.571484:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff8d53436db000) 00010000:00010000:3.0:1787826853.571487:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826853.571490:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031e00, rc 0) 00000100:00100000:3.0:1787826853.571549:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+31:14980:x1874672134178816:12345-192.168.203.6@tcp:101:grep.0 Request processed in 421us (553us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787826853.571557:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 82 00000100:00100000:2.0:1787826853.573056:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.573111:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134178944 00000100:00100000:3.0:1787826853.573118:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134178944 00000100:00100000:3.0:1787826853.573162:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:3.0:1787826853.573170:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+31:2392:x1874672134178944:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826853.573181:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.573196:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d25 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ff expref: 31 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.573207:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff8d53436db000) 00010000:00010000:3.0:1787826853.573209:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826853.573268:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134178944:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826853.573276:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:0.0:1787826853.573880:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.573976:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134179200 00000100:00100000:2.0:1787826853.573981:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134179200 00000100:00100000:2.0:1787826853.574012:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:2.0:1787826853.574019:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+30:14980:x1874672134179200:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:2.0:1787826853.574299:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+31:14980:x1874672134179200:12345-192.168.203.6@tcp:35:grep.0 Request processed in 266us (405us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787826853.574309:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:0.0:1787826853.580395:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.580521:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134179456 00000100:00100000:3.0:1787826853.580532:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134179456 00000100:00100000:3.0:1787826853.580587:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:3.0:1787826853.580599:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+31:14981:x1874672134179456:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:3.0:1787826853.580621:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826853.580641:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467506 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.580740:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d3a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.580754:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.580765:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826853.580775:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 6 00010000:00010000:3.0:1787826853.580873:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467506 expref: 34 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.580890:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d3a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467506 expref: 33 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.580898:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8d54745a7900) 00010000:00010000:3.0:1787826853.580901:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826853.580905:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031400, rc 0) 00000100:00100000:3.0:1787826853.580975:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+33:14981:x1874672134179456:12345-192.168.203.6@tcp:101:grep.0 Request processed in 378us (588us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787826853.580997:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:1.0:1787826853.582658:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.582715:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134179584 00000100:00100000:3.0:1787826853.582722:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134179584 00000100:00100000:3.0:1787826853.582768:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:3.0:1787826853.582777:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+33:2390:x1874672134179584:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826853.582791:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.582810:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d3a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467506 expref: 33 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.582825:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8d54745a7900) 00010000:00010000:3.0:1787826853.582829:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826853.582880:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134179584:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 104us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826853.582889:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:0.0:1787826853.583941:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.584042:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134179840 00000100:00100000:3.0:1787826853.584048:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134179840 00000100:00100000:3.0:1787826853.584087:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:3.0:1787826853.584096:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:14981:x1874672134179840:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:3.0:1787826853.584532:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+33:14981:x1874672134179840:12345-192.168.203.6@tcp:35:grep.0 Request processed in 436us (592us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787826853.584540:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:0.0:1787826853.590107:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.590298:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134180096 00000100:00100000:2.0:1787826853.590309:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134180096 00000100:00100000:2.0:1787826853.590365:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 84 00000100:00100000:2.0:1787826853.590375:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+33:14982:x1874672134180096:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:2.0:1787826853.590399:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826853.590419:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953d48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346750d expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.590522:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953d4f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.590535:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953d4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.590547:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953d4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826853.590557:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 6 00010000:00010000:2.0:1787826853.590647:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953d48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346750d expref: 36 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.590664:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953d4f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346750d expref: 35 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.590672:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8d54745a7e00) 00010000:00010000:2.0:1787826853.590686:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826853.590690:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2200, rc 0) 00000100:00100000:2.0:1787826853.590741:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+35:14982:x1874672134180096:12345-192.168.203.6@tcp:101:grep.0 Request processed in 367us (642us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787826853.590748:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 84 00000100:00100000:1.0:1787826853.593324:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826853.593402:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826853.593440:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134180224 00000100:00100000:0.0:1787826853.593449:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134180224 00000100:00100000:2.0:1787826853.593461:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134180480 00000100:00100000:2.0:1787826853.593471:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134180480 00000100:00100000:2.0:1787826853.593520:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1787826853.593521:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:2.0:1787826853.593535:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450468050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+36:14982:x1874672134180480:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:0.0:1787826853.593536:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5442b17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134180224:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826853.593554:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826853.593576:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953d4f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346750d expref: 36 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.593601:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8d54745a7e00) 00010000:00010000:0.0:1787826853.593606:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826853.593663:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5442b17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+35:2392:x1874672134180224:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826853.593687:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:2.0:1787826853.593795:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450468050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+35:14982:x1874672134180480:12345-192.168.203.6@tcp:35:grep.0 Request processed in 265us (392us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787826853.593800:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:1.0:1787826853.601065:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.601123:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134180736 00000100:00100000:3.0:1787826853.601132:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134180736 00000100:00100000:3.0:1787826853.601189:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 85 00000100:00100000:3.0:1787826853.601201:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+35:14983:x1874672134180736:12345-192.168.203.6@tcp:101:grep.0 00010000:00010000:3.0:1787826853.601279:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826853.601311:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467514 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.601409:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.601429:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.601440:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826853.601450:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 7 00010000:00010000:3.0:1787826853.601534:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467514 expref: 38 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.601550:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467514 expref: 37 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.601558:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8d53436dbd00) 00010000:00010000:3.0:1787826853.601560:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826853.601563:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440031e00, rc 0) 00000100:00100000:3.0:1787826853.601616:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+37:14983:x1874672134180736:12345-192.168.203.6@tcp:101:grep.0 Request processed in 418us (559us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787826853.601624:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 85 00000100:00100000:0.0:1787826853.603007:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.603060:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134180864 00000100:00100000:2.0:1787826853.603067:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134180864 00000100:00100000:2.0:1787826853.603110:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:2.0:1787826853.603119:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+37:2393:x1874672134180864:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826853.603130:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826853.603148:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953d64 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467514 expref: 37 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.603162:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8d53436dbd00) 00010000:00010000:2.0:1787826853.603166:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826853.603227:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134180864:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.603236:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:0.0:1787826853.604191:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.604251:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134181120 00000100:00100000:3.0:1787826853.604258:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134181120 00000100:00100000:3.0:1787826853.604305:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:3.0:1787826853.604325:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:14983:x1874672134181120:12345-192.168.203.6@tcp:35:grep.0 00000100:00100000:3.0:1787826853.604535:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+37:14983:x1874672134181120:12345-192.168.203.6@tcp:35:grep.0 Request processed in 211us (345us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787826853.604541:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:1.0:1787826853.605954:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.605988:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134181376 00000100:00100000:3.0:1787826853.605992:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134181376 00000100:00100000:3.0:1787826853.606028:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:3.0:1787826853.606034:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+37:14044:x1874672134181376:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826853.606046:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826853.606058:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346751b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826853.606125:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787826853.606188:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346751b expref: 39 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.606201:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:3.0:1787826853.606204:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826853.606209:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346751b expref: 39 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.606253:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5440030400, rc 0) 00000100:00100000:3.0:1787826853.606282:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+38:14044:x1874672134181376:12345-192.168.203.6@tcp:101:bash.0 Request processed in 248us (331us total) trans 4294967355 rc 301/301 00000100:00100000:3.0:1787826853.606298:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:0.0:1787826853.607311:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.607352:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134181504 00000100:00100000:2.0:1787826853.607364:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134181504 00000100:00100000:2.0:1787826853.607412:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 87 00000100:00100000:2.0:1787826853.607426:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+38:14044:x1874672134181504:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1787826853.607438:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826853.607448:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953d80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467522 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.607487:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7953d87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.607499:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7953d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.607510:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7953d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826853.607534:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826853.607538:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826853.607551:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7953d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.607570:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953d80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467522 expref: 40 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.607583:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7953d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467522 expref: 39 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.607591:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826853.607603:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826853.607606:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2a00, rc 0) 00000100:00100000:2.0:1787826853.607645:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+39:14044:x1874672134181504:12345-192.168.203.6@tcp:101:bash.0 Request processed in 225us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.607653:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 87 00000100:00100000:0.0:1787826853.609652:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.609685:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134181632 00000100:00100000:2.0:1787826853.609692:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134181632 00000100:00100000:2.0:1787826853.609725:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:2.0:1787826853.609734:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+39:14044:x1874672134181632:12345-192.168.203.6@tcp:37:bash.0 00000100:00100000:2.0:1787826853.611427:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+39:14044:x1874672134181632:12345-192.168.203.6@tcp:37:bash.0 Request processed in 1693us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826853.611433:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:0.0:1787826853.612696:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.612728:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134181888 00000100:00100000:3.0:1787826853.612739:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134181888 00000100:00100000:3.0:1787826853.612766:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:3.0:1787826853.612772:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+39:14044:x1874672134181888:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:3.0:1787826853.612931:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+40:14044:x1874672134181888:12345-192.168.203.6@tcp:35:bash.0 Request processed in 159us (237us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787826853.612940:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:0.0:1787826853.617312:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.617376:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134182144 00000100:00100000:3.0:1787826853.617384:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134182144 00000100:00100000:3.0:1787826853.617430:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 88 00000100:00100000:3.0:1787826853.617438:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+40:14984:x1874672134182144:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826853.617489:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826853.617515:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a79539e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467426 expref: 40 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617531:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8d54605a1000) 00010000:00010000:3.0:1787826853.617543:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7953d87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467522 expref: 39 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617549:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.617551:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826853.617567:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617576:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617582:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617604:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617608:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617612:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617680:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617687:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617693:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826853.617884:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787826853.617893:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 228480678166ns, next at 229480676118ns, rc = 0 00010000:00010000:3.0:1787826853.617948:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617957:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617965:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617972:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617989:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.617994:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618013:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826853.618029:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618035:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618042:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826853.618042:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618053:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618053:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.618061:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618063:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826853.618070:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618073:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618084:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618088:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8d5450fb5000) 00010000:00010000:3.0:1787826853.618094:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826853.618097:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618102:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8d5450fb5000) 00010000:00010000:3.0:1787826853.618103:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953d9c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618109:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826853.618114:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618124:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953da3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618124:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618137:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618141:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.618144:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.618152:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826853.618156:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.618160:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.618166:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618176:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618184:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.618187:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.618189:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618195:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953d8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826853.618205:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000987f216 reply state 000000000154f02b transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618232:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.618240:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x95f49252 (ffff8d5450fb5200) 00010000:00010000:3.0:1787826853.618243:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826853.618246:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826853.618324:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+40:14984:x1874672134182144:12345-192.168.203.6@tcp:36:rm.0 Request processed in 886us (1022us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787826853.618335:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 88 00000100:00100000:1.0:1787826853.620402:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.620519:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134182400 00000100:00100000:3.0:1787826853.620526:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134182400 00000100:00100000:3.0:1787826853.620574:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 89 00000100:00100000:3.0:1787826853.620584:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+40:14984:x1874672134182400:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826853.620723:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.620750:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a7953b5e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674a4 expref: 40 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620764:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8d53436dbd00) 00010000:00010000:3.0:1787826853.620773:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826853.620790:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620801:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620809:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620821:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620828:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620835:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620887:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620899:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.620906:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826853.621053:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00010000:00010000:3.0:1787826853.621081:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 3/0,1 mode: --/PW res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621087:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621092:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621096:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621101:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621104:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621118:0:6485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826853.621129:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621132:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621143:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621148:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e1c7200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826853.621149:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826853.621151:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.621157:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621158:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621174:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8d5450fb5600) 00010000:00010000:3.0:1787826853.621177:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826853.621180:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.621183:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826853.621184:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953db8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.621190:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621196:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.621201:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621203:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621234:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621241:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e1c7e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.621244:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621265:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.621268:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8d5450fb5600) 00010000:00010000:0.0:1787826853.621273:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826853.621277:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 1/0,0 mode: --/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621279:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787826853.621298:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953dbf lrc: 0/0,0 mode: --/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621299:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.621305:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621313:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953daa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.621319:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1787826853.621325:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed8073d9 reply state 00000000dfb753a8 transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.621326:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826853.621330:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.621339:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.621345:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfd049252 (ffff8d5450fb5300) 00010000:00010000:3.0:1787826853.621348:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826853.621350:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826853.621412:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+41:14984:x1874672134182400:12345-192.168.203.6@tcp:36:rm.0 Request processed in 821us (1008us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1787826853.621420:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 89 00000100:00100000:0.0:1787826853.622773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.622825:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134182656 00000100:00100000:2.0:1787826853.622832:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134182656 00000100:00100000:2.0:1787826853.622866:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 90 00000100:00100000:2.0:1787826853.622872:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+41:14984:x1874672134182656:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:2.0:1787826853.622902:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826853.622914:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953a0e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467434 expref: 41 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.622925:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x4:0x0].0x0 (ffff8d54605a1400) 00010000:00010000:2.0:1787826853.622936:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826853.622947:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.622954:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.622959:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.622974:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.622978:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.622982:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623029:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623042:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623046:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826853.623156:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:2.0:1787826853.623182:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623188:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623193:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623197:0:10060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623201:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623204:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623236:0:10060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826853.623249:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623254:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.623258:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826853.623266:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623272:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.623278:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2c00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826853.623292:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826853.623293:0:10301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623298:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623308:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.623314:0:10301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623318:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x4:0x0].0x0 (ffff8d53428dea00) 00010000:00010000:2.0:1787826853.623321:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826853.623324:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623328:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953dd4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.623330:0:10301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x4:0x0].0x0 (ffff8d53428dea00) 00010000:00010000:1.0:1787826853.623335:0:10301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826853.623338:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 1/0,0 mode: --/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.623342:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7953ddb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623342:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623356:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623362:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623365:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826853.623367:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.623370:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.623373:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.623374:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826853.623384:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623392:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826853.623394:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826853.623397:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623402:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953dc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826853.623412:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ede947b reply state 0000000032779857 transno 4294967359 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623421:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.623428:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2ef3d52 (ffff8d53428de700) 00010000:00010000:2.0:1787826853.623430:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826853.623433:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826853.623485:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:14984:x1874672134182656:12345-192.168.203.6@tcp:36:rm.0 Request processed in 612us (718us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1787826853.623491:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 90 00000100:00100000:0.0:1787826853.625111:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.625145:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134182912 00000100:00100000:3.0:1787826853.625152:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134182912 00000100:00100000:3.0:1787826853.625185:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 91 00000100:00100000:3.0:1787826853.625200:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+42:14984:x1874672134182912:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826853.625254:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.625270:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7953a38 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467442 expref: 42 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625300:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0x0 (ffff8d53428de600) 00010000:00010000:3.0:1787826853.625307:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826853.625318:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625324:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625329:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625336:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625340:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625344:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625394:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625401:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625407:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826853.625533:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00010000:00010000:3.0:1787826853.625558:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625569:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625574:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625579:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625582:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625586:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625600:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826853.625613:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625619:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625623:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826853.625625:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625628:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625637:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.625641:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625650:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826853.625653:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625655:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625669:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625688:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0x0 (ffff8d5450fb5e00) 00010000:00010000:3.0:1787826853.625692:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826853.625696:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625701:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0x0 (ffff8d5450fb5e00) 00010000:00010000:3.0:1787826853.625703:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177600/0xc0fefc09a7953df0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625706:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826853.625711:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625722:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177e00/0xc0fefc09a7953df7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625728:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625743:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625748:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625752:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.625754:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.625758:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.625760:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.625764:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.625764:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625771:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.625773:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.625775:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625778:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177400/0xc0fefc09a7953de2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826853.625792:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b389a971 reply state 000000008677511f transno 4294967360 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625797:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.625801:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8ac02452 (ffff8d5450fb5500) 00010000:00010000:3.0:1787826853.625803:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826853.625804:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826853.625843:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+43:14984:x1874672134182912:12345-192.168.203.6@tcp:36:rm.0 Request processed in 646us (734us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787826853.625847:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 91 00000100:00100000:1.0:1787826853.627243:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.627297:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134183168 00000100:00100000:3.0:1787826853.627303:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134183168 00000100:00100000:3.0:1787826853.627337:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 92 00000100:00100000:3.0:1787826853.627343:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+43:14984:x1874672134183168:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826853.627371:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.627385:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7953a62 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467450 expref: 43 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627395:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6:0x0].0x0 (ffff8d53436db600) 00010000:00010000:3.0:1787826853.627400:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826853.627413:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627422:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627430:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627451:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627459:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627464:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627503:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627508:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627512:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826853.627607:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8704 00010000:00010000:3.0:1787826853.627638:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627647:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627654:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627661:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627665:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627673:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627690:0:6485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826853.627703:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.627708:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826853.627710:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.627715:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627721:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.627723:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e1c7200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826853.627728:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627738:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e1c7e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.627744:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.627746:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.627766:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6:0x0].0x0 (ffff8d5450fb5000) 00010000:00010000:3.0:1787826853.627767:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.627768:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826853.627772:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.627781:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7200/0xc0fefc09a7953e13 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627785:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6:0x0].0x0 (ffff8d5450fb5000) 00010000:00010000:2.0:1787826853.627788:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.627789:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826853.627792:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826853.627794:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.627794:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627801:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7e00/0xc0fefc09a7953e0c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627813:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627817:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627825:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627830:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482176e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.627833:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627838:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627846:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.627849:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.627851:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627858:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176e00/0xc0fefc09a7953dfe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826853.627867:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d81306e8 reply state 00000000baf70a68 transno 4294967361 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627875:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.627879:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x427acf52 (ffff8d5450fb5400) 00010000:00010000:3.0:1787826853.627881:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826853.627882:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826853.627930:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+44:14984:x1874672134183168:12345-192.168.203.6@tcp:36:rm.0 Request processed in 586us (692us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1787826853.627937:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 92 00000100:00100000:0.0:1787826853.629418:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.629494:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134183424 00000100:00100000:2.0:1787826853.629500:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134183424 00000100:00100000:2.0:1787826853.629536:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:2.0:1787826853.629543:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+44:14984:x1874672134183424:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:2.0:1787826853.629573:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826853.629597:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482176200/0xc0fefc09a7953a8c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346745e expref: 44 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629611:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7:0x0].0x0 (ffff8d54605a1e00) 00010000:00010000:2.0:1787826853.629618:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826853.629631:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629640:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629659:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629672:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629679:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629686:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629731:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629738:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629744:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826853.629858:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8768 00010000:00010000:2.0:1787826853.629888:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629905:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629912:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629919:0:10060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629929:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629933:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629948:0:10060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826853.629959:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629962:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629966:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629969:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826853.629971:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629976:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.629980:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826853.629982:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7:0x0].0x0 (ffff8d53428de200) 00010000:00010000:2.0:1787826853.629985:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826853.629987:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.629988:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630003:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7953e28 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.630004:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3a00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826853.630009:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.630016:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630017:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.630024:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7:0x0].0x0 (ffff8d53428de200) 00010000:00010000:2.0:1787826853.630026:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.630028:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826853.630032:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 1/0,0 mode: --/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630034:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.630042:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7953e2f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630044:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826853.630049:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630054:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.630059:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826853.630062:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.630062:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.630065:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826853.630066:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826853.630069:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630072:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a7953e1a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826853.630079:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003966001d reply state 00000000cf4cae23 transno 4294967362 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630084:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.630088:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1b739652 (ffff8d53428dee00) 00010000:00010000:2.0:1787826853.630090:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826853.630091:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826853.630128:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+45:14984:x1874672134183424:12345-192.168.203.6@tcp:36:rm.0 Request processed in 586us (713us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787826853.630136:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:0.0:1787826853.631756:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.631795:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134183680 00000100:00100000:3.0:1787826853.631802:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134183680 00000100:00100000:3.0:1787826853.631835:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 94 00000100:00100000:3.0:1787826853.631842:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+45:14984:x1874672134183680:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826853.631873:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.631890:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030a00/0xc0fefc09a7953ab6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346746c expref: 45 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.631905:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8:0x0].0x0 (ffff8d54605a1f00) 00010000:00010000:3.0:1787826853.631920:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826853.631932:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.631938:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.631944:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.631952:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.631956:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.631960:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.631996:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632000:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632004:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826853.632099:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8832 00010000:00010000:3.0:1787826853.632121:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632127:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632136:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632141:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632144:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632148:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632160:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826853.632170:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632174:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632177:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632182:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826853.632182:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.632185:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632190:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632191:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632207:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8:0x0].0x0 (ffff8d5450fb5c00) 00010000:00010000:3.0:1787826853.632209:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826853.632250:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632251:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826853.632259:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031200/0xc0fefc09a7953e44 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632260:0:10301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632278:0:10301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632293:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632299:0:10301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8:0x0].0x0 (ffff8d5450fb5c00) 00010000:00010000:3.0:1787826853.632302:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632303:0:10301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826853.632307:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 1/0,0 mode: --/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632315:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632316:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030200/0xc0fefc09a7953e4b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632333:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.632338:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.632339:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.632342:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.632344:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.632350:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632360:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.632362:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.632365:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632371:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031e00/0xc0fefc09a7953e36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826853.632381:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c821de4 reply state 0000000090cda3a4 transno 4294967363 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632401:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.632407:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x532e4152 (ffff8d5450fb5600) 00010000:00010000:3.0:1787826853.632410:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826853.632412:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826853.632461:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+46:14984:x1874672134183680:12345-192.168.203.6@tcp:36:rm.0 Request processed in 618us (706us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787826853.632468:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 94 00000100:00100000:1.0:1787826853.633608:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.633638:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134183936 00000100:00100000:3.0:1787826853.633643:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134183936 00000100:00100000:3.0:1787826853.633672:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 95 00000100:00100000:3.0:1787826853.633684:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+46:14984:x1874672134183936:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826853.633713:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.633727:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a7953ae0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346747a expref: 46 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633738:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff8d53436db000) 00010000:00010000:3.0:1787826853.633753:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826853.633780:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633788:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633795:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633816:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633823:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633830:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633872:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633881:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.633887:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826853.634017:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8896 00010000:00010000:3.0:1787826853.634049:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634055:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634060:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634063:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634067:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634075:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634088:0:6485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826853.634101:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634107:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634113:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634118:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.634121:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.634122:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826853.634128:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634128:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634137:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff8d5450fb5b00) 00010000:00010000:3.0:1787826853.634140:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826853.634143:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826853.634143:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.634147:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634148:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953e60 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.634160:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634160:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634166:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.634171:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff8d5450fb5b00) 00010000:00010000:1.0:1787826853.634173:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826853.634177:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634177:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.634183:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7953e67 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634183:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.634186:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634192:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.634195:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.634197:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.634198:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.634198:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.634200:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.634209:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634253:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953e52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826853.634263:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000080908ff reply state 00000000c594e762 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634274:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.634278:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4bf9e852 (ffff8d5450fb5d00) 00010000:00010000:3.0:1787826853.634280:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826853.634282:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826853.634320:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+47:14984:x1874672134183936:12345-192.168.203.6@tcp:36:rm.0 Request processed in 639us (714us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787826853.634325:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 95 00000100:00100000:0.0:1787826853.636172:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826853.636209:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134184192 00000100:00100000:2.0:1787826853.636243:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134184192 00000100:00100000:2.0:1787826853.636295:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 96 00000100:00100000:2.0:1787826853.636305:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+47:14984:x1874672134184192:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:2.0:1787826853.636339:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826853.636354:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c7400/0xc0fefc09a7953b0a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467488 expref: 47 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636364:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8d54745a7900) 00010000:00010000:2.0:1787826853.636371:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826853.636385:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636393:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636409:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636423:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636431:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636435:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636487:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636500:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636505:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826853.636617:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8960 00010000:00010000:2.0:1787826853.636650:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636659:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636666:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636673:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636679:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636684:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636701:0:6487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826853.636713:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636719:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.636729:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826853.636738:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636741:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.636755:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3800 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826853.636766:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826853.636768:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636772:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.636784:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636787:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.636804:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8d53428deb00) 00010000:00010000:1.0:1787826853.636814:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826853.636818:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636822:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8d53428deb00) 00010000:00010000:1.0:1787826853.636826:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953e83 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636827:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826853.636833:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.636841:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826853.636842:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7953e7c lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826853.636846:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826853.636849:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826853.636864:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636871:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636876:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636880:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826853.636883:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636897:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636905:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826853.636907:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826853.636909:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636915:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953e6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826853.636924:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004657c543 reply state 000000009fe968ec transno 4294967365 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636933:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826853.636939:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x59102352 (ffff8d53428dec00) 00010000:00010000:2.0:1787826853.636941:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826853.636943:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826853.636995:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+48:14984:x1874672134184192:12345-192.168.203.6@tcp:36:rm.0 Request processed in 691us (828us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787826853.637001:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 96 00000100:00100000:0.0:1787826853.638513:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826853.638547:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134184448 00000100:00100000:3.0:1787826853.638552:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134184448 00000100:00100000:3.0:1787826853.638583:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 97 00000100:00100000:3.0:1787826853.638589:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+48:14984:x1874672134184448:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826853.638623:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826853.638638:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6800/0xc0fefc09a7953b34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467496 expref: 48 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638648:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8d54745a7e00) 00010000:00010000:3.0:1787826853.638658:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826853.638671:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638677:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638682:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638690:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638697:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638703:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638749:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638768:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638775:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826853.638904:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9024 00010000:00010000:3.0:1787826853.638962:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638971:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638979:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638986:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638991:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.638998:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639016:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826853.639027:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639031:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639042:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.639044:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826853.639050:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826853.639052:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639054:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.639066:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079400 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826853.639067:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.639071:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639084:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8d5450fb5e00) 00010000:00010000:0.0:1787826853.639085:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639088:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826853.639092:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639099:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953e98 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.639103:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8d5450fb5e00) 00010000:00010000:0.0:1787826853.639107:0:6474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826853.639109:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.639111:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 1/0,0 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639116:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.639126:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a7953e9f lrc: 0/0,0 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639127:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639141:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826853.639143:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826853.639149:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826853.639152:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826853.639154:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826853.639157:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639164:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826853.639165:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826853.639167:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639171:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953e8a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826853.639178:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001235c0f2 reply state 00000000e355e0b6 transno 4294967366 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639184:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826853.639189:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d464a52 (ffff8d5450fb5000) 00010000:00010000:3.0:1787826853.639191:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826853.639194:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826853.639265:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+49:14984:x1874672134184448:12345-192.168.203.6@tcp:36:rm.0 Request processed in 673us (753us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787826853.639273:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 97 00000100:00100000:2.0:1787826853.969433:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143685760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826853.969453:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143686016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826853.969518:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826853.969575:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826853.969586:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143685888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826853.969594:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143685760 00000100:00100000:1.0:1787826853.969603:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143685760 00000100:00100000:2.0:1787826853.969621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826853.969632:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686016 00000100:00100000:3.0:1787826853.969639:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686016 00000100:00080000:0.0:1787826853.969641:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826853.969671:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787826853.969678:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143685888 00000100:00100000:1.0:1787826853.969684:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143685760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826853.969690:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143685888 00000100:00100000:3.0:1787826853.969698:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787826853.969708:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143686016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826853.969709:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787826853.969725:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826853.969735:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787826853.969744:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143685888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826853.969763:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787826853.969776:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143685760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826853.969784:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787826853.969814:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826853.969843:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143686016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826853.969858:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787826853.969863:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143685888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826853.969871:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1787826853.969902:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b11680 x1874672143686016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826853.969904:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d139e00 x1874672143685760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826853.969929:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143686016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826853.969932:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d139e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143685760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826853.969951:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143685888:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787826854.097380:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826854.993407:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826854.993435:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143686144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826854.993490:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826854.993531:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686144 00000100:00100000:0.0:1787826854.993538:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686144 00000100:00100000:0.0:1787826854.993584:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787826854.993593:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143686144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826854.993622:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826854.993683:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143686144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826854.993691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787826854.993726:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143686144:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826855.121381:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826855.980543:0:18188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 3: Fail OST during write, with verification ========================================================== 06:34:15 (1787826855) 00000100:00100000:1.0:1787826856.007730:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826856.007790:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134184704 00000100:00100000:3.0:1787826856.007804:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134184704 00000100:00080000:1.0:1787826856.007859:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826856.007891:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 98 00000100:00100000:3.0:1787826856.007908:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+49:15551:x1874672134184704:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826856.007938:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826856.008131:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953ea6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467529 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008281:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008297:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008312:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008352:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008360:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008368:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826856.008687:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xe:0x0], index 0: 0 00010000:00010000:3.0:1787826856.008850:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953ebb lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008859:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953ebb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008867:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953ebb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008899:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008906:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008914:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008920:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826856.008924:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008932:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.008945:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826856.009009:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826856.009017:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.009035:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079200/0xc0fefc09a7953ead lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826856.009047:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d058f53 reply state 000000007593a2d9 transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.009058:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.009064:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x733c6acc (ffff8d5450fb5e00) 00010000:00010000:3.0:1787826856.009067:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826856.009071:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826856.009100:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7953ea6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467529 expref: 52 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.009114:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953ebb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467529 expref: 51 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.009121:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd:0x0].0x0 (ffff8d5450fb5b00) 00010000:00010000:3.0:1787826856.009123:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826856.009126:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e079600, rc 0) 00000100:00100000:3.0:1787826856.009190:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+52:15551:x1874672134184704:12345-192.168.203.6@tcp:101:bash.0 Request processed in 1288us (1466us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787826856.009198:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 98 00000100:00100000:0.0:1787826856.015891:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826856.015935:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134184832 00000100:00100000:3.0:1787826856.015945:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134184832 00000100:00080000:0.0:1787826856.016005:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826856.016016:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 112 00000100:00100000:3.0:1787826856.016033:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+15:15551:x1874672134184832:12345-192.168.203.6@tcp:101:tee.0 00010000:00010000:3.0:1787826856.016055:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826856.016074:0:10061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003339cf6d/0xc0fefc09a7953ec9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467530 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826856.016483:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826856.016505:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1787826856.016510:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826856.016519:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003339cf6d/0xc0fefc09a7953ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467530 expref: 16 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.016537:0:10061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003339cf6d/0xc0fefc09a7953ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467530 expref: 16 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.016550:0:10061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e078000, rc 0) 00000100:00100000:3.0:1787826856.016617:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:15551:x1874672134184832:12345-192.168.203.6@tcp:101:tee.0 Request processed in 591us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826856.016624:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 112 00000100:00100000:2.0:1787826856.017374:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826856.017405:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143686272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.017424:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143686400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.017504:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826856.017504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826856.017507:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143686528:0@lo:400:kworker.0 00000100:00100000:0.0:1787826856.017565:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826856.017602:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143686912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826856.017614:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143687040:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.017622:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143686656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.017650:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826856.017683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826856.017688:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143687424:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.017696:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826856.017719:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143687552:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.017747:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143687168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.017758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826856.017766:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686528 00000100:00100000:1.0:1787826856.017771:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686528 00000100:00100000:0.0:1787826856.017782:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686912 00000100:00100000:0.0:1787826856.017787:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686912 00000100:00100000:2.0:1787826856.017800:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826856.017811:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687040 00000100:00100000:1.0:1787826856.017815:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787826856.017825:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687040 00000100:00100000:1.0:1787826856.017830:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143686528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.017837:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143687680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826856.017841:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687424 00000100:00100000:0.0:1787826856.017847:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687424 00000100:00100000:3.0:1787826856.017867:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787826856.017877:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143686912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826856.017903:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787826856.017905:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143686528:12345-0@lo:400:kworker.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826856.017906:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826856.017922:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787826856.017923:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143686912:12345-0@lo:400:kworker.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826856.017927:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143687040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.017934:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787826856.017948:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787826856.017962:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143686784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.017963:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787826856.017984:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143687040:12345-0@lo:400:kworker.0 Request processed in 60us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826856.017984:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143687424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787826856.017985:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826856.017992:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826856.018000:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787826856.018009:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826856.018017:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826856.018031:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687552 00000100:00100000:3.0:1787826856.018032:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143687424:12345-0@lo:400:kworker.0 Request processed in 56us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826856.018038:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687552 00000100:00100000:3.0:1787826856.018044:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826856.018055:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143687296:0@lo:400:kworker.0 00000100:00100000:1.0:1787826856.018065:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143686528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.018074:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686400 00000100:00100000:3.0:1787826856.018078:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686400 00010000:00080000:1.0:1787826856.018089:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534479da40 x1874672143687040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826856.018095:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787826856.018107:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826856.018114:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686656 00000100:00100000:3.0:1787826856.018117:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686656 00000100:00100000:1.0:1787826856.018120:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143687040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826856.018122:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143687552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018137:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143687808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.018138:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687168 00000100:00100000:3.0:1787826856.018144:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687168 00000100:00100000:3.0:1787826856.018166:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687680 00000100:00100000:1.0:1787826856.018169:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686784 00000100:00100000:3.0:1787826856.018169:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687680 00000100:00100000:1.0:1787826856.018172:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686784 00000100:00100000:3.0:1787826856.018193:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687296 00000100:00100000:2.0:1787826856.018199:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826856.018201:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143687552:12345-0@lo:400:kworker.0 Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826856.018202:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787826856.018202:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687296 00000100:00100000:0.0:1787826856.018242:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787826856.018255:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143686784:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826856.018281:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826856.018281:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687808 00000100:00100000:3.0:1787826856.018284:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687808 00000100:00080000:0.0:1787826856.018290:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826856.018298:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826856.018301:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826856.018342:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143686784:12345-0@lo:400:kworker.0 Request processed in 119us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826856.018342:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00010000:00080000:0.0:1787826856.018343:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534479c3c0 x1874672143687552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826856.018356:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787826856.018361:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787826856.018370:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143686400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.018371:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143686656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826856.018381:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143687552:0@lo:400:kworker.0 00000100:00100000:1.0:1787826856.018397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787826856.018406:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143687168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.018436:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143686656:12345-0@lo:400:kworker.0 Request processed in 68us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826856.018446:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787826856.018454:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143686784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018463:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143686400:12345-0@lo:400:kworker.0 Request processed in 104us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826856.018473:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787826856.018481:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143687168:12345-0@lo:400:kworker.0 Request processed in 70us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826856.018482:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143686656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.018484:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787826856.018498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787826856.018498:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143687680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018508:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787826856.018513:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143687168:0@lo:400:kworker.0 00000100:00100000:1.0:1787826856.018528:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787826856.018534:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143687296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826856.018549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143687808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826856.018571:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143687680:12345-0@lo:400:kworker.0 Request processed in 76us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826856.018579:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787826856.018590:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143687680:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018594:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143687296:12345-0@lo:400:kworker.0 Request processed in 69us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826856.018607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143687808:12345-0@lo:400:kworker.0 Request processed in 63us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826856.018616:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787826856.018631:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:0.0:1787826856.018632:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534479cf00 x1874672143687296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826856.018647:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143686912:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018658:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143686272 00000100:00100000:0.0:1787826856.018667:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143687296:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018667:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143686272 00000100:00100000:3.0:1787826856.018668:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143687424:0@lo:400:kworker.0 00010000:00080000:0.0:1787826856.018705:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534479d680 x1874672143687808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826856.018705:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143686400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826856.018722:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143687808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018736:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787826856.018746:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143686272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826856.018806:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143686272:12345-0@lo:400:kworker.0 Request processed in 62us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826856.018815:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1787826856.018843:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143686272:0@lo:400:kworker.0 00010000:00010000:2.0:1787826856.145363:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826856.212404:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826856.212478:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134184960 00000100:00100000:1.0:1787826856.212492:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134184960 00002000:00100000:1.0:1787826856.212552:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xe:0x0] (0->4194303) req@ffff8d534479e1c0 x1874672134184960/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:457/0 lens 488/0 e 0 to 0 dl 1787826867 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826856.212562:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479e1c0 with x1874672134184960 ext(0->4194303) 00002000:00010000:1.0:1787826856.212568:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479e1c0 00000100:00100000:1.0:1787826856.212608:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:1.0:1787826856.212623:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134184960:12345-192.168.203.6@tcp:4:tee.0 00000100:00100000:1.0:1787826856.237880:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134184960:12345-192.168.203.6@tcp:4:tee.0 Request processed in 25254us (25479us total) trans 17179869195 rc 0/0 00000100:00100000:1.0:1787826856.237895:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 14 00002000:00100000:1.0:1787826856.237910:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xe:0x0] (0->4194303) req@ffff8d534479e1c0 x1874672134184960/t17179869195(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:457/0 lens 488/448 e 0 to 0 dl 1787826867 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826856.237922:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479e1c0 with x1874672134184960 ext(0->4194303) 00002000:00010000:1.0:1787826856.237928:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479e1c0 00000100:00100000:2.0:1787826856.260097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826856.260142:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134185216 00000100:00100000:3.0:1787826856.260152:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134185216 00000100:00100000:3.0:1787826856.260326:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:3.0:1787826856.260338:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+52:15551:x1874672134185216:12345-192.168.203.6@tcp:35:tee.0 00000001:00080000:3.0:1787826856.260550:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787826856.260675:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+54:15551:x1874672134185216:12345-192.168.203.6@tcp:35:tee.0 Request processed in 339us (583us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787826856.260684:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 32 00000020:00080000:3.0:1787826856.260689:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:01000004:1.0:1787826856.687400:0:18285:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787826856.687451:0:18285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826856.687461:0:18285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826856.687466:0:18285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826856.687471:0:18285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826856.687508:0:18285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787826856.687514:0:18285:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787826856.687539:0:18285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826856.687543:0:18285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787826856.687549:0:18285:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1787826856.687550:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826856.687558:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.687567:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3200 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826856.687571:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826856.687572:0:18285:0:(import.c:65:import_set_state_nolock()) ffff8d547d17f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787826856.687584:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826856.687592:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826856.687598:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826856.687600:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787826856.687603:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787826856.687629:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.687637:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826856.687643:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143687936:0@lo:39:umount.0 00010000:00010000:0.0:1787826856.687676:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.687685:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a7953bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953bc7 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826856.687695:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1787826856.687697:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826856.687700:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826856.687703:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826856.687708:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143688064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826856.687714:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826856.687735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826856.687771:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688064 00000100:00100000:3.0:1787826856.687778:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688064 00000100:00100000:3.0:1787826856.687830:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826856.687842:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143688064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826856.687854:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826856.687868:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953bc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953bc0 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.687879:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826856.687926:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143688064:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826856.687937:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787826856.687967:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143688064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826856.687984:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143687936 00000100:00100000:0.0:1787826856.687988:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143687936 00000100:00100000:0.0:1787826856.688017:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787826856.688023:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143687936:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787826856.688042:0:6486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953bdc 00000100:00080000:0.0:1787826856.688051:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d544558e000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787826856.688091:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826856.688111:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143687936:12345-0@lo:39:umount.0 Request processed in 88us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826856.688118:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000020:00000080:0.0:1787826856.688125:0:6486:0:(genops.c:885:class_export_put()) final put ffff8d5445589000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:2.0:1787826856.688183:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d547d17f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787826856.688198:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143687936:0@lo:39:umount.0 00000020:00000080:3.0:1787826856.688207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5445589000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1787826856.688238:0:18285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826856.688242:0:18285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787826856.688246:0:18285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826856.688437:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d544558e000 for lustre-MDT0000 00000100:00080000:1.0:1787826856.689038:0:18285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826856.689041:0:18285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787826856.689043:0:18285:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787826856.689051:0:18285:0:(import.c:65:import_set_state_nolock()) ffff8d54438ab800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787826856.689097:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143688192:0@lo:39:umount.0 00000100:00100000:2.0:1787826856.689128:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826856.689181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688192 00000100:00100000:1.0:1787826856.689185:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688192 00000100:00100000:1.0:1787826856.689208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787826856.689229:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143688192:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826856.689245:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953bf1 00000100:00080000:1.0:1787826856.689252:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d5445589800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826856.689291:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826856.689344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143688192:12345-0@lo:39:umount.0 Request processed in 129us (214us total) trans 0 rc 0/0 00010000:00080000:3.0:1787826856.689346:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d138b40 x1874672143688192/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826856.689360:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d54438ab800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826856.689371:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000020:00000080:1.0:1787826856.689381:0:6514:0:(genops.c:885:class_export_put()) final put ffff8d544558d000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00100000:3.0:1787826856.689381:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d138b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143688192:0@lo:39:umount.0 00000100:00080000:0.0:1787826856.689412:0:18285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000020:00000080:2.0:1787826856.689415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544558d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:0.0:1787826856.689416:0:18285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826856.689423:0:18285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826856.689458:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5445589800 for lustre-MDT0001 00010000:00010000:0.0:1787826856.690280:0:18285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690291:0:18285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690298:0:18285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690312:0:18285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690332:0:18285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826856.690339:0:18285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690346:0:18285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690354:0:18285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690360:0:18285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826856.690361:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826856.690370:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.690380:0:18285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826856.690381:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2400 already unused, calling callback (ffffffffc13fec20) 10000000:01000000:0.0:1787826856.690385:0:18285:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:00010000:2.0:1787826856.690387:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826856.690398:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.690403:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1787826856.690406:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826856.690410:0:18285:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:3.0:1787826856.690411:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1787826856.690416:0:18285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 10000000:01000000:2.0:1787826856.690418:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:0.0:1787826856.690422:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:2.0:1787826856.690426:0:7427:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:02000400:0.0:1787826856.690429:0:18285:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:3.0:1787826856.690429:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2800 already unused, calling callback (ffffffffc13fec20) 10000000:01000000:2.0:1787826856.690430:0:7427:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:00010000:3.0:1787826856.690436:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.690448:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826856.690455:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826856.690457:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826856.690470:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826856.690474:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1787826856.690475:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787826856.690479:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787826856.690498:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826856.690501:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.690506:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826856.690513:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2400/0xc0fefc09a7953b81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953b88 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826856.690520:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143688320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826856.690533:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826856.690535:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826856.690537:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826856.690545:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a7953bb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953bb9 expref: -99 pid: 17294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826856.690549:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826856.690553:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826856.690566:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826856.690569:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826856.690571:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826856.690582:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143688448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826856.690594:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688320 00000100:00100000:1.0:1787826856.690598:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688320 00000100:00100000:2.0:1787826856.690618:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826856.690631:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688448 00000100:00100000:1.0:1787826856.690635:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688448 00000100:00100000:3.0:1787826856.690657:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826856.690667:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787826856.690672:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143688320:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826856.690682:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143688448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826856.690685:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826856.690693:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826856.690698:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953b88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953b81 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826856.690708:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7400/0xc0fefc09a7953bb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953bb2 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826856.690708:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826856.690725:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826856.690749:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3619:x1874672143688320:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826856.690759:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826856.690761:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143688448:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826856.690770:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787826856.690783:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143688320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826856.690803:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143688448:0@lo:103:ldlm_bl.0 00002000:00000080:0.0:1787826856.691584:0:18285:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1787826856.691600:0:18285:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:3.0:1787826856.692502:0:17295:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869195 is committed 00000020:00000080:0.0:1787826856.692548:0:18285:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1787826856.692554:0:18285:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d53444e8000 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 15 (0 0 11) 0 0 0 0: 0000000000000000 17179869195 stale:0 00000020:00080000:0.0:1787826856.692559:0:18285:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d53444eb000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 17179869186 stale:0 00000020:00080000:0.0:1787826856.692562:0:18285:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d53444e8800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:0.0:1787826856.692569:0:18285:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5450eecd28) has exports, disconnecting them 00000020:00080000:0.0:1787826856.692573:0:18285:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d53444e8000), last request at 1787826856 00000020:00000080:0.0:1787826856.692580:0:18285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953bab 00000020:00010000:0.0:1787826856.692584:0:18285:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d53444e8000: total 0 00000100:00080000:0.0:1787826856.692587:0:18285:0:(import.c:65:import_set_state_nolock()) ffff8d544558d800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787826856.692617:0:10301:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d53444e8000: total 0 00000020:00080000:0.0:1787826856.692628:0:18285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d53444e8000): rc 0 00000020:00080000:0.0:1787826856.692633:0:18285:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d53444eb000), last request at 1787826856 00000020:00000080:0.0:1787826856.692636:0:18285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953ba4 00000100:00080000:0.0:1787826856.692640:0:18285:0:(import.c:65:import_set_state_nolock()) ffff8d5448300800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826856.692654:0:18285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d53444eb000): rc 0 00000020:00000080:0.0:1787826856.692656:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d53444eb000/lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787826856.692662:0:10301:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d53444e8000, canceled 0 locks, left on hash table 11. 00000020:00080000:0.0:1787826856.692670:0:18285:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d53444e8800), last request at 1787826856 00010000:00010000:2.0:1787826856.692673:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826856.692675:0:18285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953b9d 00000100:00080000:0.0:1787826856.692683:0:18285:0:(import.c:65:import_set_state_nolock()) ffff8d5343592000 : changing import state from FULL to CLOSED 00002000:00010000:1.0:1787826856.692689:0:10301:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00000020:00080000:0.0:1787826856.692690:0:18285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d53444e8800): rc 0 00010000:00010000:2.0:1787826856.692693:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826856.692694:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d53444e8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787826856.692698:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444eb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00010000:00010000:1.0:1787826856.692715:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c024253e/0xc0fefc09a7953c45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 12 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826856.692729:0:18285:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5450eecd28) has no exports 00000020:00000080:3.0:1787826856.692733:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444e8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00002000:00010000:1.0:1787826856.692741:0:10301:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:1.0:1787826856.692754:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003847f0c2/0xc0fefc09a7953c3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467473 expref: 11 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787826856.692756:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5448300800 for lustre-OST0000 00000020:00000080:3.0:1787826856.692761:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343592000 for lustre-OST0000 00002000:00010000:1.0:1787826856.692785:0:10301:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:1.0:1787826856.692796:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011f78d82/0xc0fefc09a7953c37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346748f expref: 10 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826856.692811:0:10301:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb size from disk: 0 -> 4194304 00010000:00010000:0.0:1787826856.692814:0:18285:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000d950ce59/0xc0fefc09a7953c84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674c0 expref: 9 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826856.692815:0:10301:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb mtime from disk: 0 -> 1787826856 00002000:00010000:1.0:1787826856.692819:0:10301:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb ctime from disk: 0 -> 1787826856 00002000:00010000:1.0:1787826856.692823:0:10301:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1787826856.692835:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003339cf6d/0xc0fefc09a7953ec9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467530 expref: 9 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.692843:0:18285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d950ce59/0xc0fefc09a7953c84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674c0 expref: 9 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826856.692855:0:10301:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:1.0:1787826856.692868:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a68c511/0xc0fefc09a7953c30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467481 expref: 7 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.692876:0:18285:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000372bf048/0xc0fefc09a7953c61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 7 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826856.692888:0:10301:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:0.0:1787826856.692890:0:18285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372bf048/0xc0fefc09a7953c61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 6 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826856.692902:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000219ad041/0xc0fefc09a7953c22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346749d expref: 6 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826856.692924:0:10301:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 7, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:1.0:1787826856.692932:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7450bf9/0xc0fefc09a7953c29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 4 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.692938:0:18285:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000005e2b47f7/0xc0fefc09a7953c53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467449 expref: 4 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826856.692954:0:18285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e2b47f7/0xc0fefc09a7953c53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467449 expref: 3 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826856.692964:0:10301:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:1.0:1787826856.692978:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a591388b/0xc0fefc09a7953c4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467457 expref: 2 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826856.693008:0:10301:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d53444e8000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787826856.702185:0:10301:0:(genops.c:885:class_export_put()) final put ffff8d53444e8000/2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:1.0:1787826856.702209:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826856.702212:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826856.702234:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826856.702259:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444e8000/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:3.0:1787826856.702314:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d544558d800 for lustre-OST0000 00000020:01000000:0.0:1787826856.702457:0:18285:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5343a6a7e0 - data ffff8d5448afb6c0/ffff8d5343583c00 00000020:01000000:0.0:1787826856.702585:0:18285:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d53426f4540 - data ffff8d5448acb5e8/ffff8d547c484400 00100000:10000000:0.0:1787826856.708773:0:18285:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787826856.713552:0:18285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953b96 00000020:00000080:2.0:1787826856.713561:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d544ad59800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787826856.713571:0:18285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5442bd0800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787826856.713574:0:18285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd0800 2 00000020:01000004:2.0:1787826856.713576:0:18285:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d5442bd0800 from lustre-OST0000 00000020:00000080:3.0:1787826856.713583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544ad59800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787826856.713596:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826856.713608:0:18285:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787826856.713611:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d534351f000/lustre-OST0000_UUID 00000020:00000080:2.0:1787826856.713614:0:18285:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534351f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787826856.713622:0:18285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787826856.713667:0:18285:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1787826856.713672:0:18285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787826856.713676:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826856.713682:0:18285:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787826856.713688:0:18285:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d5341fa7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826856.713694:0:18285:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d53444fcd28) has exports, disconnecting them 00000020:00080000:2.0:1787826856.713699:0:18285:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d5341fa7000), last request at 1787826845 00000020:00000080:2.0:1787826856.713703:0:18285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953bd5 00000020:00080000:2.0:1787826856.713712:0:18285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5341fa7000): rc 0 00000020:00000080:2.0:1787826856.713717:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d5341fa7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787826856.713737:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5341fa7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787826856.715367:0:18285:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787826856.715373:0:18285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826856.715377:0:18285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826856.715383:0:18285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826856.715407:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d547d17f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787826856.715565:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826856.715573:0:18285:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787826856.715577:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d547f8e7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787826856.715580:0:18285:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f8e7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787826856.715589:0:18285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787826856.715653:0:18285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787826856.715656:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826856.715662:0:18285:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826856.715668:0:18285:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d5478926000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826856.715677:0:18285:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d53444f8000) has exports, disconnecting them 00000020:00080000:0.0:1787826856.715681:0:18285:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d5478926000), last request at 1787826845 00000020:00000080:0.0:1787826856.715685:0:18285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953bea 00000020:00080000:0.0:1787826856.715705:0:18285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5478926000): rc 0 00000020:00000080:0.0:1787826856.715709:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d5478926000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787826856.715731:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478926000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787826856.717276:0:18285:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787826856.717280:0:18285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826856.717283:0:18285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826856.717286:0:18285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826856.717314:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d54438ab800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787826856.717429:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826856.717439:0:18285:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787826856.717441:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d5478923000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787826856.717444:0:18285:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478923000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787826856.717450:0:18285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787826856.717506:0:18285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5442bd0800 1 00000020:00000080:1.0:1787826856.717512:0:18285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953b7a 00000020:00000080:1.0:1787826856.717517:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d547d075000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787826856.717527:0:18285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787826856.717532:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826856.717537:0:18285:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:3.0:1787826856.717537:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547d075000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:1.0:1787826856.717543:0:18285:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d53444f99b8) has no exports 00000020:00000080:1.0:1787826856.732702:0:18285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826856.732717:0:18285:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787826856.732729:0:18285:0:(genops.c:885:class_export_put()) final put ffff8d5442bd1000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787826856.732734:0:18285:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5442bd1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787826856.732739:0:18285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787826856.732834:0:18285:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d5442bd7800 00000020:02000400:1.0:1787826856.732873:0:18285:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787826857.169357:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826857.553426:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 232416208619ns, next at 233416206002ns, rc = 0 00000100:00100000:2.0:1787826857.553445:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826857.553468:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143688576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826857.553491:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826857.553500:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143688704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826857.553533:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826857.553566:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688704 00000100:00100000:0.0:1787826857.553584:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826857.553584:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688704 00000100:00100000:1.0:1787826857.553610:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688576 00000100:00100000:1.0:1787826857.553614:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688576 00000100:00100000:2.0:1787826857.553621:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787826857.553695:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787826857.553700:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143688576:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1787826857.553708:0:8403:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826857.553752:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143688576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (171us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826857.553759:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787826857.553792:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3619:x1874672143688704:12345-0@lo:13:osp-pre-0-1.0 00000100:02020000:0.0:1787826857.553797:0:3616:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000020:00080000:2.0:1787826857.553802:0:8404:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826857.553842:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3619:x1874672143688704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 213us (308us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826857.553849:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:02020000:1.0:1787826857.553884:0:3619:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787826857.553889:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826857.553893:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826857.553897:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1787826857.563853:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1787826857.563862:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826857.563871:0:3619:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 221 00000100:00080000:1.0:1787826857.563880:0:3619:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826857.563941:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b0d680 x1874672143688832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826857.563990:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143688832:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:3.0:1787826857.564061:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826857.564109:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688832 00000100:00100000:1.0:1787826857.564128:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688832 00000100:00100000:1.0:1787826857.564170:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787826857.564178:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143688832:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:1.0:1787826857.564200:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1787826857.565742:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826857.565749:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826857.565753:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1787826857.565762:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1787826857.565764:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826857.565768:0:3616:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 221 00000100:00080000:0.0:1787826857.565774:0:3616:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826857.565796:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d534479cb40 x1874672143688960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826857.565867:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143688960:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:3.0:1787826857.565910:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826857.565965:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688960 00000100:00100000:0.0:1787826857.565972:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688960 00000100:00100000:0.0:1787826857.566011:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787826857.566017:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143688960:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:0.0:1787826857.566033:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826857.566092:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143688960:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 73us (181us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826857.566103:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1787826857.566126:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826857.566132:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826857.566136:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143688960:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1787826857.576565:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143688832:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 12379us (12496us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826857.576581:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787826857.576603:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826857.576610:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826857.576622:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143688832:0@lo:8:ptlrpcd_00_03.0 00010000:00010000:2.0:1787826858.193455:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826858.385096:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826858.385138:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826858.385156:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134185344 00000100:00100000:1.0:1787826858.385168:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134185344 00000100:00100000:2.0:1787826858.385175:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826858.385203:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134185472 00000100:00100000:3.0:1787826858.385211:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134185472 00000100:00100000:2.0:1787826858.385294:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826858.385319:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134185600 00000100:00100000:0.0:1787826858.385326:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134185600 00000100:00100000:2.0:1787826858.385341:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826858.385349:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 394 00000100:00100000:1.0:1787826858.385369:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134185344:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826858.385381:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134185728 00000100:00100000:3.0:1787826858.385382:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 193 00000100:00100000:2.0:1787826858.385386:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134185728 00000100:00100000:0.0:1787826858.385390:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 194 00000100:00100000:0.0:1787826858.385401:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134185600:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826858.385407:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2390:x1874672134185472:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826858.385418:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134185856 00000100:00100000:2.0:1787826858.385423:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134185856 00000100:00100000:1.0:1787826858.385455:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134185344:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 91us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826858.385462:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 99 00000100:00100000:1.0:1787826858.385477:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 394 00000100:00100000:2.0:1787826858.385478:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134185856:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826858.385478:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2390:x1874672134185472:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826858.385486:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134185600:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826858.385495:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 193 00000100:00100000:0.0:1787826858.385503:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 194 00000100:00100000:2.0:1787826858.385524:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134185856:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826858.385531:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 99 00000100:00080000:0.0:1787826858.385541:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826858.385549:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826858.385556:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00080000:0.0:1787826858.385557:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826858.385564:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1874672134185728:12345-192.168.203.6@tcp:400:kworker.0 00000020:00080000:2.0:1787826858.385572:0:9498:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:2.0:1787826858.385600:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1874672134185728:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (307us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826858.385619:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00100000:2.0:1787826858.391531:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826858.391620:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134185984 00000100:00100000:1.0:1787826858.391632:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134185984 00000100:00100000:1.0:1787826858.391686:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 116 00000100:00100000:1.0:1787826858.391695:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134185984:12345-192.168.203.6@tcp:8:ptlrpcd_00_00.0 00010000:00020000:1.0:1787826858.391718:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826858.391781:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134185984:12345-192.168.203.6@tcp:8:ptlrpcd_00_00.0 Request processed in 86us (260us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826858.391789:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 116 00000100:00100000:0.0:1787826859.089418:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826859.089433:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826859.089441:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143689088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826859.089449:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143689216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826859.089522:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826859.089526:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826859.089572:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689088 00000100:00100000:3.0:1787826859.089581:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689088 00000100:00100000:1.0:1787826859.089590:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143689344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826859.089605:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689216 00000100:00100000:0.0:1787826859.089609:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689216 00000100:00100000:1.0:1787826859.089628:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826859.089656:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787826859.089657:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689344 00000100:00080000:2.0:1787826859.089659:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826859.089662:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689344 00000100:00100000:3.0:1787826859.089668:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143689088:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826859.089684:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787826859.089696:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143689216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826859.089700:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000004:00000024:3.0:1787826859.089703:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826859.089711:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143689344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826859.089727:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787826859.089728:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826859.089772:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143689088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826859.089779:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787826859.089783:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143689344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826859.089788:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143689216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826859.089793:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787826859.089803:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787826859.089813:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143689088:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787826859.089813:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787826859.089848:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b0fc00 x1874672143689216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826859.089860:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143689216:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787826859.089867:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534479f0c0 x1874672143689344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826859.089874:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143689344:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1787826859.090414:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:2.0:1787826859.090445:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967369 is committed 00000004:00080000:2.0:1787826859.090476:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:1.0:1787826859.090482:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090494:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090500:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090505:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440031400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090510:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090524:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090540:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x95f49252 (ffff8d5450fb5200) 00010000:00010000:1.0:1787826859.090543:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090547:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090552:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440031400/0xc0fefc09a7953d95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090572:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090576:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090580:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090583:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e1c6600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090584:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090588:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090591:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfd049252 (ffff8d5450fb5300) 00010000:00010000:1.0:1787826859.090593:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090594:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090602:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e1c6600/0xc0fefc09a7953db1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090612:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090616:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090622:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090625:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090627:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090631:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090636:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2ef3d52 (ffff8d53428de700) 00010000:00010000:1.0:1787826859.090637:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090639:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090642:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7953dcd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090651:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090655:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090662:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090665:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090667:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090670:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090675:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8ac02452 (ffff8d5450fb5500) 00010000:00010000:1.0:1787826859.090676:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090677:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090680:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177a00/0xc0fefc09a7953de9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090689:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090692:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090695:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090697:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5482177200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090699:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090711:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090719:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x427acf52 (ffff8d5450fb5400) 00010000:00010000:1.0:1787826859.090721:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090724:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090730:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5482177200/0xc0fefc09a7953e05 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090744:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090751:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090758:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090761:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090763:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090769:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090777:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1b739652 (ffff8d53428dee00) 00010000:00010000:1.0:1787826859.090779:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090782:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090794:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7953e21 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090809:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090815:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090820:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090823:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5440030400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090825:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090828:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090833:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x532e4152 (ffff8d5450fb5600) 00010000:00010000:1.0:1787826859.090834:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090836:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090839:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5440030400/0xc0fefc09a7953e3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090847:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090851:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090859:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090862:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090864:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090867:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090871:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4bf9e852 (ffff8d5450fb5d00) 00010000:00010000:1.0:1787826859.090873:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090874:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090877:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7953e59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090887:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090891:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090894:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090897:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090899:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090908:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090913:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x59102352 (ffff8d53428dec00) 00010000:00010000:1.0:1787826859.090914:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090915:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090918:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3c00/0xc0fefc09a7953e75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090926:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090929:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090932:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090935:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090936:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090940:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090945:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d464a52 (ffff8d5450fb5000) 00010000:00010000:1.0:1787826859.090946:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090947:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090954:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078600/0xc0fefc09a7953e91 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090964:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090967:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090971:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090974:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826859.090976:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090979:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090983:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x733c6acc (ffff8d5450fb5e00) 00010000:00010000:1.0:1787826859.090985:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826859.090987:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826859.090997:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079a00/0xc0fefc09a7953eb4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826859.217413:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826860.113511:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143689472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826860.113584:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826860.113654:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689472 00000100:00100000:2.0:1787826860.113663:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689472 00000100:00100000:2.0:1787826860.113711:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787826860.113722:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143689472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826860.113764:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826860.113810:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143689472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826860.113815:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787826860.113854:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143689472:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826860.241388:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826861.137441:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143689600:0@lo:400:kworker.0 00000100:00100000:1.0:1787826861.137450:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143689728:0@lo:400:kworker.0 00000100:00100000:1.0:1787826861.137468:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143689984:0@lo:400:kworker.0 00000100:00080000:0.0:1787826861.137470:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826861.137477:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787826861.137482:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787826861.137482:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143689856:0@lo:400:kworker.0 00000100:00080000:0.0:1787826861.137492:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 232 00000100:00080000:0.0:1787826861.137499:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826861.137506:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826861.137529:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d534479c000 x1874672143690240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826861.137536:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826861.137540:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826861.137545:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826861.137593:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689856 00000100:00100000:3.0:1787826861.137600:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689856 00000100:00080000:0.0:1787826861.137607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826861.137612:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1787826861.137614:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143690624:0@lo:400:kworker.0 00000100:00080000:0.0:1787826861.137615:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826861.137624:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 232 00000100:00100000:2.0:1787826861.137633:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143690112:0@lo:400:kworker.0 00000100:00080000:0.0:1787826861.137642:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826861.137650:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826861.137650:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826861.137659:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787826861.137673:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826861.137674:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143689856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826861.137681:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826861.137682:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546f6dbc00 x1874672143690752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826861.137692:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143690496:0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.137701:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826861.137717:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143690880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826861.137727:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826861.137749:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689984 00000100:00100000:0.0:1787826861.137754:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689984 00000100:00100000:3.0:1787826861.137760:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143689856:12345-0@lo:400:kworker.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826861.137767:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826861.137775:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143690624 00000100:00100000:3.0:1787826861.137775:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787826861.137782:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143690624 00000100:00100000:2.0:1787826861.137796:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143690368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826861.137796:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143690112 00000100:00100000:0.0:1787826861.137802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143690496 00000100:00100000:3.0:1787826861.137802:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143690112 00000100:00100000:0.0:1787826861.137809:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143690496 00000100:00100000:2.0:1787826861.137830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826861.137837:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787826861.137837:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787826861.137849:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143690112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826861.137851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787826861.137853:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143689984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.137866:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689600 00000100:00100000:0.0:1787826861.137867:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143690624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.137872:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689600 00000100:00100000:3.0:1787826861.137903:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143690112:12345-0@lo:400:kworker.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826861.137912:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787826861.137915:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143689984:12345-0@lo:400:kworker.0 Request processed in 66us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826861.137925:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143689600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826861.137925:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787826861.137927:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787826861.137929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f702580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143690624:12345-0@lo:400:kworker.0 Request processed in 65us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826861.137942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787826861.137954:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787826861.137959:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143690240:0@lo:8:kworker.0 00000100:00100000:1.0:1787826861.137968:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143690496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.137975:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143689600:12345-0@lo:400:kworker.0 Request processed in 54us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826861.137984:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1787826861.137998:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826861.138018:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143690496:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826861.138029:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826861.138029:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143690752:0@lo:8:kworker.0 00000100:00100000:2.0:1787826861.138030:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143690880 00000100:00100000:2.0:1787826861.138036:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143690880 00000100:00100000:1.0:1787826861.138042:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787826861.138064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143689728 00000100:00100000:0.0:1787826861.138070:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143689728 00000100:00100000:2.0:1787826861.138072:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143690368 00000100:00100000:3.0:1787826861.138077:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826861.138078:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143690368 00000100:00100000:1.0:1787826861.138098:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143690240 00000100:00100000:1.0:1787826861.138103:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143690240 00000100:00100000:0.0:1787826861.138106:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787826861.138107:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143690752 00000100:00100000:2.0:1787826861.138112:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143690752 00000100:00100000:0.0:1787826861.138119:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143689728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826861.138126:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787826861.138134:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826861.138139:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143690880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.138146:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787826861.138150:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143690368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.138157:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143690240:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787826861.138176:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143689728:12345-0@lo:400:kworker.0 Request processed in 60us (151us total) trans 0 rc 0/0 00010000:00020000:2.0:1787826861.138179:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826861.138188:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787826861.138193:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143690880:12345-0@lo:400:kworker.0 Request processed in 58us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826861.138201:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787826861.138250:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143690368:12345-0@lo:400:kworker.0 Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826861.138257:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787826861.138268:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143689728:0@lo:400:kworker.0 00000100:00100000:1.0:1787826861.138269:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826861.138270:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143690752:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826861.138272:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143690240:12345-0@lo:8:kworker.0 Request processed in 114us (272us total) trans 0 rc -19/-19 00010000:00020000:3.0:1787826861.138289:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826861.138294:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787826861.138295:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826861.138308:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826861.138316:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826861.138325:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143690752:12345-0@lo:8:kworker.0 Request processed in 58us (250us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826861.138333:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787826861.138337:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143690496:0@lo:400:kworker.0 00010000:00080000:2.0:1787826861.138340:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546f6db840 x1874672143690880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826861.138352:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143690880:0@lo:400:kworker.0 00010000:00080000:0.0:1787826861.138362:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534479f0c0 x1874672143690624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826861.138370:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787826861.138374:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143689856:0@lo:400:kworker.0 00000100:00100000:0.0:1787826861.138375:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143690624:0@lo:400:kworker.0 00010000:00080000:2.0:1787826861.138375:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534479da40 x1874672143690368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826861.138378:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826861.138386:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143690240:0@lo:8:kworker.0 00000100:00100000:2.0:1787826861.138403:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143690368:0@lo:400:kworker.0 00000100:00080000:3.0:1787826861.138408:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826861.138413:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826861.138417:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143690752:0@lo:8:kworker.0 00000100:00100000:0.0:1787826861.138420:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143689984:0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.138425:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143690112:0@lo:400:kworker.0 00000100:00100000:2.0:1787826861.138442:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143689600:0@lo:400:kworker.0 00010000:00010000:3.0:1787826861.265342:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826862.289365:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826863.314278:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826863.506600:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826863.506647:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826863.506670:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134186112 00000100:00100000:1.0:1787826863.506680:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134186112 00000100:00100000:2.0:1787826863.506689:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826863.506726:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826863.506730:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 396 00000100:00100000:1.0:1787826863.506743:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134186112:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826863.506748:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134186368 00000100:00100000:3.0:1787826863.506753:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134186368 00000100:00100000:2.0:1787826863.506762:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826863.506793:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134186624 00000100:00100000:3.0:1787826863.506794:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134186240 00000100:00100000:2.0:1787826863.506799:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134186624 00000100:00100000:3.0:1787826863.506799:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134186240 00000100:00100000:1.0:1787826863.506819:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134186112:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826863.506823:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 199 00000100:00100000:1.0:1787826863.506831:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 396 00000100:00100000:3.0:1787826863.506835:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134186368:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826863.506840:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134186496 00000100:00100000:2.0:1787826863.506845:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134186496 00000100:00080000:1.0:1787826863.506872:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826863.506877:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 102 00000100:00080000:1.0:1787826863.506880:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826863.506884:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826863.506892:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134186624:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826863.506892:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134186368:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 56us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826863.506905:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 199 00000100:00100000:3.0:1787826863.506926:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 200 00000100:00100000:2.0:1787826863.506939:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134186624:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826863.506939:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134186240:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826863.506953:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 102 00000100:00100000:2.0:1787826863.506970:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:2.0:1787826863.506979:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134186496:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:3.0:1787826863.506979:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134186240:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826863.506993:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 200 00010000:00020000:2.0:1787826863.507005:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826863.507038:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134186496:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 61us (277us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826863.507058:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:2.0:1787826864.209647:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826864.209727:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143691008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826864.209796:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826864.209840:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691008 00000100:00100000:3.0:1787826864.209848:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691008 00000100:00100000:3.0:1787826864.209899:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787826864.209907:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143691008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826864.209935:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826864.209975:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143691008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826864.209980:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787826864.210162:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143691008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826864.210376:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826864.210405:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143691136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826864.210442:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826864.210479:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e073c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143691264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826864.210496:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691136 00000100:00100000:2.0:1787826864.210501:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691136 00000100:00100000:0.0:1787826864.210508:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826864.210548:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691264 00000100:00100000:2.0:1787826864.210552:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691264 00000100:00100000:0.0:1787826864.210566:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787826864.210576:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143691136:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826864.210588:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00002000:00000024:0.0:1787826864.210596:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826864.210600:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143691264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826864.210614:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787826864.210798:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826864.210810:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143691136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 236us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826864.210813:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143691264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826864.210823:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787826864.210830:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:0.0:1787826864.210865:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e073c00 x1874672143691264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826864.210890:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e073c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143691264:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787826864.210900:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546f6da1c0 x1874672143691136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826864.210912:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143691136:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826864.337435:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826865.233397:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143691392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826865.233466:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826865.233521:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691392 00000100:00100000:0.0:1787826865.233529:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691392 00000100:00100000:0.0:1787826865.233578:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787826865.233588:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e073840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143691392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826865.233627:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826865.233683:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e073840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143691392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826865.233703:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787826865.234372:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f703840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143691392:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826865.361358:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826866.257508:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143691520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826866.257588:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826866.257592:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143691904:0@lo:400:kworker.0 00000100:00080000:3.0:1787826866.257632:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826866.257638:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826866.257642:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787826866.257666:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826866.257694:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826866.257704:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143692032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.257707:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143691648:0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.257735:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826866.257761:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692032 00000100:00100000:2.0:1787826866.257766:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692032 00000100:00100000:2.0:1787826866.257806:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787826866.257811:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143692032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.257859:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143692032:12345-0@lo:400:kworker.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826866.257877:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787826866.257898:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691520 00000100:00100000:2.0:1787826866.257901:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691520 00000100:00100000:2.0:1787826866.257917:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1787826866.257921:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143691520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.257942:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826866.257951:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143691520:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826866.257955:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787826866.257979:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691904 00000100:00100000:1.0:1787826866.257984:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691904 00000100:00100000:2.0:1787826866.257992:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143692032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.258017:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691648 00000100:00100000:1.0:1787826866.258021:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691648 00000100:00100000:2.0:1787826866.258025:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787826866.258032:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143691904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.258047:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787826866.258057:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143691648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.258063:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143691904:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826866.258071:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787826866.258094:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143691776:0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.258098:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143691648:12345-0@lo:400:kworker.0 Request processed in 42us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826866.258114:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787826866.258123:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826866.258155:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143691648:0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.258157:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143691904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.258211:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143691776 00000100:00100000:1.0:1787826866.258237:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143691776 00000100:00100000:1.0:1787826866.258266:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787826866.258275:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143691776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.258313:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143691776:12345-0@lo:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826866.258320:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787826866.258338:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143691776:0@lo:400:kworker.0 00000100:00080000:3.0:1787826866.259302:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 235 00000100:00080000:3.0:1787826866.259308:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826866.259314:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826866.259317:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143691520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826866.259343:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f995a40 x1874672143692160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826866.259414:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143692160:0@lo:8:kworker.0 00000100:00100000:0.0:1787826866.259445:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826866.259521:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692160 00000100:00100000:2.0:1787826866.259526:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692160 00000100:00080000:3.0:1787826866.259527:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826866.259533:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826866.259536:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826866.259540:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 235 00000100:00080000:3.0:1787826866.259544:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826866.259549:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826866.259560:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787826866.259574:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143692160:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787826866.259576:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f9943c0 x1874672143692672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00020000:2.0:1787826866.259597:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826866.259612:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143692672:0@lo:8:kworker.0 00000100:00100000:1.0:1787826866.259619:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f996d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143692288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.259634:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143692160:12345-0@lo:8:kworker.0 Request processed in 59us (187us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826866.259642:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787826866.259650:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826866.259664:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692672 00000100:00100000:2.0:1787826866.259669:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692672 00000100:00100000:1.0:1787826866.259681:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1787826866.259690:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787826866.259691:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143692544:0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.259696:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787826866.259699:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826866.259705:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143692672:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787826866.259706:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143692160:0@lo:8:kworker.0 00010000:00020000:2.0:1787826866.259723:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826866.259735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826866.259761:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692544 00000100:00100000:0.0:1787826866.259766:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692544 00000100:00100000:2.0:1787826866.259770:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143692672:12345-0@lo:8:kworker.0 Request processed in 63us (119us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826866.259778:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787826866.259789:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826866.259812:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826866.259817:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143692416:0@lo:400:kworker.0 00000100:00100000:1.0:1787826866.259846:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826866.259870:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143692800:0@lo:400:kworker.0 00000100:00080000:3.0:1787826866.259883:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826866.259893:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826866.259897:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692416 00000100:00100000:3.0:1787826866.259901:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692416 00000100:00100000:3.0:1787826866.259992:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787826866.260000:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143692544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826866.260036:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143692544:12345-0@lo:400:kworker.0 Request processed in 38us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826866.260043:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787826866.260056:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787826866.260062:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143692416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826866.260088:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143692416:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826866.260094:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1787826866.260109:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826866.260172:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826866.260177:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826866.260180:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143692672:0@lo:8:kworker.0 00000100:00100000:0.0:1787826866.260252:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143692416:0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.260329:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692288 00000100:00100000:2.0:1787826866.260334:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692288 00010000:00080000:1.0:1787826866.260350:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f994780 x1874672143692544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826866.260363:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143692544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826866.260366:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692800 00000100:00100000:3.0:1787826866.260372:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692800 00000100:00100000:2.0:1787826866.260379:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787826866.260389:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143692288:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787826866.260397:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826866.260412:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787826866.260422:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143692800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.260433:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143692288:12345-0@lo:400:kworker.0 Request processed in 44us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826866.260473:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143692800:12345-0@lo:400:kworker.0 Request processed in 52us (579us total) trans 0 rc 0/0 00010000:00080000:1.0:1787826866.260540:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f996940 x1874672143692800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826866.260555:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143692800:0@lo:400:kworker.0 00000100:00100000:2.0:1787826866.260593:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787826866.260621:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1787826866.260647:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f996d00 x1874672143692288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826866.260657:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f996d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143692288:0@lo:400:kworker.0 00010000:00010000:2.0:1787826866.385399:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826867.409982:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826868.433443:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826868.625175:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826868.625264:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826868.625288:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826868.625309:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826868.625332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826868.625359:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187008 00000100:00100000:3.0:1787826868.625367:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187008 00000100:00100000:3.0:1787826868.625413:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134186880 00000100:00100000:3.0:1787826868.625415:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134186880 00000100:00100000:3.0:1787826868.625434:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 205 00000100:00100000:3.0:1787826868.625443:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134187008:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826868.625502:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134187008:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826868.625515:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 205 00000100:00100000:3.0:1787826868.625531:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 206 00000100:00100000:3.0:1787826868.625537:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134186880:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826868.625560:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134186880:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 23us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826868.625567:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 206 00000100:00100000:3.0:1787826868.625591:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187264 00000100:00100000:3.0:1787826868.625595:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187264 00000100:00100000:3.0:1787826868.625633:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187136 00000100:00100000:3.0:1787826868.625636:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187136 00000100:00100000:3.0:1787826868.625654:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00080000:0.0:1787826868.625658:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826868.625671:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826868.625673:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134187264:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787826868.625675:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:02000400:0.0:1787826868.625698:0:6481:0:(pinger.c:524:ping_evictor_main()) lustre-MDT0001: haven't heard from client 623ddf66-2f94-46d4-a38e-7bde7caf88c3 (at 192.168.203.6@tcp) in 101 seconds. I think it's dead, and I am evicting it. exp ffff8d534390d000, cur 1787826868 deadline 1787826867 last 1787826767 00000100:00100000:3.0:1787826868.625708:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134187264:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826868.625722:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:3.0:1787826868.625737:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:3.0:1787826868.625741:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134187136:12345-192.168.203.6@tcp:8:kworker.0 00010000:00020000:3.0:1787826868.625759:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826868.625779:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134187136:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 37us (447us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826868.625784:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:1.0:1787826868.625902:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134186752 00000100:00100000:1.0:1787826868.625908:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134186752 00000100:00100000:1.0:1787826868.625945:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 398 00000100:00100000:1.0:1787826868.625956:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134186752:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826868.625996:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134186752:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826868.626003:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 398 00000100:00080000:0.0:1787826868.636387:0:6481:0:(pinger.c:526:ping_evictor_main()) Last request was at 1787826767 00000020:00080000:0.0:1787826868.636397:0:6481:0:(genops.c:1634:class_fail_export()) disconnecting export ffff8d534390d000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:0.0:1787826868.636409:0:6481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79534b2 00000100:00080000:0.0:1787826868.636427:0:6481:0:(import.c:65:import_set_state_nolock()) ffff8d534390d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826868.636461:0:6481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787826868.636476:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787826868.636609:0:6481:0:(genops.c:1651:class_fail_export()) disconnected export ffff8d534390d000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000100:00100000:2.0:1787826869.329430:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e070b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143693056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826869.329449:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f995680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143693184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826869.329474:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143692928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826869.329567:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826869.329575:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.329643:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693056 00000100:00100000:0.0:1787826869.329651:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693056 00000100:00080000:3.0:1787826869.329697:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826869.329706:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.329712:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787826869.329721:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693184 00000100:00100000:0.0:1787826869.329724:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143693056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826869.329727:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693184 00000100:00100000:2.0:1787826869.329737:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143692928 00000100:00100000:2.0:1787826869.329744:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143692928 00002000:00000024:0.0:1787826869.329749:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826869.329786:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787826869.329798:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143693184:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826869.329804:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143693056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.329813:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1787826869.329824:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:3.0:1787826869.329837:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826869.329865:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787826869.329888:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143692928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826869.329913:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826869.329917:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143693184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826869.329930:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787826869.329963:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f995680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143693184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826869.329985:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143692928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826869.330000:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:3.0:1787826869.330008:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e070b40 x1874672143693056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826869.330028:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546f6d9a40 x1874672143692928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826869.330030:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e070b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143693056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826869.330061:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143692928:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826869.457588:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826869.920002:0:18708:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826869.920006:0:18708:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787826869.920008:0:18708:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787826869.920086:0:18708:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d547f8e0000 00000020:01000004:2.0:1787826869.920098:0:18708:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787826869.920109:0:18708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826869.920120:0:18708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d53444f99b8) 00000020:00000080:2.0:1787826869.920133:0:18708:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787826869.950051:0:18708:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787826869.952022:0:18708:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787826869.952357:0:18708:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787826869.952518:0:18708:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787826869.952680:0:18708:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787826869.952851:0:18708:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787826869.953097:0:18708:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1787826869.953803:0:18708:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787826869.953944:0:18708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787826869.953955:0:18708:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787826869.953972:0:18708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953ed7 00000020:01000004:0.0:1787826869.953978:0:18708:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787826869.954001:0:18708:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787826869.954004:0:18708:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787826869.954010:0:18708:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787826869.954036:0:18708:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787826869.954039:0:18708:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787826869.961951:0:18708:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787826869.961991:0:18708:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787826869.961995:0:18708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787826869.961997:0:18708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826869.961998:0:18708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826869.962000:0:18708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826869.962001:0:18708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826869.962002:0:18708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826869.962004:0:18708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826869.962005:0:18708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826869.962007:0:18708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826869.962011:0:18708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787826869.962013:0:18708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826869.962014:0:18708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826869.962015:0:18708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826869.962016:0:18708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826869.962017:0:18708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826869.962019:0:18708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826869.962020:0:18708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826869.962021:0:18708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826869.962021:0:18708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826869.962050:0:18708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787826869.962070:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693312:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826869.962147:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.962235:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826869.962275:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693312 00000100:00100000:2.0:1787826869.962282:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693312 00000100:00100000:2.0:1787826869.962629:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1787826869.962641:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:18708:x1874672143693312:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826869.962671:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787826869.962674:0:6479:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787826869.962678:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787826869.962942:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:18708:x1874672143693312:12345-0@lo:253:mount.lustre.0 Request processed in 304us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826869.962951:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787826869.962980:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693312:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787826869.962992:0:18708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787826869.963001:0:18708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826869.963002:0:18708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826869.963003:0:18708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826869.963004:0:18708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826869.963005:0:18708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826869.963006:0:18708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826869.963007:0:18708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826869.963008:0:18708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826869.963008:0:18708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787826869.963027:0:18708:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d547f8e0000 from lustre-OST0000 10000000:01000000:0.0:1787826869.963048:0:18708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787826869.963051:0:18708:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787826869.963058:0:18708:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:0.0:1787826869.963067:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826869.963139:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826869.963165:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.963199:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826869.963211:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693440 00000100:00100000:2.0:1787826869.963232:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693440 00000100:00100000:2.0:1787826869.963319:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787826869.963327:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:18708:x1874672143693440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826869.963393:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:18708:x1874672143693440:12345-0@lo:501:mount.lustre.0 Request processed in 66us (227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826869.963400:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787826869.963421:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693440:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787826869.963436:0:18708:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787826869.963453:0:18708:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787826869.963459:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.963474:0:18708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826869.963497:0:18708:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d547f8e0000 10000000:01000000:0.0:1787826869.963501:0:18708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787826869.963505:0:18708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787826869.963511:0:18708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826869.963514:0:18708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787826869.963516:0:18708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787826869.963532:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.963538:0:18708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.963545:0:18708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826869.963553:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826869.963578:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.963596:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826869.963613:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693568 00000100:00100000:2.0:1787826869.963618:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693568 00000100:00100000:2.0:1787826869.963647:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787826869.963654:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:18708:x1874672143693568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826869.963662:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826869.963673:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d3000/0xc0fefc09a7953ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953ede expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.963692:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d3000/0xc0fefc09a7953ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953ede expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.963703:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d3000/0xc0fefc09a7953ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953ede expref: 22 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.963712:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3000, rc 0) 00000100:00100000:2.0:1787826869.963739:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143693568:12345-0@lo:101:mount.lustre.0 Request processed in 86us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826869.963745:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1787826869.963756:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826869.963769:0:18708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.963776:0:18708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826869.964385:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000040:00080000:0.0:1787826869.964734:0:18708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826869.966046:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:0.0:1787826869.966071:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:0.0:1787826869.966078:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:0.0:1787826869.966085:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:0.0:1787826869.966093:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:0.0:1787826869.966099:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:0.0:1787826869.966113:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:0.0:1787826869.966119:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:0.0:1787826869.966126:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 80 off9712 00000040:00080000:0.0:1787826869.966133:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9936 00000040:00080000:0.0:1787826869.966145:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10160 00000040:00080000:0.0:1787826869.966156:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 120 off10280 00000040:00080000:0.0:1787826869.966190:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 224 off10504 00000040:00080000:0.0:1787826869.966197:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 14 00000100:00100000:0.0:1787826869.966317:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826869.966373:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.966412:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.966438:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693696 00000100:00100000:1.0:1787826869.966446:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693696 00000100:00100000:1.0:1787826869.966505:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787826869.966516:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143693696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826869.966654:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143693696:12345-0@lo:501:mount.lustre.0 Request processed in 139us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.966663:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1787826869.966666:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826869.966701:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826869.966739:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.966764:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826869.966810:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693824 00000100:00100000:2.0:1787826869.966814:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693824 00000100:00100000:2.0:1787826869.966874:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1787826869.966881:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143693824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826869.966958:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143693824:12345-0@lo:503:mount.lustre.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826869.966974:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787826869.966992:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826869.967418:0:18708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826869.967464:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826869.967509:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.967534:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54756070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826869.967546:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143693952 00000100:00100000:2.0:1787826869.967551:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143693952 00000100:00100000:2.0:1787826869.967571:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787826869.967576:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143693952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826869.967638:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143693952:12345-0@lo:502:mount.lustre.0 Request processed in 60us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826869.967645:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1787826869.967672:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143693952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826869.967802:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1787826869.967826:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:1.0:1787826869.967840:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:1.0:1787826869.967852:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:1.0:1787826869.967863:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:1.0:1787826869.967877:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:1.0:1787826869.967889:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:1.0:1787826869.967901:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:1.0:1787826869.967914:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 80 off9712 00000040:00080000:1.0:1787826869.967927:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9936 00000040:00080000:1.0:1787826869.967959:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10160 00000040:00080000:1.0:1787826869.967975:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 120 off10280 00000100:00100000:1.0:1787826869.967999:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826869.968029:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.968041:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547575e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826869.968051:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694080 00000100:00100000:0.0:1787826869.968057:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694080 00000100:00100000:0.0:1787826869.968092:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1787826869.968099:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143694080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826869.968160:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143694080:12345-0@lo:502:mount.lustre.0 Request processed in 62us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.968165:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1787826869.968201:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826869.968257:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 224 off10504 00000040:00080000:1.0:1787826869.968264:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787826869.968653:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826869.968661:0:18712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787826869.968666:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826869.968668:0:18712:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787826869.968673:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826869.968691:0:18712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5450eecd28) 00000020:00000080:1.0:1787826869.968711:0:18712:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787826869.968717:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826869.968769:0:18712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e0000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787826869.968774:0:18712:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826869.968779:0:18712:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7953ef3 00010000:00010000:1.0:1787826869.971580:0:18712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1787826869.971919:0:18712:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 17179869184 lx: 1874672143596416 gen 0 00000001:00080000:1.0:1787826869.971947:0:18712:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 17179869186 srv lr: 17179869184 lx: 1874672143683072 gen 0 00000001:00080000:1.0:1787826869.971958:0:18712:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 17179869195 srv lr: 17179869184 lx: 1874672134184960 gen 0 00000001:00000004:1.0:1787826869.971970:0:18712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 17179869195 00080000:10000000:1.0:1787826869.972902:0:18712:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xd:0x0] (8/32) registered 00000020:00000080:1.0:1787826869.973638:0:18712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787826869.973648:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826869.973654:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826869.973656:0:18712:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787826869.973659:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787826869.973662:0:18712:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787826869.973663:0:18712:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826869.973665:0:18712:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826869.973666:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787826869.973669:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826869.973670:0:18712:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787826869.973673:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826869.973676:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826869.973677:0:18712:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787826869.973680:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787826869.973682:0:18712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787826869.973684:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826869.973686:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826869.973688:0:18712:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787826869.973690:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826869.973699:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826869.973701:0:18712:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787826869.973705:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787826869.973722:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826869.973725:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826869.973726:0:18712:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787826869.973729:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000020:01000000:0.0:1787826869.973797:0:18708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787826869.973836:0:18708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787826869.973852:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.973861:0:18708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826869.973873:0:18708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d547f8e0000 from 1 10000000:01000000:0.0:1787826869.973875:0:18708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826869.973904:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.973912:0:18708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.973923:0:18708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826869.973946:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826869.974007:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.974038:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694208 00000100:00100000:0.0:1787826869.974041:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.974046:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694208 00000100:00100000:1.0:1787826869.974090:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1787826869.974101:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:18708:x1874672143694208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826869.974114:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826869.974127:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953f16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953f0f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.974152:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953f0f expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.974163:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953f0f expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.974184:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7000, rc 0) 00000100:00100000:1.0:1787826869.974247:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694208:12345-0@lo:101:mount.lustre.0 Request processed in 148us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.974254:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1787826869.974280:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826869.974295:0:18708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.974306:0:18708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826869.974997:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 7 count 7 00000040:00080000:0.0:1787826869.975194:0:18708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826869.975370:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:0.0:1787826869.975401:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:0.0:1787826869.975420:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:0.0:1787826869.975448:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:0.0:1787826869.975462:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:0.0:1787826869.975494:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:0.0:1787826869.975498:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 6 count 7 00000100:00100000:0.0:1787826869.975542:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826869.975590:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.975622:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826869.975630:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694336 00000100:00100000:3.0:1787826869.975644:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694336 00000100:00100000:3.0:1787826869.975694:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787826869.975702:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826869.975794:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694336:12345-0@lo:501:mount.lustre.0 Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.975802:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826869.975805:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1787826869.975835:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826869.975877:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.975894:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.975922:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694464 00000100:00100000:1.0:1787826869.975928:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694464 00000100:00100000:1.0:1787826869.975961:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1787826869.975969:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826869.976055:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694464:12345-0@lo:503:mount.lustre.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.976070:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1787826869.976083:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826869.976422:0:18708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826869.976459:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826869.976508:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.976544:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.976544:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694592 00000100:00100000:1.0:1787826869.976548:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694592 00000100:00100000:1.0:1787826869.976578:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1787826869.976586:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826869.976683:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694592:12345-0@lo:502:mount.lustre.0 Request processed in 97us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.976691:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1787826869.976701:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826869.976837:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1787826869.976863:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:0.0:1787826869.976879:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1787826869.976893:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1787826869.976906:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000100:00100000:0.0:1787826869.976924:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826869.976953:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.976972:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826869.976986:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694720 00000100:00100000:3.0:1787826869.976992:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694720 00000100:00100000:3.0:1787826869.977033:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1787826869.977040:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826869.977123:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694720:12345-0@lo:502:mount.lustre.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.977133:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826869.977133:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000040:00080000:0.0:1787826869.977169:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:0.0:1787826869.977193:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1787826869.977541:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826869.977550:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826869.977552:0:18716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787826869.977557:0:18716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547f8e0000 00000020:00000080:0.0:1787826869.977559:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826869.977565:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826869.977567:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826869.977569:0:18716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787826869.977572:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826869.977574:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826869.977576:0:18716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787826869.977580:0:18716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547f8e0000 00000020:00000080:0.0:1787826869.977582:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826869.977631:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826869.977634:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826869.977635:0:18716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787826869.977639:0:18716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 7 count 7 00000020:01000000:1.0:1787826869.977709:0:18708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787826869.977740:0:18708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826869.977753:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.977761:0:18708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826869.977805:0:18708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787826869.977808:0:18708:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d547f8e0000 10000000:01000000:1.0:1787826869.977811:0:18708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d547f8e0000 10000000:01000000:1.0:1787826869.977816:0:18708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826869.977821:0:18708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d547f8e0000 from 1 10000000:01000000:1.0:1787826869.977824:0:18708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826869.977854:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.977862:0:18708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.977869:0:18708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826869.977884:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826869.977912:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.977940:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694848 00000100:00100000:1.0:1787826869.977940:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826869.977946:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694848 00000100:00100000:0.0:1787826869.977976:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1787826869.977984:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:18708:x1874672143694848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826869.977991:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826869.978003:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1400/0xc0fefc09a7953f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953f1d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.978024:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1400/0xc0fefc09a7953f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953f1d expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.978035:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1400/0xc0fefc09a7953f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953f1d expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.978053:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1400, rc 0) 00000100:00100000:0.0:1787826869.978080:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143694848:12345-0@lo:101:mount.lustre.0 Request processed in 99us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.978086:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787826869.978100:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826869.978116:0:18708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.978125:0:18708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826869.979949:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 52 count 51 00000040:00080000:0.0:1787826869.980248:0:18708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826869.980478:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:0.0:1787826869.980506:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:0.0:1787826869.980526:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:0.0:1787826869.980546:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:0.0:1787826869.980563:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:0.0:1787826869.980577:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:0.0:1787826869.980596:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:0.0:1787826869.980615:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:0.0:1787826869.980630:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:0.0:1787826869.980648:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:0.0:1787826869.980670:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:0.0:1787826869.980685:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:0.0:1787826869.980709:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:0.0:1787826869.980729:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:0.0:1787826869.980746:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:0.0:1787826869.980765:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:0.0:1787826869.980787:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:0.0:1787826869.980807:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:0.0:1787826869.980824:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:0.0:1787826869.980844:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:0.0:1787826869.980861:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:0.0:1787826869.980879:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:0.0:1787826869.980893:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:0.0:1787826869.980910:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:0.0:1787826869.980939:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 160 off12472 00000040:00080000:0.0:1787826869.980959:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12696 00000040:00080000:0.0:1787826869.980974:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12920 00000040:00080000:0.0:1787826869.980991:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off13000 00000040:00080000:0.0:1787826869.981009:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13224 00000040:00080000:0.0:1787826869.981027:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13448 00000040:00080000:0.0:1787826869.981044:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13536 00000040:00080000:0.0:1787826869.981060:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13664 00000040:00080000:0.0:1787826869.981079:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13808 00000040:00080000:0.0:1787826869.981096:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13936 00000040:00080000:0.0:1787826869.981111:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14160 00000040:00080000:0.0:1787826869.981126:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14384 00000040:00080000:0.0:1787826869.981141:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14464 00000040:00080000:0.0:1787826869.981158:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14688 00000040:00080000:0.0:1787826869.981190:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14912 00000040:00080000:0.0:1787826869.981211:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 88 off15000 00000040:00080000:0.0:1787826869.981280:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 128 off15128 00000040:00080000:0.0:1787826869.981316:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].42, 144 off15272 00000040:00080000:0.0:1787826869.981344:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].43, 128 off15400 00000040:00080000:0.0:1787826869.981360:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].44, 224 off15624 00000040:00080000:0.0:1787826869.981378:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].45, 224 off15848 00000040:00080000:0.0:1787826869.981400:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].46, 80 off15928 00000040:00080000:0.0:1787826869.981418:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].47, 224 off16152 00000040:00080000:0.0:1787826869.981438:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].48, 232 off16384 00000040:00080000:0.0:1787826869.981536:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].49, 224 off16608 00000040:00080000:0.0:1787826869.981555:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].50, 120 off16728 00000040:00080000:0.0:1787826869.981569:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].51, 224 off16952 00000040:00080000:0.0:1787826869.981573:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 51 count 51 00000100:00100000:0.0:1787826869.981636:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826869.981698:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.981720:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143694976 00000100:00100000:1.0:1787826869.981728:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143694976 00000100:00100000:0.0:1787826869.981729:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.981772:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1787826869.981781:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143694976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826869.981887:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143694976:12345-0@lo:501:mount.lustre.0 Request processed in 105us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.981895:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787826869.981899:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143694976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826869.981936:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826869.981967:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.981986:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.982028:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143695104 00000100:00100000:1.0:1787826869.982035:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143695104 00000100:00100000:1.0:1787826869.982074:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1787826869.982084:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826869.982156:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695104:12345-0@lo:503:mount.lustre.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.982164:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826869.982164:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000040:00080000:0.0:1787826869.982448:0:18708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826869.982502:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826869.982530:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.982550:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0baa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826869.982565:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143695232 00000100:00100000:3.0:1787826869.982570:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143695232 00000100:00100000:3.0:1787826869.982603:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1787826869.982612:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826869.982705:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695232:12345-0@lo:502:mount.lustre.0 Request processed in 94us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826869.982713:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1787826869.982721:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826869.982874:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:0.0:1787826869.982898:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:0.0:1787826869.982916:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:0.0:1787826869.982924:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:0.0:1787826869.982931:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:0.0:1787826869.982947:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:0.0:1787826869.982984:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:0.0:1787826869.983002:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:0.0:1787826869.983013:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:0.0:1787826869.983024:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:0.0:1787826869.983040:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:0.0:1787826869.983052:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:0.0:1787826869.983068:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:0.0:1787826869.983077:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:0.0:1787826869.983091:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:0.0:1787826869.983106:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:0.0:1787826869.983125:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:0.0:1787826869.983142:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:0.0:1787826869.983156:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:0.0:1787826869.983196:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:0.0:1787826869.983330:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:0.0:1787826869.983353:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:0.0:1787826869.983367:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:0.0:1787826869.983399:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:0.0:1787826869.983419:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 160 off12472 00000040:00080000:0.0:1787826869.983436:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12696 00000040:00080000:0.0:1787826869.983452:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12920 00000040:00080000:0.0:1787826869.983473:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off13000 00000040:00080000:0.0:1787826869.983494:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13224 00000040:00080000:0.0:1787826869.983518:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13448 00000040:00080000:0.0:1787826869.983541:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13536 00000040:00080000:0.0:1787826869.983564:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13664 00000040:00080000:0.0:1787826869.983592:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13808 00000040:00080000:0.0:1787826869.983618:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13936 00000040:00080000:0.0:1787826869.983641:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14160 00000040:00080000:0.0:1787826869.983674:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14384 00000040:00080000:0.0:1787826869.983697:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14464 00000040:00080000:0.0:1787826869.983720:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14688 00000040:00080000:0.0:1787826869.983741:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14912 00000040:00080000:0.0:1787826869.983769:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 88 off15000 00000040:00080000:0.0:1787826869.983782:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 128 off15128 00000040:00080000:0.0:1787826869.983799:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 144 off15272 00000040:00080000:0.0:1787826869.983816:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 128 off15400 00000040:00080000:0.0:1787826869.983834:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 224 off15624 00000040:00080000:0.0:1787826869.983852:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off15848 00000040:00080000:0.0:1787826869.983864:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].46, 80 off15928 00000040:00080000:0.0:1787826869.983871:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].47, 224 off16152 00000040:00080000:0.0:1787826869.983878:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].48, 232 off16384 00000100:00100000:0.0:1787826869.983909:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826869.983958:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826869.984030:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143695360 00000100:00100000:0.0:1787826869.984031:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826869.984037:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143695360 00000100:00100000:3.0:1787826869.984085:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1787826869.984095:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826869.984182:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695360:12345-0@lo:502:mount.lustre.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.984198:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826869.984200:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000040:00080000:0.0:1787826869.984353:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].49, 224 off16608 00000040:00080000:0.0:1787826869.984371:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].50, 120 off16728 00000100:00100000:0.0:1787826869.984392:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826869.984433:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.984463:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.984472:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143695488 00000100:00100000:1.0:1787826869.984494:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143695488 00000100:00100000:1.0:1787826869.984525:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1787826869.984531:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826869.984601:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143695488:12345-0@lo:502:mount.lustre.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.984607:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787826869.984610:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143695488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826869.984642:0:18708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].51, 224 off16952 00000040:00080000:0.0:1787826869.984649:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787826869.985090:0:18719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787826869.985104:0:18719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d5450e8cd28) 00000020:00000080:0.0:1787826869.985128:0:18719:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787826869.985257:0:18719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787826869.985262:0:18719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787826869.985265:0:18719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e0000 3 00010000:00080000:0.0:1787826869.985295:0:18719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d53444b2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1787826869.986996:0:18719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:0.0:1787826869.987166:0:18719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787826869.987209:0:18719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787826869.987252:0:18719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a7953f32 00000100:00080000:0.0:1787826869.987261:0:18719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826869.987266:0:18719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d53444b2800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826869.987299:0:18719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546f6d8780 x1874672143695616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826869.987329:0:18719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787826869.987380:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143695616:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787826869.987413:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826869.987417:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:3.0:1787826869.987420:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143696000:0@lo:400:kworker.0 00000100:00080000:0.0:1787826869.987427:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826869.987433:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 241 00000100:00080000:0.0:1787826869.987437:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1787826869.987438:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826869.987442:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826869.987458:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546f6d9e00 x1874672143696128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826869.987468:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.987486:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143696128:0@lo:8:kworker.0 00000100:00080000:0.0:1787826869.987494:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826869.987497:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787826869.987499:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826869.987503:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 241 00000100:00100000:3.0:1787826869.987505:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1787826869.987507:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826869.987514:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826869.987517:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143695872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826869.987519:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.987529:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546f6dad00 x1874672143696512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826869.987550:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143696512:0@lo:8:kworker.0 00000100:00100000:3.0:1787826869.987557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.987560:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143695744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826869.987584:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.987586:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.987604:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143696384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826869.987613:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696000 00000100:00100000:3.0:1787826869.987620:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696000 00000100:00100000:0.0:1787826869.987628:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.987639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143695616 00000100:00100000:1.0:1787826869.987643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143695616 00000100:00100000:0.0:1787826869.987651:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826869.987661:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143696256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826869.987672:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787826869.987674:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143695872 00000100:00100000:1.0:1787826869.987678:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143695872 00000100:00100000:3.0:1787826869.987685:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143696000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826869.987689:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.987697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143695744 00000100:00100000:1.0:1787826869.987699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143695744 00000100:00100000:1.0:1787826869.987710:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696384 00000100:00100000:1.0:1787826869.987713:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696384 00000100:00100000:0.0:1787826869.987715:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696256 00000100:00100000:0.0:1787826869.987717:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696256 00000100:00100000:0.0:1787826869.987742:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787826869.987750:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143696000:12345-0@lo:400:kworker.0 Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.987752:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787826869.987753:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f996d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143695872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826869.987760:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3615:x1874672143695616:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826869.987771:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:1.0:1787826869.987782:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000100:00100000:3.0:1787826869.987798:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696128 00000100:00100000:3.0:1787826869.987804:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696128 00000100:00100000:0.0:1787826869.987809:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f996d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143695872:12345-0@lo:400:kworker.0 Request processed in 60us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.987819:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000020:00000080:1.0:1787826869.987830:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a7953f39 00000100:00100000:3.0:1787826869.987834:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696512 00000100:00100000:3.0:1787826869.987838:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696512 00000100:00100000:0.0:1787826869.987844:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000004:00100000:1.0:1787826869.987848:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787826869.987855:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143695744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826869.987870:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787826869.987879:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143696128:12345-0@lo:8:kworker.0 00000100:00080000:1.0:1787826869.987898:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d5343bec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826869.987906:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143695744:12345-0@lo:400:kworker.0 Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.987917:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787826869.987933:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787826869.987944:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143696384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826869.987970:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143695616:12345-0@lo:38:llog_process_th.0 Request processed in 209us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826869.987983:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143696128:12345-0@lo:8:kworker.0 Request processed in 102us (460us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826869.987988:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826869.987997:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787826869.987998:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143696384:12345-0@lo:400:kworker.0 Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.988009:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787826869.988014:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787826869.988024:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143696256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826869.988034:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787826869.988043:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143696512:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787826869.988058:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143695744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826869.988060:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143696256:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.988068:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:0.0:1787826869.988077:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546f6d8000 x1874672143696384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826869.988089:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143696384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826869.988108:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143696512:12345-0@lo:8:kworker.0 Request processed in 62us (520us total) trans 0 rc -11/-11 00000100:00080000:1.0:1787826869.988115:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826869.988119:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826869.988127:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143696256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826869.988134:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787826869.988151:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826869.988156:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787826869.988160:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143696512:0@lo:8:kworker.0 00000100:00080000:1.0:1787826869.988187:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826869.988193:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787826869.988203:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143696128:0@lo:8:kworker.0 00000100:00100000:1.0:1787826869.988246:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826869.988253:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787826869.988263:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787826869.988269:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787826869.988273:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826869.988274:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143695872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826869.988288:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143695616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826869.988303:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143696000:0@lo:400:kworker.0 00000020:01000004:0.0:1787826869.988452:0:18719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787826869.988466:0:18719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d5450e8b370) 00000020:00000080:0.0:1787826869.988481:0:18719:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787826869.988550:0:18719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787826869.988555:0:18719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787826869.988558:0:18719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e0000 3 00010000:00080000:0.0:1787826869.988597:0:18719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d53444b4800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1787826869.990439:0:18719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:0.0:1787826869.990607:0:18719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787826869.990633:0:18719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787826869.990642:0:18719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a7953f47 00000100:00080000:0.0:1787826869.990651:0:18719:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826869.990657:0:18719:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d53444b4800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826869.990686:0:18719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546f6d8f00 x1874672143696640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826869.990711:0:18719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787826869.990736:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143696640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826869.990794:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826869.990848:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696640 00000100:00100000:1.0:1787826869.990854:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696640 00000040:00080000:0.0:1787826869.990872:0:18719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 00000100:00100000:1.0:1787826869.990888:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787826869.990893:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1874672143696640:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787826869.990913:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787826869.990952:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a7953f4e 00000004:00100000:1.0:1787826869.990967:0:6487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826869.990994:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8d5343be8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826869.991042:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143696640:12345-0@lo:38:llog_process_th.0 Request processed in 147us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.991048:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1787826869.991059:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546f6d8f00 x1874672143696640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826869.991069:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826869.991075:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000020:01000000:1.0:1787826869.991076:0:18708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00080000:0.0:1787826869.991081:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787826869.991084:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787826869.991085:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826869.991090:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143696640:0@lo:38:llog_process_th.0 10000000:01000000:1.0:1787826869.991108:0:18708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826869.991123:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.991134:0:18708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787826869.991197:0:18708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787826869.991199:0:18708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826869.991201:0:18708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826869.991202:0:18708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826869.991203:0:18708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826869.991205:0:18708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826869.991206:0:18708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826869.991208:0:18708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826869.991210:0:18708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826869.991239:0:18708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787826869.991242:0:18708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826869.991244:0:18708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826869.991246:0:18708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826869.991248:0:18708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826869.991251:0:18708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826869.991259:0:18708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826869.991260:0:18708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826869.991261:0:18708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826869.991262:0:18708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826869.991278:0:18708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787826869.991289:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143696768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787826869.991326:0:18708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826869.991348:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696768 00000100:00100000:1.0:1787826869.991351:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826869.991352:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696768 00000100:00100000:0.0:1787826869.991398:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1787826869.991407:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143696768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826869.991426:0:9479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787826869.991437:0:9479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787826869.992629:0:9479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826869.992644:0:9479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787826869.992699:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826869.992705:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826869.992722:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.992739:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.992747:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.992755:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.992763:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.992805:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.992821:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 24 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826869.992835:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143696896:0@lo:104: 00000100:00100000:0.0:1787826869.992844:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:18708:x1874672143696768:12345-0@lo:253:mount.lustre.0 Request processed in 1435us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.992857:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1787826869.992885:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826869.992935:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:18708:1874672143696768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826869.992940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143696896 10000000:01000000:3.0:1787826869.992949:0:18708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00010000:00010000:1.0:1787826869.992952:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826869.992953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143696896 00000020:01000004:3.0:1787826869.992954:0:18708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826869.992960:0:18708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826869.992963:0:18708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826869.992966:0:18708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:1.0:1787826869.992968:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 23 pid: 6480 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787826869.992969:0:18708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826869.992973:0:18708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826869.992975:0:18708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826869.992978:0:18708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826869.992981:0:18708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787826869.992987:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143697024:0@lo:104: 00000020:02000000:3.0:1787826869.993003:0:18708:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787826869.993018:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826869.993028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787826869.993043:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143697024 00000100:00100000:0.0:1787826869.993050:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143697024 00000100:00100000:2.0:1787826869.993051:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143696896:12345-0@lo:104: 00010000:00010000:1.0:1787826869.993061:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.993077:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.993085:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 9 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826869.993090:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787826869.993114:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143697024:12345-0@lo:104: 00000100:00100000:1.0:1787826869.993114:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143697152:192.168.203.6@tcp:104: 00010000:00010000:0.0:1787826869.993131:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826869.993194:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826869.993242:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143696896:0@lo:104: 00010000:00010000:2.0:1787826869.993258:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787826869.993260:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787826869.993263:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143697024:0@lo:104: 00000100:00100000:2.0:1787826869.993273:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143696896:12345-0@lo:104: Request processed in 232us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.993276:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143697024:12345-0@lo:104: Request processed in 164us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826869.993301:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787826869.993311:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1787826869.993354:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826869.993363:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.993373:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0200 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826869.993379:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.993396:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826869.993403:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.993405:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826869.993435:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.993437:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1c00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787826869.993447:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826869.993453:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826869.993470:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826869.993490:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826869.993496:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826869.993518:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.993529:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826869.993533:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.993544:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826869.993565:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.993569:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826869.993577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143697280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826869.993589:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7953c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953c1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.993595:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7953c06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.993618:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826869.993626:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826869.993635:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826869.993636:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826869.993643:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826869.993647:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826869.993651:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826869.993709:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826869.993721:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143697408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826869.993744:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826869.993781:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143697280 00000100:00100000:2.0:1787826869.993788:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143697280 00010000:00010000:2.0:1787826869.993823:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 24 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826869.993867:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143697408 00000100:00100000:2.0:1787826869.993872:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143697408 00010000:00010000:2.0:1787826869.993906:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 25 pid: 6480 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826869.993941:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826869.993958:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787826869.993965:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143697280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826869.993974:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143697408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826869.993981:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826869.993989:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826869.993990:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 25 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.994001:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 25 pid: 6480 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.994014:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 25 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.994035:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 25 pid: 6480 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.994068:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d546e1c6200/0xc0fefc09a7953c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953c14 expref: 25 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826869.994085:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d546e1c7c00/0xc0fefc09a7953c0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953c06 expref: 24 pid: 6480 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826869.994093:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826869.994106:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826869.994184:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143697280:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826869.994186:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143697408:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826869.994208:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826869.994291:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826869.994478:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143697408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826869.994496:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143697280:0@lo:103:ldlm_bl.0 00010000:00080000:3.0:1787826869.998159:0:18708:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 17179869195 00010000:00080000:3.0:1787826869.999243:0:18724:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 18724 00010000:00080000:3.0:1787826869.999256:0:18724:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1787826869.999261:0:18724:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:0.0:1787826869.999333:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826869.999374:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143697152:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826869.999428:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826869.999459:0:18708:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 00000100:00100000:1.0:1787826869.999463:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187392 00000100:00100000:1.0:1787826869.999471:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187392 00010000:00010000:1.0:1787826869.999506:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 10 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826869.999574:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 55 10000000:01000000:0.0:1787826869.999589:0:18708:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000100:00100000:1.0:1787826869.999590:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54516ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134187392:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826869.999608:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826869.999616:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 10 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999632:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 10 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826869.999633:0:18708:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787826869.999652:0:18708:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00010000:00010000:1.0:1787826869.999656:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1600/0xc0fefc09a7953bff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674b2 expref: 10 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999677:0:8417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999686:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826869.999703:0:8417:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006998888s 00010000:00010000:1.0:1787826869.999708:0:8417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999717:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999725:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999732:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999749:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826869.999755:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999765:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999784:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826869.999796:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826869.999851:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54516ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134187392:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 268us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826869.999859:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 55 00010000:00010000:1.0:1787826870.000047:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826870.000057:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826870.000064:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7e00/0xc0fefc09a7953f55 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1787826870.000957:0:18708:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826870.001188:0:18708:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787826870.332625:0:18773:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826870.332834:0:18773:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826870.353375:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143697536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826870.353494:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826870.353546:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143697536 00000100:00100000:3.0:1787826870.353556:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143697536 00000100:00100000:3.0:1787826870.353606:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787826870.353616:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143697536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826870.353650:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826870.353741:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143697536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826870.353749:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787826870.353840:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143697536:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826870.481396:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787826871.249292:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826871.249300:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 10 10000000:01000000:0.0:1787826871.249304:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826871.249354:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.249369:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.249380:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.249411:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143697664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826871.249478:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.249547:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826871.249562:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143697664 00000100:00100000:2.0:1787826871.249585:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143697664 00000100:00100000:2.0:1787826871.249667:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1787826871.249683:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143697664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826871.249707:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826871.249725:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953f5c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.249757:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.249770:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.249781:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2a00, rc 0) 00000100:00100000:2.0:1787826871.249874:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143697664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826871.249884:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1787826871.249940:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143697664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826871.249963:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.249973:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.250023:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143697792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826871.250058:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.250080:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826871.250106:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143697792 00000100:00100000:3.0:1787826871.250113:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143697792 00000100:00100000:3.0:1787826871.250145:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1787826871.250169:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143697792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787826871.250189:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787826871.250238:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787826871.250242:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787826871.250395:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143697792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 242us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826871.250407:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1787826871.250421:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143697792:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787826871.250465:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 19, was 0): DISCONN 00010000:00080000:0.0:1787826871.250476:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:0.0:1787826871.250481:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826871.250487:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826871.250510:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546f6d8000 x1874672143697920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1787826871.250559:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826871.250567:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826871.250575:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143697920:0@lo:8:ll_cfg_requeue.0 00010000:00010000:0.0:1787826871.250589:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826871.250599:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826871.250602:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 10 10000000:01000000:0.0:1787826871.250605:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:2.0:1787826871.250623:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826871.250625:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.250634:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.250642:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.250656:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143698048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826871.250685:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.250707:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143697920 00000100:00100000:3.0:1787826871.250714:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143697920 00000100:00100000:0.0:1787826871.250719:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826871.250750:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787826871.250760:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143697920:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787826871.250781:0:10061:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d5343bed800, cookie 0xc0fefc09a7953efa 00010000:00080000:3.0:1787826871.250785:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5343bed800 cur 246 last 1787826869 00010000:02000400:3.0:1787826871.250798:0:10061:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:2.0:1787826871.251369:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698048 00000100:00100000:2.0:1787826871.251374:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698048 00000100:00100000:2.0:1787826871.251413:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1787826871.251422:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143698048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826871.251435:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826871.251448:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7953f6a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.251469:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.251479:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.251488:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3400, rc 0) 00000100:00100000:2.0:1787826871.251536:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143698048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826871.251545:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1787826871.251567:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143698048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826871.251578:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.251585:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.251617:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143698176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826871.251649:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.251690:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826871.251702:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698176 00000100:00100000:2.0:1787826871.251709:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698176 00000100:00100000:2.0:1787826871.251746:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1787826871.251760:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143698176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826871.251775:0:9479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826871.251797:0:9479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826871.251800:0:9479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787826871.251913:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143698176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826871.251923:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787826871.251929:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143698176:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787826871.251963:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 19, was 0): DISCONN 00010000:00080000:0.0:1787826871.251971:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:0.0:1787826871.251975:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826871.251981:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826871.251999:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546f6d8f00 x1874672143698304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1787826871.252040:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:2.0:1787826871.252045:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143698304:0@lo:8:ll_cfg_requeue.0 00010000:00010000:0.0:1787826871.252049:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.252058:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826871.252085:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.252121:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698304 00000100:00100000:0.0:1787826871.252126:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698304 00000100:00100000:0.0:1787826871.252158:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787826871.252175:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143698304:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826871.252192:0:8399:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d5343beb800, cookie 0xc0fefc09a7953f01 00010000:00080000:0.0:1787826871.252198:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5343beb800 cur 246 last 1787826869 00010000:00080000:0.0:1787826871.252206:0:8399:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:0.0:1787826871.252249:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d5343beb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787826871.252255:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787826871.252259:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1787826871.252409:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d5448303800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826871.252463:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143698304:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 288us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826871.252472:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:2.0:1787826871.252493:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546f6d8f00 x1874672143698304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826871.252507:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:2.0:1787826871.252516:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787826871.252520:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787826871.252523:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869186 gen 2 00000100:00080000:2.0:1787826871.252526:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 17179869186 last 0 00000100:00080000:2.0:1787826871.252530:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787826871.252657:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143698304:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826871.252673:0:18890:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787826871.252676:0:18890:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1787826871.252679:0:18890:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1787826871.252708:0:18890:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787826871.252750:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143698432:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787826871.252780:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826871.252806:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698432 00000100:00100000:2.0:1787826871.252811:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698432 00000100:00100000:2.0:1787826871.252849:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787826871.252858:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143698432:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787826871.252870:0:8401:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d546f6d8f00 x1874672143698432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:472/0 lens 224/0 e 0 to 0 dl 1787826882 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826871.252891:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143698432:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (110us total) trans 0 rc 0/-999 00010000:00080000:0.0:1787826871.252900:0:18724:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1787826871.252907:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00002000:00100000:3.0:1787826871.255392:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d5343bed800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787826871.255401:0:10061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787826871.255405:0:10061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1787826871.255441:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d534260f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826871.255572:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143697920:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 4810us (4945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826871.255582:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:2.0:1787826871.255763:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546f6d8000 x1874672143697920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826871.255779:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 5 00000100:00080000:2.0:1787826871.255790:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787826871.255794:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787826871.255797:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:2.0:1787826871.255800:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00080000:2.0:1787826871.255803:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1787826871.256054:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143697920:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826871.256073:0:18892:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787826871.256078:0:18892:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1787826871.256082:0:18892:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1787826871.256120:0:18892:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1787826871.256185:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143698560:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826871.256262:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.256313:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698560 00000100:00100000:3.0:1787826871.256319:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698560 00000100:00100000:3.0:1787826871.256356:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787826871.256364:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143698560:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787826871.256376:0:8402:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f9961c0 x1874672143698560/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:472/0 lens 224/0 e 0 to 0 dl 1787826882 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826871.256402:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143698560:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 40us (141us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826871.256410:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1787826871.256438:0:18724:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:2.0:1787826871.505361:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826871.889268:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826871.889318:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187520 00000100:00100000:2.0:1787826871.889327:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187520 00000100:00100000:2.0:1787826871.889378:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 422 00000100:00100000:2.0:1787826871.889389:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+9:10866:x1874672134187520:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826871.889411:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826871.889428:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467537 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.889452:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.889475:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.889485:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2200, rc 0) 00000100:00100000:2.0:1787826871.889543:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134187520:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 157us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826871.889549:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 422 00000100:00100000:0.0:1787826871.891175:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826871.891262:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187648 00000100:00100000:2.0:1787826871.891272:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187648 00000100:00100000:2.0:1787826871.891326:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 423 00000100:00100000:2.0:1787826871.891336:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134187648:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826871.891354:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787826871.891371:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826871.891375:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787826871.892410:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134187648:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 1069us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826871.892424:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 423 00000100:00100000:0.0:1787826871.893538:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826871.893602:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187776 00000100:00100000:2.0:1787826871.893615:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187776 00000100:00100000:2.0:1787826871.893653:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 127 00000100:00100000:2.0:1787826871.893660:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134187776:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826871.893689:0:9498:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d5343bef800, cookie 0xc0fefc09a7953f08 00010000:00080000:2.0:1787826871.893696:0:9498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t17179869195 exp ffff8d5343bef800 cur 246 last 1787826869 00002000:00100000:2.0:1787826871.893713:0:9498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d5343bef800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 1073152 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787826871.893731:0:9498:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787826871.893880:0:9498:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd6800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1787826871.893930:0:18724:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787826871.893935:0:18724:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 17179869196 00010000:00080000:0.0:1787826871.893939:0:18724:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 17179869196 00010000:00080000:0.0:1787826871.893944:0:18724:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 17179869196 00000100:00100000:2.0:1787826871.893952:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134187776:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 Request processed in 289us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826871.893969:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 127 00000100:00100000:2.0:1787826871.896752:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826871.896801:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826871.896820:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134187904 00000100:00100000:3.0:1787826871.896833:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134187904 00000100:00100000:2.0:1787826871.896834:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826871.896885:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826871.896901:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188032 00000100:00100000:3.0:1787826871.896906:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188032 00000100:00100000:0.0:1787826871.896917:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188160 00000100:00100000:0.0:1787826871.896924:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188160 00000100:00100000:3.0:1787826871.896934:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188288 00000100:00100000:3.0:1787826871.896939:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188288 00000100:00100000:2.0:1787826871.896959:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:0.0:1787826871.896977:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:2.0:1787826871.896985:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134187904:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787826871.896994:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 130 00000100:00100000:0.0:1787826871.896999:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134188032:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787826871.897018:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134188160:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787826871.897035:0:9498:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d546e070780 x1874672134187904/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826871.897037:0:8401:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d546e070f00 x1874672134188032/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826871.897038:0:10061:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d546e072d00 x1874672134188160/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826871.897131:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134187904:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 144us (376us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826871.897132:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134188032:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 127us (315us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826871.897132:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134188160:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 108us (287us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826871.897169:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:3.0:1787826871.897183:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 130 00000100:00100000:2.0:1787826871.897193:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:0.0:1787826871.897205:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 131 00000100:00100000:0.0:1787826871.897234:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134188288:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826871.897247:0:8401:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d546e070000 x1874672134188288/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826871.897257:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134188288:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 45us (376us total) trans 0 rc 0/-999 00010000:00080000:2.0:1787826871.897265:0:18724:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 17179869196 00010000:00080000:2.0:1787826871.897272:0:18724:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:2.0:1787826871.897283:0:18724:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826871.897287:0:18724:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826871.897297:0:18724:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d546e070780 x1874672134187904/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826871.897313:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 131 00010000:00010000:2.0:1787826871.897320:0:18724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826871.897355:0:18724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953f7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467530 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897392:0:18724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467530 expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897434:0:18724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467530 expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897446:0:18724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3c00, rc 0) 00010000:00080000:2.0:1787826871.897522:0:18724:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1787826871.897545:0:18724:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826871.897548:0:18724:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826871.897563:0:18724:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d546e070f00 x1874672134188032/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826871.897575:0:18724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826871.897592:0:18724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34674ab expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897611:0:18724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897622:0:18724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897630:0:18724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2400, rc 0) 00010000:00080000:2.0:1787826871.897672:0:18724:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1787826871.897686:0:18724:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826871.897688:0:18724:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826871.897697:0:18724:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d546e072d00 x1874672134188160/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826871.897723:0:18724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826871.897738:0:18724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467465 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897753:0:18724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897763:0:18724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897773:0:18724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2000, rc 0) 00010000:00080000:2.0:1787826871.897812:0:18724:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1787826871.897828:0:18724:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826871.897831:0:18724:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826871.897838:0:18724:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d546e070000 x1874672134188288/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 328/0 e 0 to 0 dl 1787826882 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826871.897848:0:18724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826871.897863:0:18724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346743b expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897878:0:18724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897889:0:18724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 9 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.897910:0:18724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2800, rc 0) 00010000:00080000:2.0:1787826871.897946:0:18724:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1787826871.897958:0:18724:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1787826871.899105:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826871.899191:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188416 00000100:00100000:2.0:1787826871.899198:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188416 00000100:00100000:2.0:1787826871.899283:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 108 00000100:00100000:2.0:1787826871.899293:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2389:x1874672134188416:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1787826871.899308:0:9498:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d546f6d9680 x1874672134188416/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 224/0 e 0 to 0 dl 1787826882 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826871.899328:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2389:x1874672134188416:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 Request processed in 38us (228us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826871.899335:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 108 00010000:00080000:0.0:1787826871.899347:0:18724:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1787826871.899455:0:18724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836480 00000001:00100000:3.0:1787826871.901118:0:18709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:3.0:1787826871.901125:0:18709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787826871.901129:0:18709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787826871.901431:0:18724:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1787826871.901445:0:18724:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d546f6d8f00 x1874672143698432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:472/0 lens 224/0 e 0 to 0 dl 1787826882 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826871.901537:0:18724:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d547f9961c0 x1874672143698560/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:472/0 lens 224/0 e 0 to 0 dl 1787826882 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826871.901586:0:18724:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d546f6d9680 x1874672134188416/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:472/0 lens 224/0 e 0 to 0 dl 1787826882 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826871.901692:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00010000:02000000:1.0:1787826871.901694:0:18724:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00000100:00080000:3.0:1787826871.901703:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d546e071e00 x1874672143698560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826887 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826871.901717:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d546e071e00 x1874672143698560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826887 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826871.901724:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787826871.901737:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787826871.901740:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00002000:00080000:1.0:1787826871.905869:0:18724:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787826871.905877:0:18724:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:1.0:1787826871.906375:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143698816:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787826871.906433:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826871.906471:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826871.906487:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826871.906496:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143698688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826871.906523:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826871.906556:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698688 00000100:00100000:1.0:1787826871.906563:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698688 00000100:00100000:1.0:1787826871.906605:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787826871.906616:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143698688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826871.906635:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919278080 avail 3687755776 00000100:00100000:1.0:1787826871.906679:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143698688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826871.906687:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787826871.906733:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143698688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826871.906789:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826871.906822:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688704 00000100:00100000:1.0:1787826871.906826:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688704 00000100:00100000:1.0:1787826871.906849:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787826871.906857:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143688704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826871.906876:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919278080 avail 3687755776 00000100:00100000:1.0:1787826871.906908:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143688704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826871.906914:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787826871.906940:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143688704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826871.906973:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698816 00000100:00100000:1.0:1787826871.906977:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698816 00000100:00100000:1.0:1787826871.907003:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787826871.907011:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143698816:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1787826871.909038:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787826871.909044:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787826871.909104:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143698816:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2093us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826871.909113:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787826871.909154:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143698816:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787826871.909179:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787826871.910772:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143698560:0@lo:400:ldlm_lock_repla.0 00000100:00080000:3.0:1787826871.910801:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787826871.910810:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d546e071680 x1874672143698432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826887 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826871.910821:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d546e071680 x1874672143698432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826887 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826871.910828:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787826871.910846:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787826871.910851:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1787826871.910858:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000095485128): req@ffff8d534479e940 x1874672143688576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787826873 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826871.910874:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143698432:0@lo:400:ldlm_lock_repla.0 00000004:00080000:3.0:1787826871.910941:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 246773725304ns, next at 247773722297ns, rc = 0 00000100:00100000:3.0:1787826871.910977:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143699840:0@lo:7:osp-pre-0-0.0 00000100:00100000:1.0:1787826871.910999:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143699200:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826871.911001:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143699328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826871.911019:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826871.911047:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.911049:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826871.911066:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143698944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826871.911078:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699840 00000100:00100000:0.0:1787826871.911083:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699840 00000100:00100000:1.0:1787826871.911097:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143699712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826871.911106:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.911120:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699200 00000100:00100000:0.0:1787826871.911124:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699200 00000100:00100000:1.0:1787826871.911130:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.911137:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143699456:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826871.911149:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143698944 00000100:00100000:0.0:1787826871.911154:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143698944 00000100:00100000:3.0:1787826871.911175:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826871.911182:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699712 00000100:00100000:0.0:1787826871.911187:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699456 00000100:00100000:1.0:1787826871.911188:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699712 00000100:00100000:3.0:1787826871.911191:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143700096:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826871.911194:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699456 00000100:00100000:1.0:1787826871.911240:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787826871.911249:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787826871.911253:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:9503:x1874672143699840:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1787826871.911258:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.911264:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3618:x1874672143699200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826871.911285:0:10061:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:13 count 1 00000100:00100000:3.0:1787826871.911297:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.911313:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787826871.911318:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143699072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826871.911339:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.911359:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143699584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826871.911381:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.911399:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143700096 00000100:00100000:3.0:1787826871.911402:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143700096 00000100:00100000:3.0:1787826871.911416:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699584 00000100:00100000:3.0:1787826871.911418:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699584 00000100:00100000:0.0:1787826871.911431:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787826871.911442:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3616:x1874672143698944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826871.911455:0:9498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00000100:00100000:3.0:1787826871.911463:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143688576 00000100:00100000:3.0:1787826871.911468:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143688576 00000100:00100000:0.0:1787826871.911482:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826871.911494:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699072 00000100:00100000:3.0:1787826871.911499:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699072 00000100:00100000:0.0:1787826871.911509:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143699968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826871.911516:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787826871.911528:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3616:x1874672143688576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826871.911543:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919278080 avail 3687755776 00000100:00100000:0.0:1787826871.911554:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.911595:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:3.0:1787826871.911596:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3616:x1874672143688576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826871.911606:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:3.0:1787826871.911607:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787826871.911624:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787826871.911630:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3616:x1874672143699072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826871.911646:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919278080 avail 3687755776 00000100:00100000:3.0:1787826871.911670:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3616:x1874672143699072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826871.911677:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787826871.911696:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:0.0:1787826871.911705:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699328 00000100:00100000:0.0:1787826871.911709:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699328 00000100:00100000:0.0:1787826871.911731:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:0.0:1787826871.911738:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143699968 00000100:00100000:0.0:1787826871.911742:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143699968 00000100:00100000:3.0:1787826871.911749:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143699072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826871.911766:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143688576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826871.911854:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787826871.911861:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3618:x1874672143699712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826871.911873:0:19008:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:8 count 1 00002000:00080000:1.0:1787826871.912914:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787826871.912925:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:1.0:1787826871.912965:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:9503:x1874672143699840:12345-0@lo:7:osp-pre-0-0.0 Request processed in 1716us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826871.912970:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00002000:00010000:0.0:1787826871.912985:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 7, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00000100:00100000:1.0:1787826871.912992:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00010000:00010000:0.0:1787826871.912995:0:10061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.913004:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3616:x1874672143699456:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1787826871.913010:0:9498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:3.0:1787826871.913019:0:9498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913024:0:10061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 8 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787826871.913024:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6 count 1 00010000:00010000:3.0:1787826871.913036:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=246s v=(0 0) 00010000:00010000:0.0:1787826871.913040:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd:0x0].0x0 since=246s v=(0 0) 00010000:00010000:3.0:1787826871.913043:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826871.913046:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826871.913051:0:9498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913053:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913078:0:9498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913088:0:9498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913095:0:10061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 8 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913097:0:9498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913124:0:10061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 8 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913128:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826871.913150:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10061:1874672143700224:192.168.203.6@tcp:104: 00000100:00100000:0.0:1787826871.913256:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0bac00 going to sleep for 11 seconds 00002000:00010000:1.0:1787826871.913282:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00000100:00100000:3.0:1787826871.913289:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3616:x1874672143698944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1848us (2183us total) trans 21474836481 rc 0/0 00010000:00010000:1.0:1787826871.913291:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.913305:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00010000:1.0:1787826871.913308:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=246s v=(0 0) 00010000:00010000:1.0:1787826871.913313:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826871.913317:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.913326:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00010000:00010000:1.0:1787826871.913332:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.913337:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3616:x1874672143700096:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826871.913348:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787826871.913357:0:9498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:10 count 1 00010000:00010000:1.0:1787826871.913358:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.913377:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787826871.913427:0:19008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:3.0:1787826871.913431:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826871.913434:0:19008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913439:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.913448:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3616:x1874672143699456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 446us (2270us total) trans 21474836482 rc 0/0 00010000:00010000:0.0:1787826871.913455:0:19008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 8 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913455:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079c00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826871.913462:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.913469:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00010000:0.0:1787826871.913479:0:19008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x8:0x0].0x0 since=246s v=(0 0) 00010000:00010000:3.0:1787826871.913483:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913484:0:19008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1787826871.913492:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00010000:00010000:0.0:1787826871.913493:0:19008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.913505:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3616:x1874672143699584:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787826871.913511:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787826871.913521:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:7 count 1 00010000:00010000:3.0:1787826871.913521:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4d40e2b/0xc0fefc09a7953fa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913527:0:19008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 8 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913547:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826871.913558:0:19008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 8 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.913571:0:19008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19008:1874672143700352:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826871.913574:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826871.913629:0:19008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447088840 going to sleep for 11 seconds 00010000:00010000:3.0:1787826871.913738:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826871.913749:0:9498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:0.0:1787826871.913760:0:9498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913762:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7600 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826871.913767:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913788:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=246s v=(0 0) 00010000:00010000:3.0:1787826871.913788:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913796:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826871.913802:0:9498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913816:0:9498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913824:0:9498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913833:0:9498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.913851:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826871.913875:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:3.0:1787826871.913875:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.913886:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913889:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a7953fa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.913904:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=246s v=(0 0) 00010000:00010000:1.0:1787826871.913910:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826871.913914:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826871.913915:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913919:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.913925:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913932:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1c00 already unused, calling callback (ffffffffc0e0f420) 00000100:00100000:0.0:1787826871.913936:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3616:x1874672143700096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 600us (2679us total) trans 21474836483 rc 0/0 00010000:00010000:1.0:1787826871.913936:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.913938:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.913954:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.913955:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00010000:3.0:1787826871.913966:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.913977:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826871.913980:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00010000:00010000:3.0:1787826871.913981:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.913986:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787826871.913993:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3619:x1874672143699328:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787826871.913997:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.914004:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a7953fb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787826871.914012:0:9498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787826871.914015:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d6e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826871.914022:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.914035:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.914050:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.914052:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3616:x1874672143699584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 549us (2668us total) trans 21474836484 rc 0/0 00010000:00010000:2.0:1787826871.914072:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8218b95/0xc0fefc09a7953fbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.914077:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00010000:2.0:1787826871.914097:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826871.914100:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826871.914102:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826871.914103:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787826871.914114:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3619:x1874672143699968:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787826871.914118:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826871.914122:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826871.914124:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787826871.914130:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:9 count 1 00010000:00010000:3.0:1787826871.914133:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826871.914188:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143699840:0@lo:7:osp-pre-0-0.0 00000004:00080000:3.0:1787826871.914199:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x21:0x0] 00000004:00080000:3.0:1787826871.914261:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d546f6da1c0/2, rc 0, transno 21474836484 00000100:00100000:3.0:1787826871.914275:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143699584:0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1787826871.914276:0:9498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:0.0:1787826871.914285:0:9498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826871.914293:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d546f6d9e00/2, rc 0, transno 21474836481 00000100:00100000:3.0:1787826871.914300:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143698944:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787826871.914315:0:9498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 8 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826871.914317:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d546f6d8000/2, rc 0, transno 21474836482 00000100:00100000:3.0:1787826871.914325:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143699456:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787826871.914329:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=246s v=(0 0) 00010000:00010000:0.0:1787826871.914334:0:9498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00000004:00080000:3.0:1787826871.914338:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d545aa7c780/2, rc 0, transno 21474836483 00010000:00010000:0.0:1787826871.914339:0:9498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.914345:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143700096:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787826871.914372:0:9498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 8 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.914384:0:9498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 8 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.914396:0:9498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9498:1874672143700480:192.168.203.6@tcp:104: 00002000:00010000:1.0:1787826871.914399:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:1.0:1787826871.914405:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914411:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=246s v=(0 0) 00010000:00010000:1.0:1787826871.914413:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826871.914416:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914424:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914431:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.914437:0:9498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5476386f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787826871.914439:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914457:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826871.914547:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3619:x1874672143699968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 435us (2995us total) trans 21474836485 rc 0/0 00000100:00100000:1.0:1787826871.914555:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787826871.914570:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10061:1874672143700224:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826871.914582:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826871.914585:0:10061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914588:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914601:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7a00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826871.914604:0:10301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914611:0:10301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914623:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914629:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024f57520/0xc0fefc09a7953fcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.914644:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826871.914646:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826871.914648:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826871.914672:0:19008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19008:1874672143700352:192.168.203.6@tcp:104: 00000100:00100000:3.0:1787826871.914674:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143700736:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787826871.914687:0:19008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.914760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826871.914788:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000004:00080000:3.0:1787826871.914815:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d545aa7c000/2, rc 0, transno 21474836485 00000100:00100000:0.0:1787826871.914818:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188544 00000100:00100000:3.0:1787826871.914822:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143699968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826871.914825:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188544 00010000:00010000:0.0:1787826871.914847:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 9 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826871.914871:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:0.0:1787826871.914879:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134188544:12345-192.168.203.6@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787826871.914881:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143700736 00000100:00100000:3.0:1787826871.914887:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143700736 00010000:00010000:0.0:1787826871.914889:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826871.914895:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 9 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.914909:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 9 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.914925:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7953f86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34674ab expref: 9 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.914931:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1787826871.914940:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1787826871.914944:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f995680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3618:x1874672143700736:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787826871.914945:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826871.914954:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787826871.914962:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:12 count 1 00010000:00010000:0.0:1787826871.914963:0:7428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.914991:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826871.915018:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134188544:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 140us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826871.915025:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 56 00010000:00010000:0.0:1787826871.915045:0:10061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915053:0:10061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915061:0:10061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915069:0:10061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915089:0:10061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826871.915096:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826871.915104:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.915112:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143700608:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787826871.915114:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787826871.915121:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.915131:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826871.915144:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.915147:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826871.915166:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d8b1639/0xc0fefc09a7953f9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.915179:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:1.0:1787826871.915187:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_006' 00010000:00010000:2.0:1787826871.915189:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826871.915192:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3618:x1874672143699200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3930us (4143us total) trans 21474836486 rc 0/0 00010000:00010000:2.0:1787826871.915193:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826871.915196:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826871.915202:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787826871.915235:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826871.915246:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143700608 00000100:00100000:0.0:1787826871.915251:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143700608 00000100:00100000:0.0:1787826871.915281:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787826871.915290:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3617:x1874672143700608:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826871.915292:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188672 00000100:00100000:3.0:1787826871.915297:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188672 00002000:00080000:0.0:1787826871.915306:0:10061:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:11 count 1 00010000:00010000:3.0:1787826871.915315:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 8 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.915342:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:3.0:1787826871.915350:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134188672:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826871.915361:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826871.915367:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 8 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.915378:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 8 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.915392:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002522a5ab/0xc0fefc09a7953f8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467465 expref: 8 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.915403:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826871.915406:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826871.915411:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.915422:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.915437:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826871.915450:0:19008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.915461:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134188672:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 112us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826871.915463:0:19008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826871.915470:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 57 00010000:00010000:0.0:1787826871.915478:0:19008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915487:0:19008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915507:0:19008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787826871.915510:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d546f6da940/2, rc 0, transno 21474836486 00000100:00100000:3.0:1787826871.915514:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143699200:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826871.915517:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826871.915523:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915532:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0600 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826871.915536:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915551:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915563:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915570:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7953fb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915583:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826871.915586:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826871.915589:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826871.915596:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3618:x1874672143699712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3734us (4465us total) trans 21474836487 rc 0/0 00000100:00100000:0.0:1787826871.915603:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00002000:00010000:0.0:1787826871.915705:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:0.0:1787826871.915712:0:10061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915721:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=246s v=(0 0) 00010000:00010000:0.0:1787826871.915725:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826871.915730:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915740:0:10061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915761:0:10061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915769:0:10061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.915786:0:10061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826871.915794:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 6, mtime: 0x6a90128f, atime: 0x0, ctime: 0x6a90128f, blocks: 0x8 00010000:00010000:1.0:1787826871.915799:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915804:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=246s v=(0 0) 00010000:00010000:1.0:1787826871.915807:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826871.915811:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915820:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915828:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915841:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915857:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1787826871.915860:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3617:x1874672143700608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 572us (714us total) trans 21474836488 rc 0/0 00000100:00100000:0.0:1787826871.915869:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787826871.915916:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f995680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3618:x1874672143700736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 976us (1157us total) trans 21474836489 rc 0/0 00000100:00100000:1.0:1787826871.915921:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1787826871.915935:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826871.915938:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915943:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0400 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826871.915945:0:10301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915950:0:10301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915958:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.915960:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826871.915967:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7953fd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.915969:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915981:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826871.915982:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826871.915986:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.915990:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826871.915994:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826871.915997:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.916010:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.916018:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1dd92d0/0xc0fefc09a7953fda lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826871.916048:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826871.916051:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826871.916054:0:9498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9498:1874672143700480:192.168.203.6@tcp:104: 00000100:00100000:1.0:1787826871.916055:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00010000:3.0:1787826871.916056:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826871.916077:0:9498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826871.916083:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d547f994f00/2, rc 0, transno 21474836488 00000100:00100000:1.0:1787826871.916086:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188800 00000100:00100000:1.0:1787826871.916091:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188800 00000100:00100000:3.0:1787826871.916092:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143700608:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826871.916111:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 7 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826871.916115:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d547f9952c0/2, rc 0, transno 21474836489 00000100:00100000:3.0:1787826871.916122:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143700736:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787826871.916131:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d546f6d8b40/2, rc 0, transno 21474836487 00000100:00100000:3.0:1787826871.916135:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143699712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826871.916146:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 58 00000100:00100000:1.0:1787826871.916166:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134188800:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826871.916175:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826871.916180:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 7 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.916190:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 7 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.916204:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb03969/0xc0fefc09a7953f94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346743b expref: 7 pid: 18724 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.916236:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826871.916239:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826871.916242:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.916248:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826871.916277:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826871.916290:0:9498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.916301:0:9498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.916308:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134188800:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 153us (254us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826871.916317:0:9498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826871.916317:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 58 00010000:00010000:0.0:1787826871.916329:0:9498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.916352:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826871.916430:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3619:x1874672143699328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2441us (4949us total) trans 21474836490 rc 0/0 00000100:00100000:0.0:1787826871.916438:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00010000:0.0:1787826871.916455:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826871.916460:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.916467:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:0.0:1787826871.916471:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.916479:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.916492:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.916501:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea67c19/0xc0fefc09a7953fc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826871.916515:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826871.916517:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826871.916519:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826871.916537:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d546f6dad00/2, rc 0, transno 21474836490 00000100:00100000:0.0:1787826871.916543:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143699328:0@lo:6:osp-syn-0-0.0 00000001:02000400:2.0:1787826872.204653:0:19067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787826872.530372:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826872.570630:0:19119:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826872.570859:0:19119:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1787826872.927055:0:19169:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826872.927355:0:19169:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826873.553698:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826873.745273:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826873.745311:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826873.745328:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826873.745331:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134188928 00000100:00100000:2.0:1787826873.745340:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134188928 00000100:00100000:1.0:1787826873.745352:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189056 00000100:00100000:1.0:1787826873.745357:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189056 00000100:00100000:3.0:1787826873.745363:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826873.745382:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189184 00000100:00100000:0.0:1787826873.745388:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189184 00000100:00100000:2.0:1787826873.745396:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 424 00000100:00100000:3.0:1787826873.745402:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826873.745415:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134188928:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826873.745418:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 211 00000100:00100000:0.0:1787826873.745429:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 212 00000100:00100000:1.0:1787826873.745435:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134189056:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826873.745442:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134189184:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:3.0:1787826873.745460:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826873.745465:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826873.745473:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189440 00000100:00100000:3.0:1787826873.745476:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189440 00000100:00100000:1.0:1787826873.745487:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134189056:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 56us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826873.745487:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134188928:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826873.745489:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134189184:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826873.745503:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 211 00000100:00100000:3.0:1787826873.745503:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189312 00000100:00100000:3.0:1787826873.745507:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189312 00000100:00100000:2.0:1787826873.745509:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 424 00000100:00100000:0.0:1787826873.745510:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 212 00000100:00100000:3.0:1787826873.745533:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 109 00000100:00100000:1.0:1787826873.745544:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 144 00000100:00080000:2.0:1787826873.745549:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826873.745550:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134189312:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:2.0:1787826873.745555:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826873.745556:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134189440:12345-192.168.203.6@tcp:9:kworker.0 00000020:00000080:1.0:1787826873.745588:0:19009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795374b 00000100:00100000:3.0:1787826873.745595:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134189312:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00080000:1.0:1787826873.745600:0:19009:0:(import.c:65:import_set_state_nolock()) ffff8d5343518800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787826873.745613:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 109 00010000:00010000:2.0:1787826873.745638:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787826873.745647:0:19009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787826873.745773:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+2:2389:x1874672134189440:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 220us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826873.745781:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 144 00000001:00100000:1.0:1787826873.938237:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:1.0:1787826873.938246:0:7417:0:(genops.c:885:class_export_put()) final put ffff8d534390d000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 00000020:00000080:0.0:1787826873.938302:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534390d000/623ddf66-2f94-46d4-a38e-7bde7caf88c3 for lustre-MDT0001 00000020:00000080:0.0:1787826873.938346:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d534390d800 for lustre-MDT0001 00000100:00100000:3.0:1787826874.246020:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826874.246085:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189568 00000100:00100000:1.0:1787826874.246094:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189568 00000100:00100000:1.0:1787826874.246168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 103 00000100:00100000:1.0:1787826874.246176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:15850:x1874672134189568:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787826874.246251:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787826874.246319:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:15850:x1874672134189568:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 144us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826874.246325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 103 00000100:00100000:3.0:1787826874.247387:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826874.247435:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189696 00000100:00100000:1.0:1787826874.247442:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189696 00000100:00100000:1.0:1787826874.247476:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 104 00000100:00100000:1.0:1787826874.247484:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:15850:x1874672134189696:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787826874.247508:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826874.247560:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:15850:x1874672134189696:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826874.247566:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 104 00000100:00100000:0.0:1787826874.249082:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826874.249138:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189824 00000100:00100000:3.0:1787826874.249156:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189824 00000100:00100000:3.0:1787826874.249193:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 125 00000100:00100000:3.0:1787826874.249199:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:15850:x1874672134189824:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826874.249249:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919319040 avail 3687796736 00000100:00100000:3.0:1787826874.249301:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:15850:x1874672134189824:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826874.249306:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 125 00000100:00100000:3.0:1787826874.250343:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826874.250392:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134189952 00000100:00100000:0.0:1787826874.250397:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134189952 00000100:00100000:0.0:1787826874.250419:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 145 00000100:00100000:0.0:1787826874.250423:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134189952:12345-192.168.203.6@tcp:8:lfs.0 00010000:00080000:0.0:1787826874.250454:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:0.0:1787826874.250483:0:10061:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a7953fe1 00002000:00100000:0.0:1787826874.250494:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d5448304000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787826874.250509:0:10061:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787826874.250584:0:10061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787826874.250607:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d5448301000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826874.250644:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134189952:12345-192.168.203.6@tcp:8:lfs.0 Request processed in 219us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826874.250649:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 145 00000100:00100000:1.0:1787826874.251340:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826874.251381:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134190080 00000100:00100000:3.0:1787826874.251385:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134190080 00000100:00100000:3.0:1787826874.251417:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:3.0:1787826874.251423:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:15850:x1874672134190080:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826874.251435:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787826874.251446:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826874.251483:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:15850:x1874672134190080:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826874.251490:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:3.0:1787826874.449390:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826874.449413:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143700992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826874.449423:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143700864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826874.449484:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826874.449485:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826874.449529:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143700992 00000100:00100000:2.0:1787826874.449537:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143700992 00000100:00080000:0.0:1787826874.449571:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826874.449598:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787826874.449609:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143700992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826874.449630:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826874.449633:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143701120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826874.449660:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143700864 00000100:00100000:0.0:1787826874.449665:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143700864 00000100:00100000:2.0:1787826874.449680:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143700992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826874.449688:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826874.449692:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787826874.449703:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787826874.449713:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143701120 00000100:00100000:0.0:1787826874.449714:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143700864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826874.449718:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143701120 00000004:00000024:0.0:1787826874.449736:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00080000:1.0:1787826874.449749:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826874.449761:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787826874.449771:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143701120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826874.449783:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826874.449784:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143700864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826874.449794:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787826874.449830:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143701120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826874.449847:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:3.0:1787826874.449863:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e073480 x1874672143700992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826874.449864:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143700864:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1787826874.449885:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534479f0c0 x1874672143701120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826874.449902:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143701120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826874.449913:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143700992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787826874.577314:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826875.473395:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143701376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.473395:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143701248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826875.473442:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143701504:0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.473481:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826875.473488:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826875.473493:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826875.473526:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e070b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143701632:0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.473553:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143701760:0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.473555:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143702016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.473555:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143701888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826875.473559:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826875.473595:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e073c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143702144:0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.473603:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826875.473607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826875.473608:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826875.473633:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143702272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.473636:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143702400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.473643:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143702528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826875.473643:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826875.473674:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143702656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.473682:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826875.473687:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826875.473706:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143701248 00000100:00100000:1.0:1787826875.473713:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143701248 00000100:00100000:2.0:1787826875.473719:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826875.473723:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143702784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.473739:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702016 00000100:00100000:0.0:1787826875.473743:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702016 00000100:00100000:1.0:1787826875.473747:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143701632 00000100:00100000:1.0:1787826875.473750:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143701632 00000100:00100000:3.0:1787826875.473758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826875.473765:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143701888 00000100:00100000:1.0:1787826875.473769:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143701888 00000100:00100000:0.0:1787826875.473781:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702144 00000100:00100000:0.0:1787826875.473784:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702144 00000100:00100000:1.0:1787826875.473788:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787826875.473797:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787826875.473799:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143701248:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826875.473803:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 3 min 2 max 116 00000100:00100000:0.0:1787826875.473807:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702528 00000100:00100000:3.0:1787826875.473811:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_003' 00000100:00100000:0.0:1787826875.473812:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702528 00000100:00100000:2.0:1787826875.473813:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143701632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.473829:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143701504 00000004:00000024:1.0:1787826875.473833:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826875.473833:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143701504 00000100:00100000:0.0:1787826875.473855:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702656 00000100:00100000:0.0:1787826875.473858:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702656 00000100:00100000:3.0:1787826875.473866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143701760 00000100:00100000:3.0:1787826875.473871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143701760 00000100:00100000:2.0:1787826875.473880:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143701632:12345-0@lo:400:kworker.0 Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826875.473886:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787826875.473888:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143701248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826875.473889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702272 00000100:00100000:3.0:1787826875.473893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702272 00000100:00100000:2.0:1787826875.473898:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787826875.473899:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143702016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.473904:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787826875.473913:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702784 00000100:00100000:3.0:1787826875.473917:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702784 00000100:00100000:3.0:1787826875.473936:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787826875.473938:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787826875.473942:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143701504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.473954:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143702016:12345-0@lo:400:kworker.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826875.473956:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143701888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.473963:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143701376 00000100:00100000:1.0:1787826875.473967:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143701376 00000100:00100000:0.0:1787826875.473969:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787826875.473979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143701504:12345-0@lo:400:kworker.0 Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826875.473986:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787826875.473990:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787826875.473999:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143702144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474002:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1787826875.474009:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143701376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.474013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787826875.474015:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143701888:12345-0@lo:400:kworker.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826875.474025:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787826875.474029:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143701760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.474041:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143702144:12345-0@lo:400:kworker.0 Request processed in 41us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826875.474044:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143701376:12345-0@lo:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826875.474048:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787826875.474050:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1787826875.474064:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787826875.474071:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3616:x1874672143702528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826875.474074:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e070b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143701632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474086:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787826875.474091:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143701760:12345-0@lo:400:kworker.0 Request processed in 64us (484us total) trans 0 rc 0/0 00010000:00080000:2.0:1787826875.474097:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e073c00 x1874672143702144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826875.474100:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143702272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.474107:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787826875.474110:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3616:x1874672143702528:12345-0@lo:400:kworker.0 Request processed in 38us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826875.474120:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e073c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143702144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.474124:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787826875.474147:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787826875.474155:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143702272:12345-0@lo:400:kworker.0 Request processed in 58us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826875.474161:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787826875.474162:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143702784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474166:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787826875.474173:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143702656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826875.474184:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826875.474235:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143702912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474239:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702400 00000100:00100000:1.0:1787826875.474246:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702400 00000100:00100000:3.0:1787826875.474246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143702784:12345-0@lo:400:kworker.0 Request processed in 61us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826875.474247:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143702656:12345-0@lo:400:kworker.0 Request processed in 78us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826875.474264:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787826875.474265:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787826875.474272:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826875.474279:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143702912 00000100:00100000:1.0:1787826875.474283:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143702912 00000100:00100000:3.0:1787826875.474293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787826875.474303:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143701376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.474305:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143702400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474312:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787826875.474314:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143702016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474321:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143702912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.474328:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143702528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826875.474337:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143701888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.474347:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143701504:0@lo:400:kworker.0 00000100:00100000:3.0:1787826875.474354:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143702400:12345-0@lo:400:kworker.0 Request processed in 51us (167us total) trans 0 rc 0/0 00010000:00080000:2.0:1787826875.474361:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0fcf00 x1874672143702400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826875.474366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787826875.474368:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143702912:12345-0@lo:400:kworker.0 Request processed in 47us (98us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826875.474384:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0fc3c0 x1874672143702656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826875.474384:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787826875.474387:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143702400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826875.474401:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143702656:0@lo:400:kworker.0 00000100:00080000:1.0:1787826875.474408:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787826875.474411:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0fd680 x1874672143702912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826875.474413:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826875.474418:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826875.474427:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143702912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474457:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143701760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474474:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143702272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474488:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143702784:0@lo:400:kworker.0 00000100:00100000:1.0:1787826875.474501:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143701248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826875.601389:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826876.164073:0:19362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:0.0:1787826876.625337:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826876.739992:0:19410:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1787826877.009379:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826877.009398:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143703040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826877.009476:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826877.009514:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703040 00000100:00100000:1.0:1787826877.009523:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703040 00000100:00100000:0.0:1787826877.009532:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143703168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826877.009573:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1787826877.009573:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826877.009581:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826877.009589:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143703040:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826877.009600:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703168 00000100:00100000:3.0:1787826877.009606:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703168 00002000:00000024:1.0:1787826877.009624:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919319040 avail 3687796736 00000100:00080000:2.0:1787826877.009632:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826877.009670:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787826877.009682:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3617:x1874672143703168:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826877.009684:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143703040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (203us total) trans 0 rc 0/0 00002000:00000024:3.0:1787826877.009693:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919319040 avail 3687796736 00000100:00100000:1.0:1787826877.009695:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787826877.009728:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143703040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826877.009734:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3617:x1874672143703168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826877.009743:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787826877.009749:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143703168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787826877.649389:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826878.035239:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:2.0:1787826878.035914:0:18709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836490 is committed 00000100:00100000:1.0:1787826878.056793:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.056855:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134190208 00000100:00100000:3.0:1787826878.056864:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134190208 00000100:00080000:2.0:1787826878.056929:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826878.056932:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:3.0:1787826878.056942:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:16317:x1874672134190208:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787826878.056994:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826878.057062:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:16317:x1874672134190208:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 121us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826878.057070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:0.0:1787826878.058303:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826878.058356:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134190336 00000100:00100000:1.0:1787826878.058361:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134190336 00000100:00100000:1.0:1787826878.058397:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 106 00000100:00100000:1.0:1787826878.058404:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:16317:x1874672134190336:12345-192.168.203.6@tcp:41:lfs.0 00000100:00080000:2.0:1787826878.058418:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:1.0:1787826878.058427:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826878.058480:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:16317:x1874672134190336:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826878.058487:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 106 00000100:00100000:1.0:1787826878.060461:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826878.060545:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134190464 00000100:00100000:2.0:1787826878.060553:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134190464 00000100:00100000:2.0:1787826878.060646:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 131 00000100:00100000:2.0:1787826878.060656:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:16317:x1874672134190464:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826878.060677:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 1353152 pending 0 free 3919319040 avail 3687796736 00000100:00100000:2.0:1787826878.060735:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:16317:x1874672134190464:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826878.060743:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 131 00000100:00080000:1.0:1787826878.060852:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826878.061597:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.061673:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134190592 00000100:00100000:3.0:1787826878.061678:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134190592 00000100:00100000:3.0:1787826878.061728:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 132 00000100:00080000:1.0:1787826878.061729:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826878.061738:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:16317:x1874672134190592:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826878.061757:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826878.061793:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:16317:x1874672134190592:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826878.061800:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 132 00000100:00100000:0.0:1787826878.074134:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826878.074192:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134190848 00000100:00100000:2.0:1787826878.074242:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134190848 00000100:00100000:2.0:1787826878.074300:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 107 00000100:00100000:2.0:1787826878.074311:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:16334:x1874672134190848:12345-192.168.203.6@tcp:101:cmp.0 00010000:00010000:2.0:1787826878.074331:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826878.074353:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953fe8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346753e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826878.074464:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953fef lrc: 3/1,0 mode: --/PR res: [0x200000403:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826878.074478:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953fef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826878.074489:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953fef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826878.074500:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xd:0x0]: returning size 5242880 00010000:00010000:2.0:1787826878.074652:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a7953fe8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346753e expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826878.074682:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953fef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346753e expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826878.074698:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd:0x0].0x0 (ffff8d5450fb5b00) 00010000:00010000:2.0:1787826878.074702:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826878.074706:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3800, rc 0) 00000100:00100000:2.0:1787826878.074779:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:16334:x1874672134190848:12345-192.168.203.6@tcp:101:cmp.0 Request processed in 470us (651us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787826878.074788:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 107 00000100:00100000:1.0:1787826878.077029:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.077076:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134190976 00000100:00100000:3.0:1787826878.077082:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134190976 00000100:00100000:3.0:1787826878.077132:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:3.0:1787826878.077139:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134190976:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826878.077150:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826878.077170:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3800/0xc0fefc09a7953fef lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346753e expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.077186:0:13703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd:0x0].0x0 (ffff8d5450fb5b00) 00010000:00010000:3.0:1787826878.077190:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826878.077253:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2390:x1874672134190976:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 114us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826878.077261:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1787826878.093332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826878.093400:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134191232 00000100:00100000:1.0:1787826878.093409:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134191232 00000100:00100000:1.0:1787826878.093468:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:1.0:1787826878.093477:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:16334:x1874672134191232:12345-192.168.203.6@tcp:35:cmp.0 00000100:00100000:1.0:1787826878.093706:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:16334:x1874672134191232:12345-192.168.203.6@tcp:35:cmp.0 Request processed in 229us (380us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787826878.093715:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:0.0:1787826878.104472:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.104542:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134191488 00000100:00100000:3.0:1787826878.104564:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134191488 00000100:00100000:3.0:1787826878.104624:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 108 00000100:00100000:3.0:1787826878.104635:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:16339:x1874672134191488:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787826878.104693:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826878.104718:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7953ebb lrc: 0/0,0 mode: --/PR res: [0x200000403:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467529 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104738:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd:0x0].0x0 (ffff8d5450fb5b00) 00010000:00010000:3.0:1787826878.104749:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826878.104771:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104785:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104796:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104810:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104818:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104825:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104900:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 3/0,1 mode: --/EX res: [0x200000403:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104908:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.104921:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826878.105135:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:3.0:1787826878.105145:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 252967929766ns, next at 253967927456ns, rc = 0 00010000:00010000:3.0:1787826878.105185:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105194:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105201:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105208:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105269:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105276:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105304:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826878.105321:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105328:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105334:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105346:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826878.105350:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105358:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105367:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd:0x0].0x0 (ffff8d54745a9e00) 00010000:00010000:3.0:1787826878.105370:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826878.105373:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 2/0,0 mode: --/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105378:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a795400b lrc: 0/0,0 mode: --/EX res: [0x200000403:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105395:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105401:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105407:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105412:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826878.105414:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105420:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105438:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826878.105440:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826878.105443:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105448:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7953ffd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826878.105456:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0183549 reply state 00000000cdc5e466 transno 4294967372 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105466:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826878.105472:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x733c6acc (ffff8d54745a9400) 00010000:00010000:3.0:1787826878.105474:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826878.105476:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826878.105544:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:16339:x1874672134191488:12345-192.168.203.6@tcp:36:rm.0 Request processed in 910us (1080us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787826878.105553:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 108 00010000:00010000:0.0:1787826878.105615:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826878.105622:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826878.105629:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079000 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:0.0:1787826878.105633:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826878.105641:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826878.105651:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xd:0x0].0x0 (ffff8d54745a9e00) 00010000:00010000:0.0:1787826878.105654:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826878.105657:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826878.105673:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079000/0xc0fefc09a7954012 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826878.105687:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826878.105688:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826878.105689:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826878.673609:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826878.864975:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.865010:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.865031:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.865055:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826878.865060:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134191616 00000100:00100000:1.0:1787826878.865076:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134191616 00000100:00100000:3.0:1787826878.865077:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826878.865105:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134191872 00000100:00100000:3.0:1787826878.865125:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134191872 00000100:00100000:3.0:1787826878.865175:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134191744 00000100:00100000:1.0:1787826878.865181:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 426 00000100:00100000:3.0:1787826878.865189:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134191744 00000100:00100000:1.0:1787826878.865198:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134191616:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826878.865275:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 219 00000100:00100000:3.0:1787826878.865289:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134191872:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826878.865342:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134191616:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 146us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826878.865366:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134191872:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 79us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826878.865367:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 426 00000100:00100000:3.0:1787826878.865380:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 219 00000100:00100000:3.0:1787826878.865418:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 220 00000100:00100000:3.0:1787826878.865431:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134191744:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826878.865444:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134192128 00000100:00100000:1.0:1787826878.865452:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134192000 00000100:00100000:2.0:1787826878.865453:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134192128 00000100:00100000:1.0:1787826878.865459:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134192000 00000100:00100000:3.0:1787826878.865484:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134191744:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 52us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826878.865494:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 220 00000100:00100000:2.0:1787826878.865516:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 114 00000100:00100000:2.0:1787826878.865528:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134192128:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826878.865532:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00100000:1.0:1787826878.865553:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134192000:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826878.865583:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134192128:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 57us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826878.865593:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 114 00000100:00100000:1.0:1787826878.865606:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134192000:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 58us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826878.865617:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 115 00000001:00100000:1.0:1787826879.058282:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:1.0:1787826879.058294:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:1.0:1787826879.058298:0:9469:0:(genops.c:885:class_export_put()) final put ffff8d534351b000/2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:3.0:1787826879.058349:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534351b000/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0001 00000020:00000080:3.0:1787826879.058394:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343518800 for lustre-OST0001 00000100:00100000:0.0:1787826879.569338:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826879.569361:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143703296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826879.569428:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826879.569481:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703296 00000100:00100000:3.0:1787826879.569488:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703296 00000100:00100000:3.0:1787826879.569549:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787826879.569566:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143703296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826879.569593:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826879.569637:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143703424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826879.569657:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143703296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826879.569665:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787826879.569676:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826879.569706:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1787826879.569709:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826879.569715:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143703552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826879.569721:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703424 00000100:00100000:3.0:1787826879.569725:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703424 00000100:00100000:2.0:1787826879.569745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826879.569764:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787826879.569771:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143703424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826879.569792:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826879.569799:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703552 00000100:00100000:2.0:1787826879.569804:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703552 00000100:00100000:2.0:1787826879.569840:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787826879.569844:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143703424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826879.569852:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787826879.569859:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143703552:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787826879.569870:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:2.0:1787826879.569883:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00010000:00080000:3.0:1787826879.569896:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546f6a1e00 x1874672143703296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826879.569919:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143703552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826879.569927:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787826879.569931:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143703296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826879.570039:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143703552:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787826879.570052:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0fd2c0 x1874672143703424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826879.570063:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143703424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826879.698307:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826880.326600:0:19605:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 4: Fail OST during read, with verification ========================================================== 06:34:39 (1787826879) 00000100:00100000:1.0:1787826880.345528:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826880.345578:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134192384 00000100:00100000:3.0:1787826880.345588:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134192384 00000100:00080000:0.0:1787826880.345649:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826880.345680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 109 00000100:00100000:3.0:1787826880.345694:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:16916:x1874672134192384:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:3.0:1787826880.345712:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826880.345733:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a7954019 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467545 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.345831:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.345853:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.345875:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.345898:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.345907:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.345914:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826880.346240:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xf:0x0], index 0: 0 00010000:00010000:3.0:1787826880.346364:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795402e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346371:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795402e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346376:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795402e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346399:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346406:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346412:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346418:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826880.346429:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346438:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346450:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787826880.346452:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826880.346455:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346459:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a7954020 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826880.346468:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4250c1d reply state 00000000d61150d0 transno 4294967373 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346523:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346529:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee27d887 (ffff8d54745a9f00) 00010000:00010000:3.0:1787826880.346530:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826880.346532:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826880.346558:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a7954019 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467545 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346575:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795402e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467545 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.346584:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff8d54745a9c00) 00010000:00010000:3.0:1787826880.346587:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826880.346595:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e078c00, rc 0) 00000100:00100000:3.0:1787826880.346653:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:16916:x1874672134192384:12345-192.168.203.6@tcp:101:bash.0 Request processed in 962us (1132us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787826880.346662:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 109 00000100:00100000:0.0:1787826880.351482:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826880.351533:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134192512 00000100:00100000:1.0:1787826880.351544:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134192512 00000100:00080000:0.0:1787826880.351576:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826880.351599:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 146 00000100:00100000:1.0:1787826880.351610:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:16916:x1874672134192512:12345-192.168.203.6@tcp:101:tee.0 00010000:00010000:1.0:1787826880.351626:0:10061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826880.351643:0:10061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a795403c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346754c expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826880.352039:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826880.352061:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=255s v=(0 0) 00010000:00010000:1.0:1787826880.352065:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826880.352075:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a795403c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346754c expref: 7 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826880.352120:0:10061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a795403c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346754c expref: 7 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826880.352135:0:10061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547d2d7600, rc 0) 00000100:00100000:1.0:1787826880.352186:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+7:16916:x1874672134192512:12345-192.168.203.6@tcp:101:tee.0 Request processed in 578us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826880.352191:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 146 00000100:00100000:1.0:1787826880.354533:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826880.354637:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134192640 00000100:00100000:2.0:1787826880.354646:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134192640 00002000:00100000:2.0:1787826880.354696:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xf:0x0] (0->4095) req@ffff8d547d13a1c0 x1874672134192640/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 4584/0 e 0 to 0 dl 1787826891 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826880.354707:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d13a1c0 with x1874672134192640 ext(0->4095) 00002000:00010000:2.0:1787826880.354712:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d13a1c0 00000100:00100000:2.0:1787826880.354760:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:2.0:1787826880.354772:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134192640:12345-192.168.203.6@tcp:4:tee.0 00000100:00100000:2.0:1787826880.355447:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134192640:12345-192.168.203.6@tcp:4:tee.0 Request processed in 679us (919us total) trans 21474836491 rc 0/0 00000100:00100000:2.0:1787826880.355453:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 15 00002000:00100000:2.0:1787826880.355459:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xf:0x0] (0->4095) req@ffff8d547d13a1c0 x1874672134192640/t21474836491(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 4584/448 e 0 to 0 dl 1787826891 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826880.355465:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d13a1c0 with x1874672134192640 ext(0->4095) 00002000:00010000:2.0:1787826880.355467:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d13a1c0 00000100:00100000:0.0:1787826880.571577:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826880.571642:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134192896 00000100:00100000:3.0:1787826880.571651:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134192896 00000100:00100000:3.0:1787826880.571705:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 34 00000100:00100000:3.0:1787826880.571716:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545046a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:16916:x1874672134192896:12345-192.168.203.6@tcp:35:tee.0 00000100:00100000:3.0:1787826880.572000:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545046a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+15:16916:x1874672134192896:12345-192.168.203.6@tcp:35:tee.0 Request processed in 282us (427us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787826880.572009:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 34 00000100:00100000:0.0:1787826880.582769:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826880.582829:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134193024 00000100:00100000:1.0:1787826880.582837:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134193024 00002000:00100000:1.0:1787826880.582876:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xf:0x0] (4096->4194303) req@ffff8d546f6a21c0 x1874672134193024/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/0 e 0 to 0 dl 1787826891 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826880.582884:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a21c0 with x1874672134193024 ext(4096->4194303) 00002000:00010000:1.0:1787826880.582889:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a21c0 00000100:00100000:1.0:1787826880.582921:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:1.0:1787826880.582931:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2390:x1874672134193024:12345-192.168.203.6@tcp:4:tee.0 00000100:00100000:0.0:1787826880.583119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826880.583194:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134193152 00000100:00100000:3.0:1787826880.583200:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134193152 00002000:00100000:3.0:1787826880.583254:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xf:0x0] (4194304->5242879) req@ffff8d546f6a12c0 x1874672134193152/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/0 e 0 to 0 dl 1787826891 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826880.583264:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a12c0 with x1874672134193152 ext(4194304->5242879) 00002000:00010000:3.0:1787826880.583268:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a12c0 00000100:00100000:3.0:1787826880.583292:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:3.0:1787826880.583301:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134193152:12345-192.168.203.6@tcp:4:tee.0 00000100:00100000:0.0:1787826880.593368:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143703680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.593369:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143703808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.593428:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826880.593441:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826880.593466:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143703936:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.593500:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143704320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.593505:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143704192:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.593513:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826880.593539:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143704448:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.593548:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826880.593549:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826880.593577:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143704064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.593578:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143704704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.593609:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826880.593625:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703680 00000100:00100000:0.0:1787826880.593632:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703680 00000100:00100000:2.0:1787826880.593654:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143704576:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.593663:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143704832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.593683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826880.593688:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1787826880.593703:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143703680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.593704:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826880.593708:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143705088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.593740:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703808 00000100:00100000:2.0:1787826880.593744:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826880.593752:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703808 00000100:00100000:0.0:1787826880.593777:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143703680:12345-0@lo:400:kworker.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826880.593784:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143703936 00000100:00100000:2.0:1787826880.593790:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143703936 00000100:00100000:1.0:1787826880.593796:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704064 00000100:00100000:0.0:1787826880.593797:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1787826880.593801:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704064 00000100:00100000:1.0:1787826880.593823:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704576 00000100:00100000:1.0:1787826880.593825:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704576 00000100:00100000:2.0:1787826880.593828:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704192 00000100:00100000:2.0:1787826880.593832:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704192 00000100:00100000:0.0:1787826880.593843:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704320 00000100:00100000:0.0:1787826880.593849:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704320 00000100:00100000:1.0:1787826880.593858:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705088 00000100:00100000:1.0:1787826880.593862:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705088 00000100:00100000:3.0:1787826880.593880:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787826880.593887:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704832 00000100:00100000:2.0:1787826880.593888:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787826880.593893:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704832 00000100:00100000:1.0:1787826880.593894:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787826880.593895:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e071e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143703936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.593904:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.593919:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143703808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.593920:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787826880.593930:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143704320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.593978:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143704192:12345-0@lo:400:kworker.0 Request processed in 77us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826880.593987:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787826880.593990:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d139e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143703808:12345-0@lo:400:kworker.0 Request processed in 76us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826880.593999:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143704320:12345-0@lo:400:kworker.0 Request processed in 68us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826880.594001:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e071e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143703936:12345-0@lo:400:kworker.0 Request processed in 111us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826880.594007:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787826880.594015:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787826880.594018:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787826880.594019:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787826880.594033:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143704064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.594037:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787826880.594045:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787826880.594052:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787826880.594053:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e073c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143704576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.594058:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143704832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826880.594074:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143705088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.594080:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143704064:12345-0@lo:400:kworker.0 Request processed in 49us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826880.594089:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787826880.594125:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e073c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143704576:12345-0@lo:400:kworker.0 Request processed in 78us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826880.594130:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143704832:12345-0@lo:400:kworker.0 Request processed in 77us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826880.594138:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787826880.594139:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787826880.594145:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143705088:12345-0@lo:400:kworker.0 Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826880.594151:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787826880.594161:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826880.594173:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826880.594178:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704448 00000100:00080000:0.0:1787826880.594179:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826880.594182:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704448 00000100:00100000:2.0:1787826880.594193:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143704960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.594196:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143704320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.594210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826880.594240:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787826880.594251:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143705216:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.594252:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836490 gen 2 00000100:00100000:3.0:1787826880.594255:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143704448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.594258:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787826880.594262:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d546f6d9e00, transno 21474836481 00000004:00080000:1.0:1787826880.594285:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d546f6d8000, transno 21474836482 00000100:00100000:0.0:1787826880.594289:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787826880.594294:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d545aa7c780, transno 21474836483 00000004:00080000:1.0:1787826880.594300:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d546f6da1c0, transno 21474836484 00000100:00100000:2.0:1787826880.594303:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143703936:0@lo:400:kworker.0 00000004:00080000:1.0:1787826880.594307:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d545aa7c000, transno 21474836485 00000100:00100000:3.0:1787826880.594312:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143704448:12345-0@lo:400:kworker.0 Request processed in 62us (160us total) trans 0 rc 0/0 00000004:00080000:1.0:1787826880.594315:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d546f6da940, transno 21474836486 00000004:00080000:1.0:1787826880.594322:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d546f6d8b40, transno 21474836487 00000100:00100000:0.0:1787826880.594324:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143703680:0@lo:400:kworker.0 00010000:00080000:2.0:1787826880.594326:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0fd680 x1874672143704448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826880.594327:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000004:00080000:1.0:1787826880.594331:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d547f994f00, transno 21474836488 00000004:00080000:1.0:1787826880.594339:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d547f9952c0, transno 21474836489 00000100:00100000:2.0:1787826880.594344:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143704448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826880.594348:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704960 00000100:00100000:0.0:1787826880.594351:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143704192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826880.594353:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704960 00000004:00080000:1.0:1787826880.594354:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d546f6dad00, transno 21474836490 00000100:00100000:1.0:1787826880.594366:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143704832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826880.594389:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143703808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.594394:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787826880.594400:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826880.594407:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143704960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.594409:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143705344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826880.594422:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143704704 00000100:00100000:3.0:1787826880.594426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143704704 00000100:00100000:0.0:1787826880.594437:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826880.594460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705216 00000100:00100000:3.0:1787826880.594463:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705216 00000100:00100000:2.0:1787826880.594470:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143704960:12345-0@lo:400:kworker.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826880.594476:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705344 00000100:00100000:2.0:1787826880.594479:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787826880.594482:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705344 00000100:00100000:3.0:1787826880.594483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787826880.594493:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143704704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.594518:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787826880.594529:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143705344:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826880.594531:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143704704:12345-0@lo:400:kworker.0 Request processed in 39us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826880.594539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787826880.594557:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000004:00000024:0.0:1787826880.594559:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826880.594564:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143705216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826880.594600:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143705344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826880.594607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143705216:12345-0@lo:400:kworker.0 Request processed in 44us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826880.594609:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787826880.594620:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000004:00080000:2.0:1787826880.594636:0:9502:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:0.0:1787826880.594654:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143705344:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787826880.594656:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787826880.594670:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0fc3c0 x1874672143704704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826880.594678:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143704704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.594690:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143704064:0@lo:400:kworker.0 00010000:00080000:0.0:1787826880.594695:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e071a40 x1874672143705216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826880.594705:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143705216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.594707:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143704576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.594733:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143705088:0@lo:400:kworker.0 00010000:00080000:2.0:1787826880.594772:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0703c0 x1874672143704960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826880.594782:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143704960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826880.597463:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+13:2390:x1874672134193152:12345-192.168.203.6@tcp:4:tee.0 Request processed in 14155us (14336us total) trans 21474836492 rc 0/0 00000100:00100000:2.0:1787826880.597474:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 17 00002000:00100000:2.0:1787826880.597486:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xf:0x0] (4194304->5242879) req@ffff8d546f6a12c0 x1874672134193152/t21474836492(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/448 e 0 to 0 dl 1787826891 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826880.597496:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a12c0 with x1874672134193152 ext(4194304->5242879) 00002000:00010000:2.0:1787826880.597508:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a12c0 00000100:00100000:2.0:1787826880.610325:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+13:2390:x1874672134193024:12345-192.168.203.6@tcp:4:tee.0 Request processed in 27383us (27552us total) trans 21474836493 rc 0/0 00000100:00100000:2.0:1787826880.610339:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 16 00002000:00100000:2.0:1787826880.610352:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xf:0x0] (4096->4194303) req@ffff8d546f6a21c0 x1874672134193024/t21474836493(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/448 e 0 to 0 dl 1787826891 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826880.610363:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a21c0 with x1874672134193024 ext(4096->4194303) 00002000:00010000:2.0:1787826880.610368:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a21c0 00000100:00100000:0.0:1787826880.614824:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826880.614881:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134193280 00000100:00100000:3.0:1787826880.614890:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134193280 00000100:00100000:3.0:1787826880.614959:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:3.0:1787826880.614970:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+13:10864:x1874672134193280:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826880.614985:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:3.0:1787826880.615002:0:6472:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xf:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:3.0:1787826880.615005:0:6472:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xf:0x0] updating lvb mtime from disk: 0 -> 1787826880 00002000:00010000:3.0:1787826880.615008:0:6472:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xf:0x0] updating lvb ctime from disk: 0 -> 1787826880 00002000:00010000:3.0:1787826880.615010:0:6472:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xf:0x0] updating lvb blocks from disk: 0 -> 10240 00010000:00010000:3.0:1787826880.615033:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a59eeca3/0xc0fefc09a795403c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346754c expref: 13 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826880.615460:0:6472:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 4194304, mtime: 0x6a9012a8, atime: 0x0, ctime: 0x6a9012a8, blocks: 0x2000 00010000:00010000:3.0:1787826880.615482:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bfc7bc8/0xc0fefc09a7953f7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467530 expref: 12 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.615498:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826880.615554:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:10864:x1874672134193280:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 586us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826880.615563:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:1.0:1787826880.630588:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826880.630637:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134193536 00000100:00100000:3.0:1787826880.630646:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134193536 00000100:00100000:3.0:1787826880.630704:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 110 00000100:00100000:3.0:1787826880.630715:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+15:16927:x1874672134193536:12345-192.168.203.6@tcp:101:cmp.0 00010000:00010000:3.0:1787826880.630739:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826880.630771:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a7954043 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467553 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.630872:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795404a lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.630886:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795404a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.630897:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795404a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826880.630907:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xe:0x0]: returning size 5242880 00010000:00010000:3.0:1787826880.631013:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078800/0xc0fefc09a7954043 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467553 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.631033:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795404a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467553 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826880.631043:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff8d54745a9c00) 00010000:00010000:3.0:1787826880.631046:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787826880.631048:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e079800, rc 0) 00000100:00100000:3.0:1787826880.631112:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+17:16927:x1874672134193536:12345-192.168.203.6@tcp:101:cmp.0 Request processed in 399us (547us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787826880.631119:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 110 00000100:00100000:1.0:1787826880.633021:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826880.633083:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134193664 00000100:00100000:0.0:1787826880.633090:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134193664 00000100:00100000:0.0:1787826880.633148:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:0.0:1787826880.633156:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2390:x1874672134193664:12345-192.168.203.6@tcp:101:cmp.0 00010000:00010000:0.0:1787826880.633169:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826880.633185:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fa8969e/0xc0fefc09a7954058 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346755a expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826880.633207:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 5242880, mtime: 0x6a9012c0, atime: 0x0, ctime: 0x6a9012c0, blocks: 0x2800 00010000:00010000:0.0:1787826880.633259:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=255s v=(0 0) 00010000:00010000:0.0:1787826880.633264:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826880.633273:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fa8969e/0xc0fefc09a7954058 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346755a expref: 12 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826880.633290:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008fa8969e/0xc0fefc09a7954058 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346755a expref: 12 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826880.633301:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0800, rc 0) 00000100:00100000:0.0:1787826880.633347:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134193664:12345-192.168.203.6@tcp:101:cmp.0 Request processed in 192us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826880.633353:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:0.0:1787826880.651391:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826880.651482:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134193792 00000100:00100000:3.0:1787826880.651492:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134193792 00002000:00100000:3.0:1787826880.651540:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xf:0x0] (0->4194303) req@ffff8d546f6a2d00 x1874672134193792/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/0 e 0 to 0 dl 1787826891 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826880.651556:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a2d00 with x1874672134193792 ext(0->4194303) 00002000:00010000:3.0:1787826880.651574:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a2d00 00000100:00100000:3.0:1787826880.651612:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:3.0:1787826880.651622:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134193792:12345-192.168.203.6@tcp:3:cmp.0 00000100:00100000:3.0:1787826880.667146:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134193792:12345-192.168.203.6@tcp:3:cmp.0 Request processed in 15517us (15755us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1787826880.667158:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00002000:00100000:3.0:1787826880.667168:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xf:0x0] (0->4194303) req@ffff8d546f6a2d00 x1874672134193792/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/440 e 0 to 0 dl 1787826891 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826880.667175:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a2d00 with x1874672134193792 ext(0->4194303) 00002000:00010000:3.0:1787826880.667180:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a2d00 00000100:00100000:0.0:1787826880.686860:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826880.686914:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134193920 00000100:00100000:2.0:1787826880.686924:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134193920 00002000:00100000:2.0:1787826880.686982:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xf:0x0] (4194304->5242879) req@ffff8d546f6a0f00 x1874672134193920/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/0 e 0 to 0 dl 1787826891 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826880.686994:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0f00 with x1874672134193920 ext(4194304->5242879) 00002000:00010000:2.0:1787826880.687010:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0f00 00000100:00100000:2.0:1787826880.687045:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:2.0:1787826880.687062:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134193920:12345-192.168.203.6@tcp:3:cmp.0 00000100:00100000:3.0:1787826880.691772:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134193920:12345-192.168.203.6@tcp:3:cmp.0 Request processed in 4709us (4913us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826880.691785:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00002000:00100000:3.0:1787826880.691798:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xf:0x0] (4194304->5242879) req@ffff8d546f6a0f00 x1874672134193920/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/440 e 0 to 0 dl 1787826891 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826880.691810:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0f00 with x1874672134193920 ext(4194304->5242879) 00002000:00010000:3.0:1787826880.691816:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0f00 00000100:00100000:0.0:1787826880.695018:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826880.695132:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194048 00000100:00100000:2.0:1787826880.695142:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194048 00002000:00100000:2.0:1787826880.695201:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xf:0x0] (5242880->5246975) req@ffff8d546f6a0780 x1874672134194048/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/0 e 0 to 0 dl 1787826891 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826880.695248:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0780 with x1874672134194048 ext(5242880->5246975) 00002000:00010000:2.0:1787826880.695255:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0780 00000100:00100000:2.0:1787826880.695284:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:2.0:1787826880.695295:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134194048:12345-192.168.203.6@tcp:3:cmp.0 00000100:00100000:2.0:1787826880.695476:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134194048:12345-192.168.203.6@tcp:3:cmp.0 Request processed in 182us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826880.695484:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00002000:00100000:2.0:1787826880.695490:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xf:0x0] (5242880->5246975) req@ffff8d546f6a0780 x1874672134194048/t0(0) o3->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:481/0 lens 488/440 e 0 to 0 dl 1787826891 ref 1 fl Complete:/600/0 rc 0/0 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826880.695498:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0780 with x1874672134194048 ext(5242880->5246975) 00002000:00010000:2.0:1787826880.695502:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0780 00010000:00010000:2.0:1787826880.722388:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787826881.281322:0:19702:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787826881.281374:0:19702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826881.281396:0:19702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826881.281403:0:19702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826881.281420:0:19702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826881.281447:0:19702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787826881.281452:0:19702:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787826881.281469:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826881.281477:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826881.281481:0:19702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826881.281487:0:19702:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787826881.281489:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547d2d7400 already unused, calling callback (ffffffffc13fec20) 00000100:00080000:3.0:1787826881.281492:0:19702:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1787826881.281494:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.281505:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826881.281512:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826881.281516:0:19702:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:0.0:1787826881.281530:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826881.281533:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787826881.281536:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787826881.281574:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826881.281578:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143705472:0@lo:39:umount.0 00010000:00010000:0.0:1787826881.281584:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826881.281611:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.281619:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547d2d7400/0xc0fefc09a7953f1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953f24 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826881.281630:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1787826881.281639:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826881.281644:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826881.281646:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826881.281646:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143705600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826881.281648:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826881.281689:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826881.281698:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705472 00000100:00100000:1.0:1787826881.281706:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705472 00000100:00100000:2.0:1787826881.281710:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705600 00000100:00100000:2.0:1787826881.281716:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705600 00000100:00100000:2.0:1787826881.281761:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826881.281766:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787826881.281771:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143705600:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826881.281779:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143705472:12345-0@lo:39:umount.0 00010000:00010000:2.0:1787826881.281791:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1787826881.281803:0:6486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953f39 00010000:00010000:2.0:1787826881.281808:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1400/0xc0fefc09a7953f24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953f1d expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826881.281813:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d5343bec000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787826881.281826:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826881.281846:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826881.281874:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143705600:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826881.281883:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826881.281892:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143705600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826881.281900:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143705472:12345-0@lo:39:umount.0 Request processed in 122us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826881.281913:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1787826881.281923:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787826881.281937:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143705472:0@lo:39:umount.0 00000020:00000080:1.0:1787826881.281942:0:6486:0:(genops.c:885:class_export_put()) final put ffff8d5343bea800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:3.0:1787826881.281945:0:19702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826881.281950:0:19702:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787826881.281954:0:19702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826881.281998:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343bea800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826881.282048:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343bec000 for lustre-MDT0000 00000100:00080000:3.0:1787826881.282747:0:19702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787826881.282750:0:19702:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787826881.282753:0:19702:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787826881.282761:0:19702:0:(import.c:65:import_set_state_nolock()) ffff8d53444b4800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787826881.282802:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143705728:0@lo:39:umount.0 00000100:00100000:0.0:1787826881.282833:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826881.282866:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705728 00000100:00100000:3.0:1787826881.282871:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705728 00000100:00100000:3.0:1787826881.282899:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787826881.282906:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143705728:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787826881.282921:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953f4e 00000100:00080000:3.0:1787826881.282932:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d5343be8800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826881.282948:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826881.282977:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143705728:12345-0@lo:39:umount.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826881.282985:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1787826881.282990:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5444f092c0 x1874672143705728/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1787826881.282992:0:6485:0:(genops.c:885:class_export_put()) final put ffff8d5343be9000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:0.0:1787826881.283003:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53444b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787826881.283024:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143705728:0@lo:39:umount.0 00000020:00000080:2.0:1787826881.283031:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343be9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:1.0:1787826881.283060:0:19702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826881.283064:0:19702:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787826881.283068:0:19702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826881.283079:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343be8800 for lustre-MDT0001 00010000:00010000:1.0:1787826881.284038:0:19702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284050:0:19702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284058:0:19702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284065:0:19702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284088:0:19702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826881.284106:0:19702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284113:0:19702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284120:0:19702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826881.284121:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826881.284128:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284130:0:19702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826881.284146:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1000 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826881.284151:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826881.284155:0:19702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787826881.284162:0:19702:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1787826881.284162:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826881.284172:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826881.284178:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826881.284180:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787826881.284181:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787826881.284184:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:1.0:1787826881.284186:0:19702:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787826881.284192:0:19702:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:0.0:1787826881.284195:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787826881.284198:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787826881.284205:0:19702:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:0.0:1787826881.284207:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0c00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826881.284212:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826881.284238:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.284241:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826881.284252:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787826881.284258:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826881.284265:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787826881.284268:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787826881.284270:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787826881.284275:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826881.284284:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143705856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826881.284285:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1000/0xc0fefc09a7953ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953ee5 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.284290:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.284309:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826881.284322:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826881.284326:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826881.284326:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826881.284332:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826881.284333:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826881.284340:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0c00/0xc0fefc09a7953f0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7953f16 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.284349:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826881.284351:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826881.284352:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826881.284362:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826881.284367:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705856 00000100:00100000:0.0:1787826881.284372:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705856 00000100:00100000:2.0:1787826881.284376:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143705984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826881.284404:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787826881.284410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826881.284424:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54516ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143705856:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826881.284425:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143705984 00000100:00100000:3.0:1787826881.284430:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143705984 00010000:00010000:0.0:1787826881.284439:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826881.284455:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d3000/0xc0fefc09a7953ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953ede expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.284467:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826881.284471:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787826881.284481:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3617:x1874672143705984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826881.284492:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826881.284501:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54516ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143705856:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (172us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826881.284504:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547d2d7000/0xc0fefc09a7953f16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7953f0f expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826881.284512:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1787826881.284515:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826881.284526:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143705856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826881.284549:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143705984:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826881.284555:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787826881.284569:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143705984:0@lo:103:ldlm_bl.0 00002000:00000080:1.0:1787826881.286046:0:19702:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1787826881.286073:0:19702:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:2.0:1787826881.286979:0:18709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836493 is committed 00000020:00000080:1.0:1787826881.287043:0:19702:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1787826881.287050:0:19702:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5343bef800 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 21474836493 stale:0 00000020:00080000:1.0:1787826881.287056:0:19702:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5343beb800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 21474836490 stale:0 00000020:00080000:1.0:1787826881.287061:0:19702:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5343bed800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:1.0:1787826881.287065:0:19702:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5450eecd28) has exports, disconnecting them 00000020:00080000:1.0:1787826881.287069:0:19702:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d5343bef800), last request at 1787826880 00000020:00000080:1.0:1787826881.287087:0:19702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953f08 00000020:00010000:1.0:1787826881.287106:0:19702:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d5343bef800: total 0 00000100:00080000:1.0:1787826881.287111:0:19702:0:(import.c:65:import_set_state_nolock()) ffff8d5442bd6800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787826881.287142:0:7427:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d5343bef800: total 0 00000020:00080000:1.0:1787826881.287169:0:19702:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d5343bef800): rc 0 00000020:00080000:1.0:1787826881.287172:0:19702:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5343beb800), last request at 1787826880 00000020:00000080:1.0:1787826881.287175:0:19702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953f01 00010000:00010000:3.0:1787826881.287184:0:7427:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d5343bef800, canceled 0 locks, left on hash table 1. 00000100:00080000:1.0:1787826881.287185:0:19702:0:(import.c:65:import_set_state_nolock()) ffff8d5448303800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826881.287195:0:19702:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5343beb800): rc 0 00000020:00000080:1.0:1787826881.287197:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5343beb800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1787826881.287208:0:19702:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5343bed800), last request at 1787826880 00000020:00000080:1.0:1787826881.287211:0:19702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953efa 00010000:00010000:0.0:1787826881.287240:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826881.287242:0:19702:0:(import.c:65:import_set_state_nolock()) ffff8d534260f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826881.287256:0:19702:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5343bed800): rc 0 00000020:00000080:1.0:1787826881.287258:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5343bed800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787826881.287264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343beb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787826881.287298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343bed800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00080000:1.0:1787826881.287301:0:19702:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5450eecd28) has no exports 00010000:00010000:3.0:1787826881.287305:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fa8969e/0xc0fefc09a7954058 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346755a expref: 2 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826881.287311:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826881.287324:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5448303800 for lustre-OST0000 00010000:00010000:3.0:1787826881.287331:0:7427:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d5343bef800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787826881.287333:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d534260f000 for lustre-OST0000 00000020:00000080:3.0:1787826881.288782:0:7427:0:(genops.c:885:class_export_put()) final put ffff8d5343bef800/2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:3.0:1787826881.288794:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826881.288796:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826881.288805:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826881.288810:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343bef800/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:2.0:1787826881.288841:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5442bd6800 for lustre-OST0000 00000020:01000000:1.0:1787826881.289429:0:19702:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5342bafe40 - data ffff8d54698bf798/ffff8d547f856000 00000020:01000000:1.0:1787826881.289548:0:19702:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d53426f4840 - data ffff8d5469ab9000/ffff8d53424d4000 00100000:10000000:1.0:1787826881.297761:0:19702:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787826881.301891:0:19702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953ef3 00000020:00000080:2.0:1787826881.301902:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5343be9800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787826881.301916:0:19702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e0000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787826881.301924:0:19702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e0000 2 00000020:00000080:0.0:1787826881.301935:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343be9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1787826881.301935:0:19702:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d547f8e0000 from lustre-OST0000 00000020:00000080:2.0:1787826881.301958:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826881.301969:0:19702:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787826881.301977:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5343bef000/lustre-OST0000_UUID 00000020:00000080:2.0:1787826881.301980:0:19702:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343bef000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787826881.302057:0:19702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787826881.302117:0:19702:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1787826881.302121:0:19702:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787826881.302126:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826881.302132:0:19702:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787826881.302143:0:19702:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d5448301800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826881.302150:0:19702:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d5450e8cd28) has exports, disconnecting them 00000020:00080000:2.0:1787826881.302155:0:19702:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d5448301800), last request at 1787826869 00000020:00000080:2.0:1787826881.302160:0:19702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953f32 00000020:00080000:2.0:1787826881.302177:0:19702:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5448301800): rc 0 00000020:00000080:2.0:1787826881.302182:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5448301800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787826881.302199:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448301800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787826881.304270:0:19702:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787826881.304277:0:19702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826881.304281:0:19702:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826881.304286:0:19702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826881.304317:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53444b2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787826881.304461:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826881.304468:0:19702:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787826881.304471:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5448302000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787826881.304474:0:19702:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448302000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787826881.304478:0:19702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787826881.304576:0:19702:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787826881.304580:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826881.304586:0:19702:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826881.304591:0:19702:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d5448302800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826881.304597:0:19702:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d5450e8b370) has exports, disconnecting them 00000020:00080000:0.0:1787826881.304602:0:19702:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d5448302800), last request at 1787826869 00000020:00000080:0.0:1787826881.304612:0:19702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953f47 00000020:00080000:0.0:1787826881.304626:0:19702:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5448302800): rc 0 00000020:00000080:0.0:1787826881.304629:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5448302800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787826881.304648:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448302800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787826881.306564:0:19702:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787826881.306569:0:19702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826881.306572:0:19702:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826881.306576:0:19702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826881.306603:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53444b4800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787826881.306700:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826881.306706:0:19702:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787826881.306708:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5448300000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787826881.306710:0:19702:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448300000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787826881.306713:0:19702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787826881.306761:0:19702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e0000 1 00000020:00000080:0.0:1787826881.306766:0:19702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953ed7 00000020:00000080:0.0:1787826881.306771:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d5448303000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787826881.306781:0:19702:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787826881.306785:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826881.306790:0:19702:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826881.306792:0:19702:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d53444f99b8) has no exports 00000020:00000080:3.0:1787826881.306799:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448303000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787826881.323474:0:19702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826881.323490:0:19702:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787826881.323495:0:19702:0:(genops.c:885:class_export_put()) final put ffff8d547f8e2800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787826881.323500:0:19702:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f8e2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787826881.323509:0:19702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787826881.323634:0:19702:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d547f8e5800 00000020:02000400:1.0:1787826881.323682:0:19702:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787826881.745581:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826882.129422:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 256992204739ns, next at 257992202082ns, rc = 0 00000100:00100000:0.0:1787826882.129439:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826882.129464:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143706112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826882.129484:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143706240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826882.129534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826882.129800:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706112 00000100:00100000:3.0:1787826882.129809:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706112 00000100:00100000:3.0:1787826882.129847:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787826882.129854:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143706112:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:3.0:1787826882.129862:0:16591:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826882.129916:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3616:x1874672143706112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (382us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826882.129922:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:02020000:1.0:1787826882.129963:0:3616:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1787826882.130019:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826882.130096:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706240 00000100:00100000:0.0:1787826882.130099:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706240 00000100:00100000:0.0:1787826882.130123:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787826882.130128:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143706240:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:0.0:1787826882.130133:0:8404:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787826882.130167:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143706240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (148us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826882.130186:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:02020000:2.0:1787826882.130205:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787826882.130211:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826882.130258:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826882.130263:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787826882.140564:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826882.140572:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826882.140591:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1787826882.140608:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1787826882.140611:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826882.140616:0:3616:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 246 00000100:00080000:1.0:1787826882.140624:0:3616:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826882.140659:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b5ad00 x1874672143706368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826882.140713:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143706368:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:0.0:1787826882.140779:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826882.140834:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706368 00000100:00100000:3.0:1787826882.140843:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706368 00000100:00100000:3.0:1787826882.140884:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787826882.140892:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143706368:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:3.0:1787826882.140915:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826882.140978:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143706368:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 85us (198us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826882.140986:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1787826882.141023:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826882.141029:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826882.141032:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143706368:0@lo:8:ptlrpcd_00_00.0 00000004:00080000:2.0:1787826882.142025:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1787826882.142029:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826882.142033:0:3618:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 246 00000100:00080000:2.0:1787826882.142039:0:3618:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826882.142061:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5344bd4b40 x1874672143706496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826882.142125:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143706496:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:0.0:1787826882.142152:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826882.142195:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706496 00000100:00100000:3.0:1787826882.142201:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706496 00000100:00100000:3.0:1787826882.142258:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787826882.142266:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143706496:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:3.0:1787826882.142281:0:19008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826882.142327:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143706496:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 61us (173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826882.142334:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1787826882.142427:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826882.142432:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826882.142436:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143706496:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:0.0:1787826882.769372:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826883.793399:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826883.985067:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826883.985113:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826883.985125:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194176 00000100:00100000:3.0:1787826883.985134:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194176 00000100:00100000:1.0:1787826883.985148:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826883.985172:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194304 00000100:00100000:0.0:1787826883.985177:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194304 00000100:00100000:1.0:1787826883.985178:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826883.985181:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 428 00000100:00100000:3.0:1787826883.985192:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134194176:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826883.985210:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194560 00000100:00100000:2.0:1787826883.985248:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194560 00000100:00100000:1.0:1787826883.985252:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826883.985254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194432 00000100:00100000:0.0:1787826883.985259:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194432 00000100:00100000:2.0:1787826883.985281:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194688 00000100:00100000:2.0:1787826883.985286:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194688 00000100:00100000:1.0:1787826883.985297:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 227 00000100:00100000:3.0:1787826883.985299:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134194176:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 110us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826883.985307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 228 00000100:00100000:1.0:1787826883.985309:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2392:x1874672134194304:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826883.985309:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 428 00000100:00100000:2.0:1787826883.985321:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:0.0:1787826883.985325:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134194432:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826883.985335:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134194688:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:3.0:1787826883.985344:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826883.985347:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2392:x1874672134194304:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826883.985350:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826883.985353:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826883.985354:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 227 00000100:00100000:0.0:1787826883.985368:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134194432:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826883.985375:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134194688:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826883.985381:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 228 00000100:00100000:1.0:1787826883.985393:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:2.0:1787826883.985404:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:1.0:1787826883.985405:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2392:x1874672134194560:12345-192.168.203.6@tcp:400:kworker.0 00000020:00080000:1.0:1787826883.985413:0:19009:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:1.0:1787826883.985442:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2392:x1874672134194560:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 41us (292us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826883.985449:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:1.0:1787826883.991895:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826883.991936:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194816 00000100:00100000:3.0:1787826883.991942:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194816 00000100:00100000:3.0:1787826883.991985:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:3.0:1787826883.991993:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134194816:12345-192.168.203.6@tcp:8:ptlrpcd_01_00.0 00010000:00020000:3.0:1787826883.992015:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826883.992065:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134194816:12345-192.168.203.6@tcp:8:ptlrpcd_01_00.0 Request processed in 73us (176us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826883.992070:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 151 00000004:00080000:1.0:1787826884.178370:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000001:00080000:1.0:1787826884.178400:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967375 is committed 00000004:00080000:1.0:1787826884.178419:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00010000:00010000:3.0:1787826884.178436:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178449:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178468:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178475:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826884.178480:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178488:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178503:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x733c6acc (ffff8d54745a9400) 00010000:00010000:3.0:1787826884.178506:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826884.178510:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178517:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079c00/0xc0fefc09a7954004 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178538:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178544:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178550:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178555:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826884.178557:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178572:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178579:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee27d887 (ffff8d54745a9f00) 00010000:00010000:3.0:1787826884.178581:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826884.178584:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826884.178590:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079600/0xc0fefc09a7954027 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826884.689407:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787826884.689429:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143706880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826884.689440:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143706624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826884.689504:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826884.689506:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826884.689557:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706880 00000100:00100000:0.0:1787826884.689565:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706880 00000100:00100000:2.0:1787826884.689566:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143706752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826884.689574:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706624 00000100:00100000:3.0:1787826884.689580:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706624 00000100:00100000:2.0:1787826884.689596:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826884.689604:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826884.689625:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706752 00000100:00100000:3.0:1787826884.689632:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787826884.689639:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706752 00000100:00100000:2.0:1787826884.689639:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787826884.689647:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143706624:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826884.689658:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54765b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143706880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826884.689682:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787826884.689682:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00080000:1.0:1787826884.689685:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826884.689687:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787826884.689699:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143706752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826884.689713:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826884.689744:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54765b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143706880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826884.689752:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143706624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826884.689755:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787826884.689762:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143706752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826884.689767:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787826884.689775:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787826884.689783:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143706624:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787826884.689820:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd70c0 x1874672143706880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826884.689836:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143706880:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787826884.689850:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546f6a03c0 x1874672143706752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826884.689862:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143706752:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826884.817312:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826885.713426:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143707264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.713430:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143707136:0@lo:400:kworker.0 00000100:00080000:3.0:1787826885.713437:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826885.713442:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826885.713446:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826885.713452:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 257 00000100:00080000:3.0:1787826885.713457:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826885.713463:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826885.713495:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d534243e940 x1874672143707776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826885.713511:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826885.713512:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826885.713535:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826885.713539:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826885.713542:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826885.713546:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 257 00000100:00080000:3.0:1787826885.713549:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826885.713553:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826885.713569:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e155e00 x1874672143708288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826885.713587:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143707520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826885.713587:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143707904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826885.713629:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826885.713634:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826885.713661:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787826885.713666:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143708160:0@lo:400:kworker.0 00000100:00100000:1.0:1787826885.713671:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143707008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826885.713682:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707264 00000100:00100000:3.0:1787826885.713690:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707264 00000100:00100000:2.0:1787826885.713693:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707904 00000100:00100000:2.0:1787826885.713700:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707904 00000100:00100000:0.0:1787826885.713705:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826885.713713:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826885.713735:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143707648:0@lo:400:kworker.0 00000100:00100000:2.0:1787826885.713748:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787826885.713757:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787826885.713765:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826885.713765:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143707904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.713769:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143707392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826885.713788:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143708416:0@lo:400:kworker.0 00000100:00100000:3.0:1787826885.713805:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707520 00000100:00100000:3.0:1787826885.713810:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707520 00000100:00100000:1.0:1787826885.713841:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826885.713842:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708160 00000100:00100000:0.0:1787826885.713843:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826885.713847:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143707904:12345-0@lo:400:kworker.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826885.713849:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708160 00000100:00100000:2.0:1787826885.713870:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787826885.713879:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143708032:0@lo:400:kworker.0 00010000:00080000:1.0:1787826885.713886:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534243d680 x1874672143707904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826885.713891:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708416 00000100:00100000:2.0:1787826885.713897:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708416 00000100:00100000:1.0:1787826885.713904:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143707904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.713911:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826885.713941:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707008 00000100:00100000:2.0:1787826885.713942:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787826885.713946:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707008 00000100:00100000:2.0:1787826885.713955:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143708416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.713961:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707136 00000100:00100000:0.0:1787826885.713967:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707136 00000100:00100000:1.0:1787826885.713981:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707648 00000100:00100000:1.0:1787826885.713986:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707648 00000100:00100000:3.0:1787826885.714004:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787826885.714008:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707392 00000100:00100000:0.0:1787826885.714011:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1787826885.714019:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707392 00000100:00100000:3.0:1787826885.714021:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143707264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826885.714022:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143708416:12345-0@lo:400:kworker.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826885.714032:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826885.714038:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787826885.714043:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787826885.714055:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143707008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826885.714086:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143707264:12345-0@lo:400:kworker.0 Request processed in 72us (577us total) trans 0 rc 0/0 00000004:00000024:1.0:1787826885.714092:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826885.714100:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143707136:12345-0@lo:400:kworker.0 Request processed in 79us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826885.714108:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787826885.714112:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1787826885.714128:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708032 00000100:00100000:3.0:1787826885.714133:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708032 00000100:00100000:1.0:1787826885.714137:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143707008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826885.714147:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787826885.714163:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787826885.714173:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787826885.714175:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143707520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.714183:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787826885.714187:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143707648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.714206:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143707392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826885.714246:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143707520:12345-0@lo:400:kworker.0 Request processed in 74us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826885.714254:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787826885.714259:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143707648:12345-0@lo:400:kworker.0 Request processed in 74us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826885.714268:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787826885.714276:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787826885.714286:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143707392:12345-0@lo:400:kworker.0 Request processed in 80us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826885.714293:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143708160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826885.714296:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787826885.714299:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787826885.714311:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143708032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826885.714329:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143707008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826885.714341:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143708160:12345-0@lo:400:kworker.0 Request processed in 50us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826885.714348:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143707648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826885.714351:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787826885.714363:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143707776:0@lo:8:kworker.0 00000100:00100000:2.0:1787826885.714363:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143708032:12345-0@lo:400:kworker.0 Request processed in 53us (451us total) trans 0 rc 0/0 00010000:00080000:1.0:1787826885.714368:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e154780 x1874672143708416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826885.714382:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787826885.714386:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143708416:0@lo:400:kworker.0 00000100:00080000:3.0:1787826885.714390:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826885.714396:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826885.714407:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143707264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.714411:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826885.714441:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e155e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143708288:0@lo:8:kworker.0 00000100:00100000:1.0:1787826885.714450:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143707776 00000100:00100000:1.0:1787826885.714455:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143707776 00000100:00100000:0.0:1787826885.714469:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826885.714487:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708288 00000100:00100000:1.0:1787826885.714492:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708288 00000100:00100000:2.0:1787826885.714511:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143707392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826885.714517:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787826885.714527:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787826885.714528:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143707776:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826885.714529:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143708032:0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.714539:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143708288:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826885.714547:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143707520:0@lo:400:kworker.0 00010000:00020000:1.0:1787826885.714549:0:19009:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1787826885.714552:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787826885.714559:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534243e580 x1874672143708160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826885.714569:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143708160:0@lo:400:kworker.0 00000100:00100000:2.0:1787826885.714579:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143707136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826885.714603:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143708288:12345-0@lo:8:kworker.0 Request processed in 63us (134us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826885.714606:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143707776:12345-0@lo:8:kworker.0 Request processed in 80us (197us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826885.714615:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787826885.714622:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1787826885.714647:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826885.714653:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826885.714658:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143707776:0@lo:8:kworker.0 00000100:00080000:0.0:1787826885.714672:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826885.714677:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826885.714681:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e155e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143708288:0@lo:8:kworker.0 00010000:00010000:0.0:1787826885.841341:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826886.865396:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826887.889412:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826888.913367:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826889.106486:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826889.106521:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826889.106567:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826889.106597:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826889.106597:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195200 00000100:00100000:3.0:1787826889.106603:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134194944 00000100:00100000:1.0:1787826889.106607:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195200 00000100:00100000:3.0:1787826889.106614:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134194944 00000100:00100000:2.0:1787826889.106622:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195072 00000100:00100000:2.0:1787826889.106628:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195072 00000100:00100000:0.0:1787826889.106641:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826889.106664:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 233 00000100:00100000:1.0:1787826889.106674:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134195200:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826889.106677:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 430 00000100:00100000:3.0:1787826889.106691:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134194944:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826889.106692:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 234 00000100:00100000:2.0:1787826889.106711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134195072:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826889.106713:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195456 00000100:00100000:0.0:1787826889.106719:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195456 00000100:00100000:1.0:1787826889.106745:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134195200:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826889.106748:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134194944:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 58us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826889.106756:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134195072:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826889.106759:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 233 00000100:00100000:3.0:1787826889.106766:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 430 00000100:00100000:0.0:1787826889.106770:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195328 00000100:00100000:2.0:1787826889.106772:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 234 00000100:00100000:0.0:1787826889.106775:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195328 00000100:00100000:0.0:1787826889.106800:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 123 00000100:00080000:3.0:1787826889.106804:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826889.106810:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:0.0:1787826889.106811:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134195456:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:3.0:1787826889.106811:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826889.106817:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826889.106821:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134195328:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:0.0:1787826889.106843:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134195456:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 35us (245us total) trans 0 rc 0/0 00010000:00020000:2.0:1787826889.106845:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826889.106855:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 123 00000100:00100000:2.0:1787826889.106879:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134195328:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 58us (239us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826889.106886:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:2.0:1787826889.809387:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143708800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826889.809391:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143708672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826889.809394:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143708544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826889.809469:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826889.809469:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826889.809522:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826889.809544:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708544 00000100:00100000:0.0:1787826889.809552:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708544 00000100:00100000:1.0:1787826889.809561:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708672 00000100:00100000:1.0:1787826889.809566:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708672 00000100:00100000:3.0:1787826889.809571:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708800 00000100:00100000:3.0:1787826889.809576:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708800 00000100:00100000:1.0:1787826889.809610:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787826889.809614:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787826889.809621:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e155e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143708672:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826889.809622:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787826889.809628:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143708544:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826889.809638:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143708800:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787826889.809647:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:1.0:1787826889.809652:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:0.0:1787826889.809653:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787826889.809654:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826889.809712:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e155e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143708672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826889.809719:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143708800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826889.809723:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787826889.809726:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143708544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826889.809742:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787826889.809752:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:1.0:1787826889.809766:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534479fc00 x1874672143708544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826889.809766:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd52c0 x1874672143708800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826889.809800:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143708672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826889.809805:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143708800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826889.809806:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143708544:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826889.937400:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826890.833398:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143708928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826890.833398:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143709056:0@lo:400:kworker.0 00000100:00080000:3.0:1787826890.833432:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826890.833436:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1787826890.833438:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143709312:0@lo:400:kworker.0 00000100:00080000:3.0:1787826890.833439:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826890.833447:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 260 00000100:00080000:3.0:1787826890.833462:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826890.833467:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826890.833479:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826890.833479:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826890.833493:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e16f480 x1874672143709696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826890.833513:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826890.833532:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143709696:0@lo:8:kworker.0 00000100:00080000:3.0:1787826890.833550:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826890.833554:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826890.833557:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826890.833561:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 260 00000100:00080000:3.0:1787826890.833564:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1787826890.833568:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143709568:0@lo:400:kworker.0 00000100:00080000:3.0:1787826890.833570:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826890.833576:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826890.833578:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143709952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.833598:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b121c0 x1874672143710208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826890.833615:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826890.833620:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709056 00000100:00100000:0.0:1787826890.833629:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709056 00000100:00100000:2.0:1787826890.833633:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826890.833649:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143710336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.833649:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143708928 00000100:00100000:3.0:1787826890.833656:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143708928 00000100:00100000:2.0:1787826890.833681:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826890.833687:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1787826890.833688:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826890.833689:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709312 00000100:00100000:2.0:1787826890.833694:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e154780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143709184:0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.833694:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709312 00000100:00100000:0.0:1787826890.833703:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143709056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.833717:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709568 00000100:00100000:1.0:1787826890.833720:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787826890.833721:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709568 00000100:00100000:1.0:1787826890.833729:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143709440:0@lo:400:kworker.0 00000100:00100000:2.0:1787826890.833736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826890.833745:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787826890.833755:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143708928:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826890.833774:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143709824:0@lo:400:kworker.0 00000100:00100000:0.0:1787826890.833776:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143709056:12345-0@lo:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826890.833776:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1787826890.833779:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826890.833791:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1787826890.833810:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143710080:0@lo:400:kworker.0 00000100:00100000:2.0:1787826890.833822:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826890.833833:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143708928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826890.833842:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787826890.833847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826890.833854:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143708928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826890.833877:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787826890.833881:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143709056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.833887:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787826890.833892:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143709312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.833899:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143709568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826890.833903:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709952 00000100:00100000:0.0:1787826890.833909:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709952 00000100:00100000:1.0:1787826890.833928:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709696 00000100:00100000:1.0:1787826890.833932:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709696 00000100:00100000:2.0:1787826890.833948:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143709312:12345-0@lo:400:kworker.0 Request processed in 61us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826890.833957:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787826890.833958:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710336 00000100:00100000:0.0:1787826890.833961:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709184 00000100:00100000:1.0:1787826890.833963:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710336 00000100:00100000:3.0:1787826890.833964:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143709568:12345-0@lo:400:kworker.0 Request processed in 67us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826890.833968:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709184 00000100:00100000:3.0:1787826890.833972:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787826890.833992:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709440 00000100:00100000:1.0:1787826890.833995:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143709824 00000100:00100000:2.0:1787826890.833997:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709440 00000100:00100000:0.0:1787826890.833998:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710080 00000100:00100000:1.0:1787826890.834000:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143709824 00000100:00100000:3.0:1787826890.834002:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787826890.834004:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710080 00000100:00100000:3.0:1787826890.834011:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143710336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826890.834038:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787826890.834049:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787826890.834050:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143709952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.834059:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143710336:12345-0@lo:400:kworker.0 Request processed in 48us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826890.834060:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787826890.834063:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143709824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826890.834075:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143709184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826890.834076:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787826890.834098:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143709952:12345-0@lo:400:kworker.0 Request processed in 52us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826890.834102:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787826890.834107:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787826890.834114:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143709824:12345-0@lo:400:kworker.0 Request processed in 53us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826890.834114:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143709696:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787826890.834129:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787826890.834129:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787826890.834130:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143709184:12345-0@lo:400:kworker.0 Request processed in 55us (394us total) trans 0 rc 0/0 00010000:00020000:3.0:1787826890.834138:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826890.834139:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143709440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826890.834145:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787826890.834166:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787826890.834176:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143710080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826890.834186:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143709440:12345-0@lo:400:kworker.0 Request processed in 46us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826890.834194:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787826890.834199:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143709440:0@lo:400:kworker.0 00010000:00080000:1.0:1787826890.834236:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b13840 x1874672143710080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826890.834246:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143710080:12345-0@lo:400:kworker.0 Request processed in 71us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826890.834246:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143710080:0@lo:400:kworker.0 00000100:00100000:2.0:1787826890.834257:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e154780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143709184:0@lo:400:kworker.0 00000100:00100000:0.0:1787826890.834258:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:1.0:1787826890.834263:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b11680 x1874672143710336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826890.834276:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143710336:0@lo:400:kworker.0 00010000:00080000:2.0:1787826890.834281:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e16c780 x1874672143709824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826890.834290:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826890.834292:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143709568:0@lo:400:kworker.0 00000100:00100000:2.0:1787826890.834295:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143709824:0@lo:400:kworker.0 00000100:00080000:0.0:1787826890.834298:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826890.834321:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143709952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826890.834343:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143710208:0@lo:8:kworker.0 00000100:00100000:2.0:1787826890.834348:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143709312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826890.834366:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826890.834484:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710208 00000100:00100000:0.0:1787826890.834497:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710208 00000100:00100000:0.0:1787826890.834524:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787826890.834530:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143710208:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787826890.834550:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826890.834589:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143710208:12345-0@lo:8:kworker.0 Request processed in 57us (222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826890.834597:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1787826890.834609:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826890.834614:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826890.834617:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143710208:0@lo:8:kworker.0 00000100:00100000:3.0:1787826890.843874:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143709696:12345-0@lo:8:kworker.0 Request processed in 9760us (10298us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826890.843884:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787826890.843933:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826890.843939:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826890.843943:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143709696:0@lo:8:kworker.0 00010000:00010000:0.0:1787826890.961412:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826891.985397:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826893.009316:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826894.033363:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826894.225182:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826894.225241:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195584 00000100:00100000:1.0:1787826894.225248:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826894.225250:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195584 00000100:00100000:1.0:1787826894.225281:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826894.225298:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 432 00000100:00100000:1.0:1787826894.225306:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826894.225309:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195840 00000100:00100000:0.0:1787826894.225312:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134195584:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826894.225315:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195840 00000100:00100000:1.0:1787826894.225341:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826894.225370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195712 00000100:00100000:1.0:1787826894.225371:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134195968 00000100:00100000:2.0:1787826894.225374:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195712 00000100:00100000:1.0:1787826894.225377:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134195968 00000100:00100000:0.0:1787826894.225388:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134195584:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.225398:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 432 00000100:00100000:1.0:1787826894.225405:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196096 00000100:00100000:1.0:1787826894.225409:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196096 00000100:00100000:2.0:1787826894.225414:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 239 00000100:00100000:2.0:1787826894.225426:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134195840:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826894.225448:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:1.0:1787826894.225458:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134196096:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826894.225465:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134195840:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.225482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 239 00000100:00100000:1.0:1787826894.225504:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134196096:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.225509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 240 00000100:00100000:1.0:1787826894.225518:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:2.0:1787826894.225523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134195712:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826894.225551:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 157 00000100:00100000:1.0:1787826894.225557:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134195968:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:2.0:1787826894.225572:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134195712:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 51us (266us total) trans 0 rc 0/0 00010000:00020000:1.0:1787826894.225573:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826894.225583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 240 00000100:00080000:0.0:1787826894.225589:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826894.225594:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826894.225597:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826894.225602:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134195968:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 42us (321us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826894.225607:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 157 00000020:01000004:1.0:1787826894.249678:0:20124:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787826894.249682:0:20124:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787826894.249684:0:20124:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787826894.249767:0:20124:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d547f8e4000 00000020:01000004:1.0:1787826894.249780:0:20124:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787826894.249791:0:20124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787826894.249801:0:20124:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d5450eecd28) 00000020:00000080:1.0:1787826894.249813:0:20124:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787826894.277298:0:20124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787826894.279238:0:20124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787826894.279572:0:20124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787826894.279768:0:20124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787826894.279996:0:20124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787826894.280175:0:20124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787826894.280380:0:20124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787826894.284399:0:20124:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787826894.284608:0:20124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787826894.284621:0:20124:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787826894.284637:0:20124:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7954066 00000020:01000004:2.0:1787826894.284644:0:20124:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787826894.284667:0:20124:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787826894.284670:0:20124:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787826894.284676:0:20124:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787826894.284704:0:20124:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787826894.284708:0:20124:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787826894.292489:0:20124:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787826894.292525:0:20124:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787826894.292529:0:20124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787826894.292531:0:20124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826894.292532:0:20124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826894.292534:0:20124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826894.292535:0:20124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826894.292536:0:20124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826894.292538:0:20124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826894.292539:0:20124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826894.292541:0:20124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787826894.292544:0:20124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787826894.292547:0:20124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826894.292548:0:20124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826894.292549:0:20124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826894.292550:0:20124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826894.292552:0:20124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826894.292553:0:20124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826894.292554:0:20124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826894.292555:0:20124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826894.292556:0:20124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787826894.292580:0:20124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787826894.292598:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826894.292664:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.292714:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.292723:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710464 00000100:00100000:0.0:1787826894.292731:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710464 00000100:00100000:0.0:1787826894.292784:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1787826894.292791:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:20124:x1874672143710464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826894.292819:0:9479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787826894.292823:0:9479:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787826894.292826:0:9479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787826894.293405:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:20124:x1874672143710464:12345-0@lo:253:mount.lustre.0 Request processed in 613us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.293415:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1787826894.293440:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826894.293450:0:20124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787826894.293457:0:20124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826894.293459:0:20124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826894.293460:0:20124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826894.293461:0:20124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826894.293462:0:20124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826894.293463:0:20124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826894.293464:0:20124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826894.293464:0:20124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826894.293465:0:20124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787826894.293477:0:20124:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d547f8e4000 from lustre-OST0000 10000000:01000000:2.0:1787826894.293498:0:20124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787826894.293508:0:20124:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787826894.293516:0:20124:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:2.0:1787826894.293525:0:20124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826894.293606:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826894.293644:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.293671:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.293745:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710592 00000100:00100000:0.0:1787826894.293751:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710592 00000100:00100000:0.0:1787826894.293791:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1787826894.293804:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:20124:x1874672143710592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826894.293875:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:20124:x1874672143710592:12345-0@lo:501:mount.lustre.0 Request processed in 73us (226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826894.293881:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1787826894.293906:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710592:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787826894.293922:0:20124:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787826894.293937:0:20124:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787826894.293943:0:20124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.293951:0:20124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826894.293975:0:20124:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d547f8e4000 10000000:01000000:2.0:1787826894.293980:0:20124:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787826894.293985:0:20124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787826894.293993:0:20124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826894.293997:0:20124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787826894.294012:0:20124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787826894.294030:0:20124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.294039:0:20124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.294048:0:20124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826894.294060:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826894.294086:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.294104:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.294134:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710720 00000100:00100000:0.0:1787826894.294139:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710720 00000100:00100000:0.0:1787826894.294169:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1787826894.294177:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:20124:x1874672143710720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826894.294187:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826894.294199:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a7954074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795406d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.294251:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a7954074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795406d expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.294263:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a7954074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795406d expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.294273:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1e00, rc 0) 00000100:00100000:0.0:1787826894.294308:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143710720:12345-0@lo:101:mount.lustre.0 Request processed in 131us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.294316:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1787826894.294322:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826894.294336:0:20124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.294354:0:20124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826894.295719:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000040:00080000:2.0:1787826894.296183:0:20124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826894.297545:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:2.0:1787826894.297645:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:2.0:1787826894.297661:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:2.0:1787826894.297675:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:2.0:1787826894.297685:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:2.0:1787826894.297697:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:2.0:1787826894.297719:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:2.0:1787826894.297731:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:2.0:1787826894.297742:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 80 off9712 00000040:00080000:2.0:1787826894.297754:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9936 00000040:00080000:2.0:1787826894.297764:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10160 00000040:00080000:2.0:1787826894.297775:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 120 off10280 00000040:00080000:2.0:1787826894.297793:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 224 off10504 00000040:00080000:2.0:1787826894.297798:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 13 count 14 00000100:00100000:2.0:1787826894.297874:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826894.297929:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.297971:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826894.297989:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710848 00000100:00100000:3.0:1787826894.297997:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710848 00000100:00100000:3.0:1787826894.298058:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1787826894.298066:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143710848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826894.298169:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143710848:12345-0@lo:501:mount.lustre.0 Request processed in 103us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826894.298178:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1787826894.298189:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826894.298242:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826894.298281:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.298309:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.298331:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143710976 00000100:00100000:0.0:1787826894.298343:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143710976 00000100:00100000:0.0:1787826894.298374:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1787826894.298382:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143710976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826894.298473:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143710976:12345-0@lo:503:mount.lustre.0 Request processed in 91us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.298481:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1787826894.298484:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143710976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787826894.298904:0:20124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826894.298958:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826894.298992:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.299020:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.299041:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143711104 00000100:00100000:0.0:1787826894.299047:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143711104 00000100:00100000:0.0:1787826894.299079:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1787826894.299086:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143711104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826894.299155:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143711104:12345-0@lo:502:mount.lustre.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.299162:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1787826894.299173:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826894.299326:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:2.0:1787826894.299349:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:2.0:1787826894.299362:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:2.0:1787826894.299375:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:2.0:1787826894.299388:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:2.0:1787826894.299402:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:2.0:1787826894.299426:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:2.0:1787826894.299440:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:2.0:1787826894.299452:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 80 off9712 00000040:00080000:2.0:1787826894.299463:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9936 00000040:00080000:2.0:1787826894.299475:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10160 00000040:00080000:2.0:1787826894.299485:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 120 off10280 00000100:00100000:2.0:1787826894.299501:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826894.299547:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.299627:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53438ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.299657:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143711232 00000100:00100000:0.0:1787826894.299661:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143711232 00000100:00100000:0.0:1787826894.299713:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1787826894.299721:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143711232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826894.299791:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143711232:12345-0@lo:502:mount.lustre.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.299798:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1787826894.299842:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826894.299886:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 224 off10504 00000040:00080000:1.0:1787826894.299895:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787826894.300387:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826894.300394:0:20128:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787826894.300399:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826894.300402:0:20128:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787826894.300411:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826894.300425:0:20128:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5342780000) 00000020:00000080:1.0:1787826894.300445:0:20128:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787826894.300451:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826894.300507:0:20128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e4000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787826894.300514:0:20128:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826894.300520:0:20128:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7954082 00010000:00010000:1.0:1787826894.303442:0:20128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1787826894.304047:0:20128:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 21474836480 lx: 1874672143596416 gen 0 00000001:00080000:1.0:1787826894.304082:0:20128:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 21474836490 srv lr: 21474836480 lx: 1874672143699328 gen 0 00000001:00080000:1.0:1787826894.304095:0:20128:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 21474836493 srv lr: 21474836480 lx: 1874672134193024 gen 0 00000001:00000004:1.0:1787826894.304113:0:20128:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 21474836493 00080000:10000000:1.0:1787826894.305230:0:20128:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xe:0x0] (8/32) registered 00000020:00000080:1.0:1787826894.306147:0:20128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787826894.306159:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826894.306166:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826894.306168:0:20128:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787826894.306173:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787826894.306175:0:20128:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787826894.306177:0:20128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826894.306179:0:20128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826894.306181:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787826894.306184:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826894.306186:0:20128:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787826894.306189:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826894.306193:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826894.306194:0:20128:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787826894.306197:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787826894.306198:0:20128:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787826894.306201:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826894.306203:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826894.306204:0:20128:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787826894.306206:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826894.306208:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826894.306209:0:20128:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787826894.306211:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787826894.306254:0:20128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826894.306256:0:20128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826894.306257:0:20128:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787826894.306259:0:20128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000020:01000000:0.0:1787826894.306342:0:20124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787826894.306381:0:20124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787826894.306399:0:20124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.306411:0:20124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826894.306420:0:20124:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d547f8e4000 from 1 10000000:01000000:0.0:1787826894.306424:0:20124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826894.306463:0:20124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.306471:0:20124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.306483:0:20124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826894.306506:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826894.306585:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.306629:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826894.306685:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143711360 00000100:00100000:2.0:1787826894.306692:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143711360 00000100:00100000:2.0:1787826894.306773:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1787826894.306782:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:20124:x1874672143711360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826894.306795:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826894.306807:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a79540a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795409e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.306830:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a79540a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795409e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.306840:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a79540a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795409e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.306848:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3600, rc 0) 00000100:00100000:2.0:1787826894.306901:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711360:12345-0@lo:101:mount.lustre.0 Request processed in 120us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.306908:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1787826894.306979:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826894.307011:0:20124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.307021:0:20124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826894.308036:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 7 count 7 00000040:00080000:1.0:1787826894.308244:0:20124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826894.308390:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:1.0:1787826894.308423:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:1.0:1787826894.308452:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:1.0:1787826894.308475:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:1.0:1787826894.308487:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:1.0:1787826894.308501:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:1.0:1787826894.308506:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 6 count 7 00000100:00100000:1.0:1787826894.308552:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826894.308594:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.308626:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826894.308653:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143711488 00000100:00100000:2.0:1787826894.308660:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143711488 00000100:00100000:2.0:1787826894.308709:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1787826894.308734:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826894.308827:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711488:12345-0@lo:501:mount.lustre.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.308834:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1787826894.308851:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826894.308881:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826894.308920:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.308938:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826894.308966:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143711616 00000100:00100000:2.0:1787826894.308971:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143711616 00000100:00100000:2.0:1787826894.309014:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1787826894.309022:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826894.309110:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711616:12345-0@lo:503:mount.lustre.0 Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.309117:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1787826894.309125:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826894.309431:0:20124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826894.309471:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826894.309511:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.309536:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826894.309543:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143711744 00000100:00100000:2.0:1787826894.309548:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143711744 00000100:00100000:2.0:1787826894.309580:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1787826894.309586:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826894.309649:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711744:12345-0@lo:502:mount.lustre.0 Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.309655:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1787826894.309661:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826894.309804:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:1.0:1787826894.309829:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:1.0:1787826894.309844:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:1.0:1787826894.309863:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:1.0:1787826894.309880:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000100:00100000:1.0:1787826894.309893:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826894.309921:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.309937:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826894.309966:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143711872 00000100:00100000:3.0:1787826894.309973:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143711872 00000100:00100000:3.0:1787826894.310022:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1787826894.310032:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826894.310120:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143711872:12345-0@lo:502:mount.lustre.0 Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826894.310127:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143711872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826894.310130:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000040:00080000:1.0:1787826894.310160:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:1.0:1787826894.310167:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1787826894.310655:0:20132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826894.310663:0:20132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826894.310666:0:20132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787826894.310673:0:20132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547f8e4000 00000020:00000080:2.0:1787826894.310676:0:20132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787826894.310692:0:20132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826894.310696:0:20132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826894.310698:0:20132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787826894.310702:0:20132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826894.310705:0:20132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826894.310713:0:20132:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787826894.310720:0:20132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d547f8e4000 00000020:00000080:2.0:1787826894.310723:0:20132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787826894.310761:0:20132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826894.310765:0:20132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826894.310766:0:20132:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787826894.310769:0:20132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 7 count 7 00000020:01000000:1.0:1787826894.310828:0:20124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787826894.310860:0:20124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826894.310880:0:20124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.310890:0:20124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826894.310932:0:20124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787826894.310935:0:20124:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d547f8e4000 10000000:01000000:1.0:1787826894.310938:0:20124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d547f8e4000 10000000:01000000:1.0:1787826894.310942:0:20124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826894.310947:0:20124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d547f8e4000 from 1 10000000:01000000:1.0:1787826894.310950:0:20124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826894.310972:0:20124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.310990:0:20124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.310999:0:20124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826894.311026:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826894.311060:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.311088:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826894.311099:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712000 00000100:00100000:2.0:1787826894.311106:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712000 00000100:00100000:2.0:1787826894.311159:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1787826894.311168:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:20124:x1874672143712000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826894.311177:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826894.311188:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d3800/0xc0fefc09a79540b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79540ac expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.311206:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d3800/0xc0fefc09a79540b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79540ac expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.311246:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d3800/0xc0fefc09a79540b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79540ac expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.311255:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3800, rc 0) 00000100:00100000:2.0:1787826894.311291:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712000:12345-0@lo:101:mount.lustre.0 Request processed in 125us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.311297:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1787826894.311310:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826894.311322:0:20124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.311331:0:20124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826894.314567:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 00000040:00080000:0.0:1787826894.314864:0:20124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826894.315114:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:0.0:1787826894.315159:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:0.0:1787826894.315180:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:0.0:1787826894.315200:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:0.0:1787826894.315242:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:0.0:1787826894.315262:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:0.0:1787826894.315289:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:0.0:1787826894.315312:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:0.0:1787826894.315328:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:0.0:1787826894.315343:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:0.0:1787826894.315362:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:0.0:1787826894.315377:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:0.0:1787826894.315392:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:0.0:1787826894.315425:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:0.0:1787826894.315446:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:0.0:1787826894.315477:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:0.0:1787826894.315496:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:0.0:1787826894.315514:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:0.0:1787826894.315546:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:0.0:1787826894.315564:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:0.0:1787826894.315585:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:0.0:1787826894.315602:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:0.0:1787826894.315622:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:0.0:1787826894.315642:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:0.0:1787826894.315659:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 160 off12472 00000040:00080000:0.0:1787826894.315676:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12696 00000040:00080000:0.0:1787826894.315691:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12920 00000040:00080000:0.0:1787826894.315704:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off13000 00000040:00080000:0.0:1787826894.315718:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13224 00000040:00080000:0.0:1787826894.315730:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13448 00000040:00080000:0.0:1787826894.315743:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13536 00000040:00080000:0.0:1787826894.315757:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13664 00000040:00080000:0.0:1787826894.315773:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13808 00000040:00080000:0.0:1787826894.315793:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13936 00000040:00080000:0.0:1787826894.315815:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14160 00000040:00080000:0.0:1787826894.315836:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14384 00000040:00080000:0.0:1787826894.315857:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14464 00000040:00080000:0.0:1787826894.315879:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14688 00000040:00080000:0.0:1787826894.315899:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14912 00000040:00080000:0.0:1787826894.315918:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 88 off15000 00000040:00080000:0.0:1787826894.315935:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 128 off15128 00000040:00080000:0.0:1787826894.315950:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].42, 144 off15272 00000040:00080000:0.0:1787826894.315967:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].43, 128 off15400 00000040:00080000:0.0:1787826894.315986:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].44, 224 off15624 00000040:00080000:0.0:1787826894.316016:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].45, 224 off15848 00000040:00080000:0.0:1787826894.316033:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].46, 80 off15928 00000040:00080000:0.0:1787826894.316050:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].47, 224 off16152 00000040:00080000:0.0:1787826894.316067:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].48, 232 off16384 00000040:00080000:0.0:1787826894.316195:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].49, 224 off16608 00000040:00080000:0.0:1787826894.316407:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].50, 120 off16728 00000040:00080000:0.0:1787826894.316435:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].51, 224 off16952 00000040:00080000:0.0:1787826894.316448:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 51 count 51 00000100:00100000:0.0:1787826894.316532:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826894.316597:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.316641:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826894.316666:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712128 00000100:00100000:3.0:1787826894.316673:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712128 00000100:00100000:3.0:1787826894.316715:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1787826894.316724:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826894.316842:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712128:12345-0@lo:501:mount.lustre.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826894.316850:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1787826894.316870:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826894.316899:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826894.316941:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.316962:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826894.316978:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712256 00000100:00100000:1.0:1787826894.316984:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712256 00000100:00100000:1.0:1787826894.317032:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1787826894.317041:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826894.317128:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712256:12345-0@lo:503:mount.lustre.0 Request processed in 89us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826894.317136:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1787826894.317158:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826894.317532:0:20124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826894.317582:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826894.317620:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.317639:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826894.317695:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712384 00000100:00100000:3.0:1787826894.317705:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712384 00000100:00100000:3.0:1787826894.317734:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1787826894.317740:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826894.317817:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712384:12345-0@lo:502:mount.lustre.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826894.317822:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1787826894.317849:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826894.318013:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:1.0:1787826894.318041:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:1.0:1787826894.318072:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:1.0:1787826894.318090:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:1.0:1787826894.318105:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:1.0:1787826894.318119:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:1.0:1787826894.318133:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:1.0:1787826894.318149:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:1.0:1787826894.318166:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:1.0:1787826894.318180:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:1.0:1787826894.318194:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:1.0:1787826894.318208:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:1.0:1787826894.318259:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:1.0:1787826894.318276:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:1.0:1787826894.318289:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:1.0:1787826894.318304:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:1.0:1787826894.318317:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:1.0:1787826894.318331:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:1.0:1787826894.318345:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:1.0:1787826894.318372:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:1.0:1787826894.318393:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:1.0:1787826894.318427:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:1.0:1787826894.318445:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:1.0:1787826894.318460:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:1.0:1787826894.318476:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 160 off12472 00000040:00080000:1.0:1787826894.318494:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12696 00000040:00080000:1.0:1787826894.318509:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12920 00000040:00080000:1.0:1787826894.318522:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off13000 00000040:00080000:1.0:1787826894.318546:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13224 00000040:00080000:1.0:1787826894.318560:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13448 00000040:00080000:1.0:1787826894.318573:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13536 00000040:00080000:1.0:1787826894.318587:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13664 00000040:00080000:1.0:1787826894.318603:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13808 00000040:00080000:1.0:1787826894.318619:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13936 00000040:00080000:1.0:1787826894.318644:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14160 00000040:00080000:1.0:1787826894.318672:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14384 00000040:00080000:1.0:1787826894.318689:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14464 00000040:00080000:1.0:1787826894.318705:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14688 00000040:00080000:1.0:1787826894.318721:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14912 00000040:00080000:1.0:1787826894.318737:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 88 off15000 00000040:00080000:1.0:1787826894.318755:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 128 off15128 00000040:00080000:1.0:1787826894.318769:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].42, 144 off15272 00000040:00080000:1.0:1787826894.318785:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].43, 128 off15400 00000040:00080000:1.0:1787826894.318799:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].44, 224 off15624 00000040:00080000:1.0:1787826894.318817:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].45, 224 off15848 00000040:00080000:1.0:1787826894.318837:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].46, 80 off15928 00000040:00080000:1.0:1787826894.318856:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].47, 224 off16152 00000040:00080000:1.0:1787826894.318874:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].48, 232 off16384 00000100:00100000:1.0:1787826894.318916:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826894.318963:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.318998:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826894.319029:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712512 00000100:00100000:3.0:1787826894.319035:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712512 00000100:00100000:3.0:1787826894.319065:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1787826894.319071:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826894.319152:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712512:12345-0@lo:502:mount.lustre.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826894.319160:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1787826894.319180:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826894.319340:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].49, 224 off16608 00000040:00080000:1.0:1787826894.319363:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].50, 120 off16728 00000100:00100000:1.0:1787826894.319388:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826894.319425:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.319459:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547579e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.319470:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712640 00000100:00100000:0.0:1787826894.319485:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712640 00000100:00100000:0.0:1787826894.319516:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1787826894.319524:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826894.319618:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143712640:12345-0@lo:502:mount.lustre.0 Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.319625:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1787826894.319646:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143712640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826894.319685:0:20124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].51, 224 off16952 00000040:00080000:1.0:1787826894.319694:0:20124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787826894.320450:0:20135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787826894.320463:0:20135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d53437f3370) 00000020:00000080:3.0:1787826894.321420:0:20135:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787826894.321510:0:20135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787826894.321515:0:20135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787826894.321518:0:20135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e4000 3 00010000:00080000:3.0:1787826894.321560:0:20135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d544558f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1787826894.322904:0:20135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:3.0:1787826894.323104:0:20135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787826894.323134:0:20135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826894.323148:0:20135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a79540c1 00000100:00080000:3.0:1787826894.323157:0:20135:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826894.323163:0:20135:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d544558f800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826894.323193:0:20135:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b11680 x1874672143712768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826894.323244:0:20135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787826894.323280:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143712768:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826894.323342:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.323410:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712768 00000100:00100000:0.0:1787826894.323416:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712768 00000020:01000004:3.0:1787826894.323431:0:20135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787826894.323444:0:20135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d53437f19b8) 00000020:00000080:3.0:1787826894.323460:0:20135:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:0.0:1787826894.323466:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787826894.323484:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1874672143712768:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787826894.323517:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 269 last 0 00000020:01000004:3.0:1787826894.323540:0:20135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d547f8e4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787826894.323546:0:20135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787826894.323548:0:20135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e4000 3 00000020:00000080:0.0:1787826894.323551:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a79540cf 00000100:00100000:1.0:1787826894.323560:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143713152:0@lo:400:kworker.0 00000100:00080000:2.0:1787826894.323565:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000004:00100000:0.0:1787826894.323567:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826894.323571:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826894.323577:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00080000:3.0:1787826894.323580:0:20135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d544558d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00000100:00080000:2.0:1787826894.323584:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 265 00000100:00080000:2.0:1787826894.323591:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826894.323600:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d5448300800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787826894.323603:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826894.323615:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.323624:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5344bd70c0 x1874672143713408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826894.323663:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826894.323666:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143712768:12345-0@lo:38:llog_process_th.0 Request processed in 181us (323us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826894.323669:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787826894.323678:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787826894.323682:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143713792:0@lo:400:kworker.0 00000100:00080000:2.0:1787826894.323684:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826894.323689:0:471:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787826894.323694:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713152 00000100:00080000:2.0:1787826894.323696:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 265 00000100:00100000:0.0:1787826894.323699:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713152 00000100:00080000:2.0:1787826894.323701:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826894.323707:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826894.323728:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.323732:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787826894.323736:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5344bd5680 x1874672143713920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826894.323743:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143713152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826894.323756:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143713280:0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.323783:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143713152:12345-0@lo:400:kworker.0 Request processed in 43us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.323791:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787826894.323797:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.323807:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713792 00000100:00100000:0.0:1787826894.323810:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713792 00000100:00100000:0.0:1787826894.323842:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787826894.323848:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143713152:0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.323851:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143713792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.323889:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143713792:12345-0@lo:400:kworker.0 Request processed in 41us (163us total) trans 0 rc 0/0 00010000:00080000:1.0:1787826894.323891:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd7840 x1874672143713792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826894.323899:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787826894.323910:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143713792:0@lo:400:kworker.0 00000100:00100000:1.0:1787826894.323924:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826894.323928:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143712896:0@lo:400:kworker.0 00000100:00100000:1.0:1787826894.323934:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143714048:0@lo:400:kworker.0 00000100:00100000:2.0:1787826894.323963:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143713024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.323968:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.323975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.323993:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143713536:0@lo:400:kworker.0 00000100:00100000:2.0:1787826894.324016:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.324025:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143714048 00000100:00100000:1.0:1787826894.324030:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143714048 00000100:00100000:0.0:1787826894.324044:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.324045:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143713664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826894.324070:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713536 00000100:00100000:2.0:1787826894.324070:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.324076:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713536 00000100:00100000:0.0:1787826894.324105:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143712896 00000100:00100000:0.0:1787826894.324110:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143712896 00000100:00100000:2.0:1787826894.324114:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713664 00000100:00100000:1.0:1787826894.324119:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787826894.324125:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713664 00000100:00100000:1.0:1787826894.324130:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143714048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.324136:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787826894.324146:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143712896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826894.324164:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787826894.324171:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143714048:12345-0@lo:400:kworker.0 Request processed in 44us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.324177:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143713664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826894.324181:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787826894.324198:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143712896:12345-0@lo:400:kworker.0 Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826894.324200:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787826894.324210:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787826894.324239:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143713536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826894.324241:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143713664:12345-0@lo:400:kworker.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.324250:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1787826894.324258:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826894.324263:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826894.324266:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826894.324274:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713280 00000100:00100000:2.0:1787826894.324277:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713280 00000100:00100000:1.0:1787826894.324281:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143713536:12345-0@lo:400:kworker.0 Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826894.324288:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787826894.324305:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713024 00000100:00100000:2.0:1787826894.324308:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713024 00000100:00100000:0.0:1787826894.324315:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143713408:0@lo:8:kworker.0 00010000:00080000:1.0:1787826894.324327:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d369e00 x1874672143714048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826894.324335:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143714048:0@lo:400:kworker.0 00000100:00100000:2.0:1787826894.324339:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787826894.324347:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143713280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.324352:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.324379:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143713920:0@lo:8:kworker.0 00000100:00100000:2.0:1787826894.324394:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143713280:12345-0@lo:400:kworker.0 Request processed in 49us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.324399:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787826894.324414:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787826894.324415:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.324426:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143713024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.324443:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826894.324450:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787826894.324457:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787826894.324461:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:2.0:1787826894.324466:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143713024:12345-0@lo:400:kworker.0 Request processed in 42us (449us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826894.324467:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d544558f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826894.324475:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143712768:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826894.324479:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787826894.324511:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713408 00000100:00100000:0.0:1787826894.324514:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713408 00000100:00100000:0.0:1787826894.324542:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143713920 00000100:00100000:0.0:1787826894.324546:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143713920 00000100:00100000:0.0:1787826894.324569:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787826894.324575:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143713408:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787826894.324580:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143713024:0@lo:400:kworker.0 00000100:00100000:2.0:1787826894.324592:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143713664:0@lo:400:kworker.0 00000100:00100000:2.0:1787826894.324620:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143713280:0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.324625:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143713408:12345-0@lo:8:kworker.0 Request processed in 48us (275us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787826894.324639:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787826894.324651:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787826894.324655:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143713920:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787826894.324694:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143713920:12345-0@lo:8:kworker.0 Request processed in 36us (280us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787826894.324700:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787826894.324730:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143712896:0@lo:400:kworker.0 00000100:00080000:0.0:1787826894.324743:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00080000:2.0:1787826894.324744:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd4b40 x1874672143713536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826894.324752:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787826894.324757:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143713536:0@lo:400:kworker.0 00000100:00100000:0.0:1787826894.324759:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143713408:0@lo:8:kworker.0 00000100:00080000:0.0:1787826894.324778:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826894.324783:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826894.324785:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143713920:0@lo:8:kworker.0 00010000:00010000:3.0:1787826894.325349:0:20135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:3.0:1787826894.325501:0:20135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787826894.325524:0:20135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826894.325532:0:20135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a79540d6 00000100:00080000:3.0:1787826894.325541:0:20135:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826894.325544:0:20135:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d544558d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826894.325563:0:20135:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b11e00 x1874672143714176/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826894.325588:0:20135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787826894.325621:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143714176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826894.325660:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.325710:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143714176 00000100:00100000:2.0:1787826894.325714:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143714176 00000100:00100000:2.0:1787826894.325739:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000040:00080000:3.0:1787826894.325742:0:20135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 52 count 51 00000100:00100000:2.0:1787826894.325746:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1874672143714176:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787826894.325775:0:10060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:2.0:1787826894.325802:0:10060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a79540dd 00000004:00100000:2.0:1787826894.325814:0:10060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826894.325836:0:10060:0:(import.c:65:import_set_state_nolock()) ffff8d5343808800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826894.325880:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143714176:12345-0@lo:38:llog_process_th.0 Request processed in 134us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.325888:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1787826894.325901:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b11e00 x1874672143714176/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826894.325908:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826894.325912:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787826894.325916:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787826894.325919:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787826894.325921:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d544558d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826894.325927:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143714176:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787826894.325930:0:20124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787826894.325965:0:20124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826894.325984:0:20124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826894.325996:0:20124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826894.326053:0:20124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787826894.326056:0:20124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826894.326058:0:20124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826894.326059:0:20124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826894.326060:0:20124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826894.326062:0:20124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826894.326063:0:20124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826894.326065:0:20124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826894.326067:0:20124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826894.326070:0:20124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787826894.326073:0:20124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826894.326074:0:20124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826894.326076:0:20124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826894.326078:0:20124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826894.326079:0:20124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826894.326080:0:20124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826894.326082:0:20124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826894.326083:0:20124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826894.326089:0:20124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826894.326104:0:20124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787826894.326115:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143714304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826894.326156:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.326178:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54455f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826894.326198:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143714304 00000100:00100000:3.0:1787826894.326203:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143714304 00000100:00100000:3.0:1787826894.326265:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1787826894.326274:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143714304:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787826894.326294:0:9479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787826894.326305:0:9479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826894.327323:0:9479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826894.327342:0:9479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787826894.327368:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787826894.327374:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787826894.327392:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.327403:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.327411:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.327421:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.327429:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.327463:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.327488:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 9 pid: 6480 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826894.327499:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143714432:192.168.203.6@tcp:104: 00000100:00100000:2.0:1787826894.327543:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:20124:x1874672143714304:12345-0@lo:253:mount.lustre.0 Request processed in 1269us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.327553:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00010000:00010000:0.0:1787826894.327563:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.327570:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 24 pid: 6478 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826894.327577:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143714560:0@lo:104: 00000100:00100000:0.0:1787826894.327614:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.327622:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:20124:1874672143714304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826894.327636:0:20124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787826894.327640:0:20124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826894.327641:0:20124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826894.327643:0:20124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826894.327644:0:20124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826894.327646:0:20124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:0.0:1787826894.327649:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826894.327649:0:20124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826894.327651:0:20124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826894.327654:0:20124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826894.327657:0:20124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1787826894.327664:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 23 pid: 6480 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826894.327674:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143714688:0@lo:104: 00000020:02000000:2.0:1787826894.327679:0:20124:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787826894.327699:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.327719:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54480e6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826894.327808:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143714560 00000100:00100000:0.0:1787826894.327812:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143714560 00000100:00100000:0.0:1787826894.327844:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143714688 00000100:00100000:0.0:1787826894.327847:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143714688 00000100:00100000:1.0:1787826894.327865:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787826894.327876:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143714560:12345-0@lo:104: 00010000:00010000:1.0:1787826894.327887:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826894.327890:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826894.327903:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143714688:12345-0@lo:104: 00010000:00010000:0.0:1787826894.327913:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.327934:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826894.327940:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143714560:12345-0@lo:104: Request processed in 67us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826894.327948:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:0.0:1787826894.327959:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787826894.327964:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143714688:12345-0@lo:104: Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.327969:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1787826894.327991:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826894.327996:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.328012:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0a00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826894.328015:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.328022:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826894.328027:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826894.328031:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826894.328060:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.328066:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826894.328088:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826894.328092:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143714816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826894.328110:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0a00/0xc0fefc09a7953f6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953f71 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.328122:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826894.328126:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826894.328126:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826894.328133:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1800 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:0.0:1787826894.328136:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.328140:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826894.328144:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826894.328147:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826894.328167:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.328171:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826894.328180:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.328184:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1800/0xc0fefc09a7953f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7953f63 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826894.328192:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787826894.328198:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826894.328201:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143714944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826894.328206:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826894.328209:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826894.328245:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826894.328260:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826894.328278:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143714560:0@lo:104: 00000100:00100000:0.0:1787826894.328290:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143714688:0@lo:104: 00000100:00100000:3.0:1787826894.328996:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143714432:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787826894.329028:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826894.329300:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826894.331274:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143714816 00000100:00100000:3.0:1787826894.331282:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143714816 00010000:00010000:3.0:1787826894.331306:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 24 pid: 6478 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826894.331329:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143714944 00000100:00100000:3.0:1787826894.331332:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143714944 00000100:00100000:0.0:1787826894.331342:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196224 00010000:00010000:3.0:1787826894.331344:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 25 pid: 6480 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826894.331346:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196224 00010000:00010000:0.0:1787826894.331361:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 10 pid: 6480 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826894.331368:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787826894.331375:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143714816:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826894.331383:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00010000:00010000:3.0:1787826894.331387:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826894.331389:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143714944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826894.331392:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 25 pid: 6478 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331396:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826894.331400:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 61 00010000:00010000:0.0:1787826894.331402:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 25 pid: 6480 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826894.331414:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 25 pid: 6478 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826894.331415:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134196224:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826894.331427:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826894.331434:0:13703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 10 pid: 6480 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331443:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 25 pid: 6480 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826894.331459:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d3400/0xc0fefc09a7953f71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953f6a expref: 25 pid: 6478 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.331464:0:13703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 10 pid: 6480 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331488:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7953f63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7953f5c expref: 24 pid: 6480 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826894.331488:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826894.331497:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a7953f78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467537 expref: 10 pid: 6480 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331501:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331511:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826894.331518:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:0.0:1787826894.331523:0:6471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006998888s 00010000:00010000:0.0:1787826894.331529:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331542:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826894.331543:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143714816:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (3420us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826894.331549:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826894.331550:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1787826894.331555:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826894.331557:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+9:2391:x1874672134196224:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 146us (2257us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826894.331571:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1a00 already unused, calling callback (ffffffffc0e0f420) 00000100:00100000:1.0:1787826894.331575:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 61 00010000:00010000:0.0:1787826894.331576:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331586:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331600:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826894.331602:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143714816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826894.331609:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826894.331639:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143714944:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826894.331641:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143714944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826894.331646:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1787826894.331730:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331738:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826894.331743:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1a00/0xc0fefc09a79540e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787826894.334115:0:20124:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 21474836493 00010000:00080000:0.0:1787826894.334822:0:20141:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 20141 00010000:00080000:0.0:1787826894.334834:0:20141:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787826894.334837:0:20141:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:2.0:1787826894.334886:0:20124:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826894.334916:0:20124:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826894.334936:0:20124:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787826894.334949:0:20124:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787826894.335876:0:20124:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826894.336104:0:20124:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787826894.652559:0:20190:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826894.652758:0:20190:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787826894.929355:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826894.929377:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143715072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826894.929422:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826894.929434:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143715200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826894.929448:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826894.929479:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.929535:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715072 00000100:00100000:2.0:1787826894.929542:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715072 00000100:00100000:1.0:1787826894.929571:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143715328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826894.929600:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787826894.929609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826894.929614:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143715072:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826894.929658:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715328 00002000:00000024:2.0:1787826894.929662:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826894.929663:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715328 00000100:00100000:1.0:1787826894.929690:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787826894.929700:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143715328:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826894.929705:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715200 00000100:00100000:0.0:1787826894.929711:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715200 00002000:00000024:1.0:1787826894.929713:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826894.929717:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143715072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826894.929738:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787826894.929756:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143715328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.929767:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787826894.929767:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787826894.929780:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143715200:12345-0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787826894.929788:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5341f60000 x1874672143715072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826894.929804:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd7c00 x1874672143715328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:0.0:1787826894.929813:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787826894.929825:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143715328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826894.929825:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143715072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826894.929878:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143715200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826894.929886:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787826894.929892:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143715200:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826895.057321:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826895.633083:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826895.633122:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196352 00000100:00100000:3.0:1787826895.633130:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196352 00000100:00100000:3.0:1787826895.633173:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 452 00000100:00100000:3.0:1787826895.633180:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+9:10866:x1874672134196352:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826895.633194:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826895.633208:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467561 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.633260:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.633269:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.633276:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e079c00, rc 0) 00000100:00100000:3.0:1787826895.633327:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134196352:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 146us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.633340:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 452 00000100:00100000:0.0:1787826895.634207:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826895.634264:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196480 00000100:00100000:3.0:1787826895.634270:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196480 00000100:00100000:3.0:1787826895.634303:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 453 00000100:00100000:3.0:1787826895.634312:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134196480:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787826895.634326:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1787826895.634343:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787826895.634346:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787826895.634971:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134196480:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 660us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.634980:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 453 00000100:00100000:0.0:1787826895.635751:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826895.635788:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196608 00000100:00100000:3.0:1787826895.635799:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196608 00000100:00100000:3.0:1787826895.635829:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 160 00000100:00100000:3.0:1787826895.635835:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1874672134196608:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787826895.635857:0:8401:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d5344bda800, cookie 0xc0fefc09a7954097 00010000:00080000:3.0:1787826895.635864:0:8401:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t21474836491 exp ffff8d5344bda800 cur 270 last 1787826894 00010000:02000400:3.0:1787826895.635871:0:8401:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:3.0:1787826895.638547:0:8401:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:3.0:1787826895.638561:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d5344bda800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787826895.638570:0:8401:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787826895.638667:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8d544558a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826895.638715:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134196608:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 Request processed in 2880us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.638729:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 160 00000100:00100000:0.0:1787826895.647525:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826895.647592:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196736 00000100:00100000:1.0:1787826895.647602:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196736 00000100:00100000:1.0:1787826895.647666:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:1.0:1787826895.647674:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134196736:12345-192.168.203.6@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787826895.647695:0:19009:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d5343b0da40 x1874672134196736/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:496/0 lens 224/0 e 0 to 0 dl 1787826906 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826895.647717:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134196736:12345-192.168.203.6@tcp:400:ldlm_lock_repla.0 Request processed in 44us (201us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826895.647724:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 129 00010000:00080000:0.0:1787826895.647773:0:20141:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 10000000:01000000:0.0:1787826895.825391:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826895.825397:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 11 10000000:01000000:0.0:1787826895.825402:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826895.825443:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826895.825455:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826895.825466:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826895.825497:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826895.825560:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826895.825613:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826895.825640:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715456 00000100:00100000:1.0:1787826895.825648:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715456 00000100:00100000:1.0:1787826895.825710:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1787826895.825721:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143715456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826895.825745:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826895.825758:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79540f2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826895.825783:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826895.825794:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826895.825804:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345112400, rc 0) 00000100:00100000:1.0:1787826895.825863:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143715456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826895.825871:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1787826895.825882:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826895.825901:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.825912:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826895.825963:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787826895.826684:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.826713:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826895.826727:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715584 00000100:00100000:0.0:1787826895.826798:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715584 00000100:00100000:0.0:1787826895.826838:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1787826895.826847:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143715584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826895.826863:0:9479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826895.826880:0:9479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826895.826883:0:9479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787826895.827022:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143715584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826895.827031:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1787826895.827035:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715584:0@lo:256:ll_cfg_requeue.0 00000100:00080000:3.0:1787826895.827084:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 24, was 0): DISCONN 00010000:00080000:3.0:1787826895.827104:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:3.0:1787826895.827108:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826895.827112:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826895.827131:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b13840 x1874672143715712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1787826895.827168:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:2.0:1787826895.827174:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143715712:0@lo:8:ll_cfg_requeue.0 00010000:00010000:3.0:1787826895.827176:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.827196:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826895.827232:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787826895.827239:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826895.827241:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 11 10000000:01000000:3.0:1787826895.827244:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826895.827261:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.827268:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.827276:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826895.827303:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826895.827319:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715712 00000100:00100000:0.0:1787826895.827326:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715712 00000100:00100000:3.0:1787826895.827331:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826895.827364:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787826895.827366:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826895.827377:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143715712:12345-0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1787826895.827383:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715840 00000100:00100000:3.0:1787826895.827388:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715840 00010000:00080000:0.0:1787826895.827409:0:8402:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d5344bdc800, cookie 0xc0fefc09a7954089 00010000:00080000:0.0:1787826895.827416:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5344bdc800 cur 270 last 1787826894 00000100:00100000:3.0:1787826895.827433:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1787826895.827442:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143715840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826895.827449:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826895.827459:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7954100 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.827484:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.827493:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.827509:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e078200, rc 0) 00002000:00100000:0.0:1787826895.827529:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d5344bdc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787826895.827535:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787826895.827538:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787826895.827547:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143715840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.827554:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1787826895.827612:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826895.827624:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.827644:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826895.827694:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715968:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787826895.827701:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d546e145000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826895.827719:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.827746:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826895.827766:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143715968 00000100:00100000:0.0:1787826895.827770:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143715712:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 392us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826895.827775:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143715968 00010000:00080000:3.0:1787826895.827778:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b13840 x1874672143715712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826895.827796:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1787826895.827799:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 6 00000100:00080000:3.0:1787826895.827809:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1787826895.827813:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1787826895.827817:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:3.0:1787826895.827820:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00100000:1.0:1787826895.827825:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00080000:3.0:1787826895.827826:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787826895.827838:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143715968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826895.827852:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826895.827865:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826895.827869:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787826895.827947:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143715712:0@lo:8:ll_cfg_requeue.0 00000100:00100000:1.0:1787826895.827958:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143715968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (236us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826895.827963:0:20373:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1787826895.827969:0:20373:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00000100:00100000:1.0:1787826895.827969:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00010000:00010000:0.0:1787826895.827976:0:20373:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1787826895.827979:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143715968:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787826895.828026:0:20373:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1787826895.828027:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 24, was 0): DISCONN 00010000:00080000:3.0:1787826895.828037:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:3.0:1787826895.828041:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826895.828047:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826895.828064:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b13840 x1874672143716224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826895.828089:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143716096:0@lo:400:ldlm_lock_repla.0 10000000:01000000:3.0:1787826895.828096:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787826895.828101:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.828107:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826895.828113:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826895.828134:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143716224:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1787826895.828144:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716096 00000100:00100000:0.0:1787826895.828150:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716096 00000100:00100000:1.0:1787826895.828160:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826895.828197:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716224 00000100:00100000:0.0:1787826895.828201:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716224 00000100:00100000:3.0:1787826895.828245:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787826895.828257:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143716096:12345-0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787826895.828260:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787826895.828270:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143716224:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787826895.828274:0:9498:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d5344bd4b40 x1874672143716096/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:496/0 lens 224/0 e 0 to 0 dl 1787826906 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826895.828288:0:8401:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d5344bde800, cookie 0xc0fefc09a7954090 00000100:00100000:3.0:1787826895.828295:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143716096:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 40us (181us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826895.828302:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:1.0:1787826895.828306:0:8401:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5344bde800 cur 270 last 1787826894 00002000:00100000:1.0:1787826895.828318:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d5344bde800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1787826895.828320:0:20141:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00002000:00080000:1.0:1787826895.828326:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787826895.828329:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1787826895.828352:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8d5344bdf000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1787826895.828378:0:20141:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1787826895.828384:0:20141:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 21474836494 00010000:00080000:3.0:1787826895.828388:0:20141:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 21474836494 00010000:00080000:3.0:1787826895.828392:0:20141:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 21474836494 00000100:00100000:1.0:1787826895.828424:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143716224:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 153us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826895.828432:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00080000:0.0:1787826895.828463:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b13840 x1874672143716224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826895.828484:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 6 00000100:00080000:0.0:1787826895.828495:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787826895.828499:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1787826895.828502:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836490 gen 2 00000100:00080000:0.0:1787826895.828504:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 21474836490 last 0 00000100:00080000:0.0:1787826895.828507:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787826895.828653:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143716224:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826895.828659:0:20374:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1787826895.828663:0:20374:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1787826895.828667:0:20374:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1787826895.828705:0:20374:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787826895.828755:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143716352:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787826895.828785:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826895.828815:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716352 00000100:00100000:0.0:1787826895.828820:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716352 00000100:00100000:0.0:1787826895.828862:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787826895.828871:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143716352:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787826895.828887:0:19009:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d5344bd43c0 x1874672143716352/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:496/0 lens 224/0 e 0 to 0 dl 1787826906 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826895.828901:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143716352:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 33us (119us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826895.828906:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:1.0:1787826895.828913:0:20141:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 21474836494 00010000:00080000:1.0:1787826895.828916:0:20141:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:1.0:1787826895.828922:0:20141:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787826895.828924:0:20141:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787826895.829051:0:20141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00100000:3.0:1787826895.830619:0:20125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787826895.830626:0:20125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787826895.830630:0:20125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00080000:1.0:1787826895.830823:0:20141:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1787826895.830838:0:20141:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d5343b0da40 x1874672134196736/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:496/0 lens 224/0 e 0 to 0 dl 1787826906 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826895.830924:0:20141:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d5344bd4b40 x1874672143716096/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:496/0 lens 224/0 e 0 to 0 dl 1787826906 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826895.830976:0:20141:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d5344bd43c0 x1874672143716352/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:496/0 lens 224/0 e 0 to 0 dl 1787826906 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1787826895.831016:0:20141:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00010000:00080000:2.0:1787826895.831092:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0f840 x1874672143716352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826911 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826895.831106:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826895.831113:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d5343b0f840 x1874672143716352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826911 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826895.831122:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d5343b0f840 x1874672143716352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826911 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826895.831128:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1787826895.831143:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1787826895.831147:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000004:00080000:3.0:1787826895.832303:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 270695086675ns, next at 271695083764ns, rc = 0 00000100:00100000:3.0:1787826895.832335:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143716608:0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1787826895.832370:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.832389:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54757d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826895.832399:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143716480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826895.832416:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.832447:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716608 00000100:00100000:3.0:1787826895.832452:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716608 00000100:00100000:3.0:1787826895.832488:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787826895.832498:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143716608:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1787826895.832649:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716480 00000100:00100000:3.0:1787826895.832653:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716480 00000100:00100000:3.0:1787826895.832677:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787826895.832683:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143716480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826895.832697:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8388608 pending 0 free 3914092544 avail 3682570240 00000100:00100000:3.0:1787826895.832734:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143716480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.832741:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00080000:3.0:1787826895.832795:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b11680 x1874672143716480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826895.832812:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143716480:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1787826895.834721:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787826895.834732:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:3.0:1787826895.834787:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143716608:12345-0@lo:7:osp-pre-0-0.0 Request processed in 2288us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.834796:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:3.0:1787826895.834833:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b13840 x1874672143716608/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826911 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826895.834845:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143716608:0@lo:7:osp-pre-0-0.0 00000004:00080000:3.0:1787826895.834856:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x21:0x0] 00000100:00100000:3.0:1787826895.835320:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826895.835341:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143716736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826895.835379:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.835424:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716736 00000100:00100000:3.0:1787826895.835430:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716736 00000100:00100000:3.0:1787826895.835472:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787826895.835479:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143716736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826895.835499:0:19008:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:14 count 1 00002000:00010000:3.0:1787826895.835793:0:19008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 4194304, mtime: 0x6a9012a8, atime: 0x0, ctime: 0x6a9012a8, blocks: 0x2000 00010000:00010000:3.0:1787826895.835800:0:19008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.835812:0:19008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=270s v=(0 0) 00010000:00010000:3.0:1787826895.835816:0:19008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826895.835820:0:19008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.835831:0:19008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.835846:0:19008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.835851:0:19008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.835863:0:19008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826895.835959:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143716736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 481us (580us total) trans 25769803777 rc 0/0 00000100:00100000:3.0:1787826895.835963:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00010000:00010000:3.0:1787826895.835976:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826895.835980:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.835985:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079000 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826895.835988:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.836008:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.836019:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.836024:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028e43112/0xc0fefc09a795410e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826895.836042:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826895.836043:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826895.836044:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826895.836062:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d546e108b40/2, rc 0, transno 25769803777 00000100:00100000:3.0:1787826895.836067:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143716736:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826895.836962:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.837004:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706112 00000100:00100000:3.0:1787826895.837008:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706112 00002000:00080000:1.0:1787826895.837029:0:20141:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787826895.837035:0:20141:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:3.0:1787826895.837040:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787826895.837051:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143706112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826895.837069:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3914092544 avail 3682570240 00000100:00100000:3.0:1787826895.837122:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143706112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.837130:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787826895.837348:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143706112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826895.840924:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143716352:0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787826895.840964:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0e940 x1874672143716096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826911 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826895.840985:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826895.841005:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d5343b0e940 x1874672143716096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826911 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826895.841014:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d5343b0e940 x1874672143716096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826911 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826895.841022:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1787826895.841035:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1787826895.841038:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1787826895.841044:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009f8725f1): req@ffff8d5343b59a40 x1874672143706240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787826898 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826895.841061:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143716096:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826895.841138:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143716992:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787826895.841150:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.841182:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826895.841184:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826895.841193:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143716864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826895.841241:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442ab3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826895.841254:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826895.841263:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716992 00000100:00100000:3.0:1787826895.841270:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716992 00000100:00100000:2.0:1787826895.841287:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143706240 00000100:00100000:2.0:1787826895.841292:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143706240 00000100:00100000:3.0:1787826895.841323:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787826895.841326:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143716864 00000100:00100000:2.0:1787826895.841330:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143716864 00000100:00100000:3.0:1787826895.841345:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:9485:x1874672143716992:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787826895.841349:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787826895.841359:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3618:x1874672143706240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826895.841375:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3914092544 avail 3682570240 00000100:00100000:2.0:1787826895.841415:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3618:x1874672143706240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826895.841422:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787826895.841446:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787826895.841453:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143716864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826895.841463:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3914092544 avail 3682570240 00000100:00100000:2.0:1787826895.841491:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143716864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826895.841497:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787826895.841548:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143716864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826895.841558:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143706240:0@lo:13:osp-pre-0-1.0 00002000:00080000:3.0:1787826895.842663:0:8401:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787826895.842669:0:8401:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787826895.842720:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143716992:12345-0@lo:7:osp-pre-0-1.0 Request processed in 1387us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826895.842728:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787826895.842751:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143716992:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787826895.842763:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787826895.954318:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143717120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826895.954375:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826895.954410:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143717120 00000100:00100000:0.0:1787826895.954416:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143717120 00000100:00100000:0.0:1787826895.954454:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787826895.954461:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143717120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826895.954485:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826895.954526:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143717120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826895.954532:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787826895.954565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143717120:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826896.081318:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826896.301760:0:20481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1787826896.626914:0:20533:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826896.627132:0:20533:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1787826896.961690:0:20583:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826896.961833:0:20583:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787826897.105461:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826898.129367:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826898.333297:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826898.333402:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196864 00000100:00100000:0.0:1787826898.333411:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196864 00000100:00100000:0.0:1787826898.333486:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00100000:0.0:1787826898.333497:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+9:17216:x1874672134196864:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787826898.333530:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826898.333595:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+9:17216:x1874672134196864:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826898.333600:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00080000:2.0:1787826898.333650:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826898.334935:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826898.335017:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134196992 00000100:00100000:2.0:1787826898.335023:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134196992 00000100:00080000:0.0:1787826898.335068:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826898.335081:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 116 00000100:00100000:2.0:1787826898.335091:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17216:x1874672134196992:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787826898.335115:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826898.335160:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17216:x1874672134196992:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826898.335165:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 116 00000100:00100000:3.0:1787826898.336676:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826898.336759:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134197120 00000100:00100000:2.0:1787826898.336765:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134197120 00000100:00080000:0.0:1787826898.336812:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826898.336818:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:2.0:1787826898.336829:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17216:x1874672134197120:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826898.336852:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:2.0:1787826898.336908:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17216:x1874672134197120:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826898.336931:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:0.0:1787826898.338037:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826898.338098:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134197248 00000100:00100000:2.0:1787826898.338104:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134197248 00000100:00100000:2.0:1787826898.338143:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00080000:0.0:1787826898.338144:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826898.338149:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17216:x1874672134197248:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826898.338174:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826898.338241:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17216:x1874672134197248:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826898.338246:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 148 00010000:00010000:3.0:1787826899.153388:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826899.345104:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826899.345156:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134197504 00000100:00100000:2.0:1787826899.345165:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134197504 00000100:00100000:0.0:1787826899.345201:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826899.345248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 245 00000100:00100000:2.0:1787826899.345261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134197504:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826899.345272:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826899.345297:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134197376 00000100:00100000:0.0:1787826899.345303:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826899.345303:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134197376 00000100:00100000:2.0:1787826899.345337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134197504:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826899.345347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 245 00000100:00100000:0.0:1787826899.345352:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826899.345358:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 458 00000100:00100000:3.0:1787826899.345369:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134197376:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826899.345370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134197632 00000100:00100000:2.0:1787826899.345376:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134197632 00000100:00100000:2.0:1787826899.345406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 246 00000100:00100000:3.0:1787826899.345411:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134197376:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826899.345419:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134197632:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826899.345424:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 458 00000100:00100000:3.0:1787826899.345464:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134197760 00000100:00100000:3.0:1787826899.345469:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134197760 00000100:00100000:0.0:1787826899.345484:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134197888 00000100:00100000:2.0:1787826899.345485:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134197632:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826899.345490:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134197888 00000100:00100000:2.0:1787826899.345495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 246 00000100:00100000:3.0:1787826899.345575:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 132 00000100:00100000:0.0:1787826899.345583:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 133 00000100:00100000:3.0:1787826899.345588:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134197760:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826899.345599:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134197888:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826899.345646:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134197888:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826899.345653:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 133 00000100:00100000:3.0:1787826899.345712:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134197760:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 129us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826899.345755:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 132 00000100:00100000:1.0:1787826899.538353:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143717248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.538431:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143717376:0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.538443:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826899.538480:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143717504:0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.538482:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826899.538507:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143717760:0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.538550:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143717888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.538572:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826899.538581:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143717248 00000100:00100000:0.0:1787826899.538587:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826899.538589:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143717248 00000100:00100000:2.0:1787826899.538618:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143718016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.538646:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826899.538655:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1787826899.538669:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143717248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.538677:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143718400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.538686:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143718528:0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.538728:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143717248:12345-0@lo:400:kworker.0 Request processed in 63us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826899.538732:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826899.538741:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1787826899.538746:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143717888 00000100:00100000:3.0:1787826899.538748:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143717376 00000100:00100000:2.0:1787826899.538752:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143717888 00000100:00100000:3.0:1787826899.538755:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143717376 00000100:00100000:1.0:1787826899.538783:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143717504 00000100:00100000:0.0:1787826899.538795:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143717632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.538795:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143717504 00000100:00100000:2.0:1787826899.538798:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718016 00000100:00100000:3.0:1787826899.538802:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787826899.538803:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718016 00000100:00100000:3.0:1787826899.538817:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143717376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.538831:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718400 00000100:00100000:2.0:1787826899.538835:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718400 00000100:00100000:1.0:1787826899.538839:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787826899.538841:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826899.538852:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143717504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.538862:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787826899.538871:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143717888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.538882:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143718144:0@lo:400:kworker.0 00000100:00100000:3.0:1787826899.538884:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143717376:12345-0@lo:400:kworker.0 Request processed in 72us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826899.538902:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787826899.538906:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143717504:12345-0@lo:400:kworker.0 Request processed in 55us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826899.538923:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143717888:12345-0@lo:400:kworker.0 Request processed in 51us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826899.538925:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143717632 00000100:00100000:1.0:1787826899.538926:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787826899.538927:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826899.538932:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143717632 00000100:00100000:2.0:1787826899.538945:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787826899.538962:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143718656:0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.538973:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826899.538976:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718144 00000100:00100000:2.0:1787826899.538979:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787826899.538982:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718144 00000100:00100000:2.0:1787826899.538991:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143718016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.539004:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143718272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826899.539012:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787826899.539013:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826899.539026:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e071680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143717632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.539041:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143718016:12345-0@lo:400:kworker.0 Request processed in 53us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826899.539048:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826899.539051:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787826899.539068:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143718784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.539071:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787826899.539079:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e071680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143717632:12345-0@lo:400:kworker.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826899.539086:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143718400:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826899.539090:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826899.539092:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1787826899.539099:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826899.539103:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826899.539105:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826899.539112:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718656 00000100:00100000:3.0:1787826899.539116:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718656 00000100:00100000:2.0:1787826899.539133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718272 00000100:00100000:1.0:1787826899.539135:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143717248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.539141:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143718400:12345-0@lo:400:kworker.0 Request processed in 58us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826899.539143:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718784 00000100:00100000:2.0:1787826899.539145:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718272 00000100:00100000:3.0:1787826899.539150:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718784 00000100:00100000:0.0:1787826899.539157:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787826899.539180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787826899.539187:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787826899.539189:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143717760 00000100:00100000:2.0:1787826899.539190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e071a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143718144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.539196:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143717760 00000100:00100000:3.0:1787826899.539202:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143718656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.539207:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143717632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.539254:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787826899.539264:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143717760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826899.539287:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143718656:12345-0@lo:400:kworker.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826899.539294:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787826899.539317:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143717760:12345-0@lo:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826899.539321:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787826899.539329:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787826899.539332:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143718656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826899.539335:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143718272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.539367:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143717760:0@lo:400:kworker.0 00000100:00100000:3.0:1787826899.539378:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143718272:12345-0@lo:400:kworker.0 Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826899.539386:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00010000:00080000:1.0:1787826899.539388:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74f480 x1874672143718272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826899.539396:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787826899.539401:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143718784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.539410:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143718272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.539444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e071a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143718144:12345-0@lo:400:kworker.0 Request processed in 257us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826899.539451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787826899.539464:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143718784:12345-0@lo:400:kworker.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826899.539473:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:2.0:1787826899.539474:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826899.539479:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787826899.539482:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74e1c0 x1874672143718784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826899.539493:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143718784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.539505:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143718144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826899.539508:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826899.539534:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143718400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.539551:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718528 00000100:00100000:1.0:1787826899.539553:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143717376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.539555:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718528 00000100:00100000:0.0:1787826899.539559:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143717504:0@lo:400:kworker.0 00000100:00100000:1.0:1787826899.539576:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143717888:0@lo:400:kworker.0 00010000:00080000:0.0:1787826899.539582:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b11680 x1874672143718016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826899.539594:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143718016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.539599:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787826899.539610:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143718528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826899.539647:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143718528:12345-0@lo:400:kworker.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826899.539654:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:0.0:1787826899.539662:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74cb40 x1874672143718528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826899.539672:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826899.539673:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143718528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826900.049374:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143719168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826900.049376:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143719040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826900.049473:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826900.049537:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143719168 00000100:00100000:2.0:1787826900.049547:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143719168 00000100:00100000:1.0:1787826900.049600:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826900.049612:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143719040 00000100:00100000:2.0:1787826900.049616:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143719040 00000100:00100000:1.0:1787826900.049627:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143718912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826900.049642:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787826900.049654:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143719168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826900.049658:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787826900.049691:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826900.049700:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143718912 00000100:00100000:1.0:1787826900.049710:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143718912 00000100:00100000:3.0:1787826900.049728:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787826900.049741:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143719040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826900.049749:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787826900.049750:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143719168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (278us total) trans 0 rc 0/0 00002000:00000024:3.0:1787826900.049756:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826900.049761:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143718912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826900.049761:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000004:00000024:1.0:1787826900.049793:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00010000:00080000:2.0:1787826900.049817:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534486f840 x1874672143719168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826900.049838:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143719168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826900.049862:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143719040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826900.049869:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787826900.049877:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143718912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826900.049885:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00080000:2.0:1787826900.049890:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d36cb40 x1874672143719040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826900.049902:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143719040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826900.049915:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143718912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787826900.177417:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826900.328884:0:20776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000001:02000400:0.0:1787826900.917540:0:20824:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1787826901.073389:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787826901.073409:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143719424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826901.073467:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826901.073511:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143719424 00000100:00100000:1.0:1787826901.073514:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143719296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826901.073530:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143719424 00000100:00100000:1.0:1787826901.073538:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826901.073564:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143719552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826901.073571:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143719296 00000100:00100000:2.0:1787826901.073578:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143719296 00000100:00100000:1.0:1787826901.073582:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826901.073595:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787826901.073607:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143719424:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826901.073614:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143719552 00000100:00100000:1.0:1787826901.073618:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143719552 00000100:00080000:3.0:1787826901.073628:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826901.073638:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000004:00000024:0.0:1787826901.073646:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826901.073648:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143719296:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826901.073654:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787826901.073669:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143719552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826901.073670:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00002000:00000024:3.0:1787826901.073689:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:0.0:1787826901.073710:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143719424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826901.073719:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787826901.073725:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143719296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826901.073732:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143719552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826901.073737:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787826901.073745:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787826901.073757:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143719424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826901.073775:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143719296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826901.073784:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143719552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787826901.201383:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826902.098266:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000001:00080000:0.0:1787826902.098364:0:20125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803777 is committed 00010000:00010000:3.0:1787826902.225343:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826902.227148:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826902.227185:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134198016 00000100:00100000:3.0:1787826902.227194:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134198016 00000100:00080000:2.0:1787826902.227254:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826902.227280:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 117 00000100:00100000:3.0:1787826902.227287:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:17684:x1874672134198016:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787826902.227316:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826902.227383:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:17684:x1874672134198016:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826902.227392:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 117 00000100:00100000:2.0:1787826902.228337:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826902.228397:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134198144 00000100:00100000:1.0:1787826902.228403:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134198144 00000100:00080000:2.0:1787826902.228445:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826902.228460:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 118 00000100:00100000:1.0:1787826902.228469:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17684:x1874672134198144:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787826902.228502:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826902.228544:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17684:x1874672134198144:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826902.228550:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 118 00000100:00100000:2.0:1787826902.229799:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826902.229852:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134198272 00000100:00100000:1.0:1787826902.229858:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134198272 00000100:00080000:2.0:1787826902.229903:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826902.229909:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 153 00000100:00100000:1.0:1787826902.229920:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17684:x1874672134198272:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787826902.229942:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:1.0:1787826902.229997:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17684:x1874672134198272:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826902.230004:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 153 00000100:00100000:2.0:1787826902.231199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826902.231261:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134198400 00000100:00100000:3.0:1787826902.231272:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134198400 00000100:00080000:2.0:1787826902.231327:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826902.231344:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:3.0:1787826902.231355:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17684:x1874672134198400:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826902.231405:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826902.231464:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:17684:x1874672134198400:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826902.231472:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:2.0:1787826902.248976:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826902.249081:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134198528 00000100:00100000:0.0:1787826902.249098:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134198528 00000100:00100000:0.0:1787826902.249182:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:0.0:1787826902.249196:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134198528:12345-192.168.203.6@tcp:101:rm.0 00010000:00010000:0.0:1787826902.249262:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826902.249294:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467568 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826902.249792:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 5242880, mtime: 0x6a9012c0, atime: 0x0, ctime: 0x6a9012c0, blocks: 0x2800 00010000:00010000:0.0:1787826902.249829:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1787826902.249833:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826902.249845:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.249868:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.249883:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1600, rc 0) 00000100:00100000:0.0:1787826902.249967:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134198528:12345-192.168.203.6@tcp:101:rm.0 Request processed in 774us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826902.249973:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:2.0:1787826902.251613:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826902.251675:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134198784 00000100:00100000:3.0:1787826902.251682:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134198784 00000100:00100000:3.0:1787826902.251725:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00100000:3.0:1787826902.251734:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+9:17700:x1874672134198784:12345-192.168.203.6@tcp:35:rm.0 00000100:00100000:3.0:1787826902.251986:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:17700:x1874672134198784:12345-192.168.203.6@tcp:35:rm.0 Request processed in 251us (372us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787826902.251992:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00100000:2.0:1787826902.253106:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826902.253157:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199040 00000100:00100000:0.0:1787826902.253163:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199040 00000100:00100000:0.0:1787826902.253201:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:0.0:1787826902.253209:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:17700:x1874672134199040:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:0.0:1787826902.253281:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787826902.253349:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795404a lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467553 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253368:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795402e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467545 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253379:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff8d54745a9c00) 00010000:00010000:0.0:1787826902.253389:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826902.253423:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253436:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253445:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253470:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253477:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253500:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253569:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 3/0,1 mode: --/EX res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253577:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253584:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826902.253753:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000004:00080000:0.0:1787826902.253763:0:6485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 277116547304ns, next at 278116545341ns, rc = 0 00010000:00010000:0.0:1787826902.253798:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253807:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253816:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253822:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253829:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253835:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253864:0:6485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826902.253880:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253887:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.253891:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826902.253894:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.253899:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253902:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826902.253908:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.253912:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0600 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826902.253918:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253920:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.253935:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253937:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff8d5450fb5100) 00010000:00010000:0.0:1787826902.253944:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826902.253961:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 2/0,0 mode: --/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.253965:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff8d5450fb5100) 00010000:00010000:0.0:1787826902.253969:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a795412a lrc: 0/0,0 mode: --/EX res: [0x200000403:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.253970:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826902.253976:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.253983:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0600/0xc0fefc09a7954131 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.253986:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.254001:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.254009:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826902.254013:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826902.254016:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826902.254019:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826902.254025:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826902.254029:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.254035:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.254044:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787826902.254046:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826902.254049:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.254055:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a795411c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826902.254066:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a17a99a reply state 0000000089aac56e transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.254075:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826902.254081:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee27d887 (ffff8d5450fb5800) 00010000:00010000:0.0:1787826902.254084:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826902.254086:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826902.254135:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:17700:x1874672134199040:12345-192.168.203.6@tcp:36:rm.0 Request processed in 927us (1030us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787826902.254142:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 119 00010000:00010000:0.0:1787826903.249396:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826904.274352:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826904.413048:0:21018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 5: Fail OST during iozone ====== 06:35:03 (1787826903) 00000100:00100000:0.0:1787826904.465722:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.465773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.465804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.465832:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.465864:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199168 00000100:00100000:0.0:1787826904.465876:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.465883:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199168 00000100:00100000:0.0:1787826904.465907:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199424 00000100:00100000:0.0:1787826904.465917:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199424 00000100:00100000:3.0:1787826904.465997:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 460 00000100:00100000:0.0:1787826904.466006:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199296 00000100:00100000:0.0:1787826904.466016:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199296 00000100:00100000:3.0:1787826904.466016:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134199168:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826904.466058:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 253 00000100:00100000:0.0:1787826904.466071:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134199424:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826904.466145:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134199168:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 136us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.466157:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134199424:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 83us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826904.466159:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199680 00000100:00100000:2.0:1787826904.466167:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199680 00000100:00100000:3.0:1787826904.466169:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 460 00000100:00100000:0.0:1787826904.466182:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 253 00000100:00100000:0.0:1787826904.466209:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:0.0:1787826904.466256:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134199296:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826904.466262:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199552 00000100:00100000:2.0:1787826904.466268:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199552 00000100:00100000:0.0:1787826904.466300:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134199296:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.466308:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:2.0:1787826904.466313:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 138 00000100:00100000:2.0:1787826904.466329:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134199680:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826904.466361:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 139 00000100:00100000:2.0:1787826904.466375:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134199680:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 51us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.466378:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134199552:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826904.466393:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 138 00000100:00100000:0.0:1787826904.466428:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134199552:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 55us (554us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826904.466430:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826904.466438:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826904.466439:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 139 00000100:00080000:2.0:1787826904.466442:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826904.466446:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826904.471009:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.471057:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199808 00000100:00100000:3.0:1787826904.471076:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199808 00000100:00100000:3.0:1787826904.471132:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 155 00000100:00100000:3.0:1787826904.471139:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:18289:x1874672134199808:12345-192.168.203.6@tcp:13:lctl.0 00002000:00000024:3.0:1787826904.471177:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:3.0:1787826904.471343:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:18289:x1874672134199808:12345-192.168.203.6@tcp:13:lctl.0 Request processed in 200us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826904.471356:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 155 00000100:00100000:2.0:1787826904.472275:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.472334:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134199936 00000100:00100000:0.0:1787826904.472343:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134199936 00000100:00100000:0.0:1787826904.472402:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 156 00000100:00100000:0.0:1787826904.472423:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:18289:x1874672134199936:12345-192.168.203.6@tcp:13:lctl.0 00002000:00000024:0.0:1787826904.472455:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826904.472533:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:18289:x1874672134199936:12345-192.168.203.6@tcp:13:lctl.0 Request processed in 114us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.472542:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 156 00000100:00100000:0.0:1787826904.577631:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826904.577700:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134200192 00000100:00100000:2.0:1787826904.577709:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134200192 00000100:00100000:2.0:1787826904.577759:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:2.0:1787826904.577765:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:18296:x1874672134200192:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:2.0:1787826904.577781:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826904.577804:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954138 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346756f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.577896:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.577909:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.577920:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.577998:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578006:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578013:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826904.578308:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x10:0x0], index 0: 0 00010000:00010000:2.0:1787826904.578449:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795414d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578458:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795414d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578465:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795414d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578493:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578499:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578505:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578511:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826904.578516:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578532:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578543:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826904.578546:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826904.578550:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578556:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a795413f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826904.578578:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000643d5c8a reply state 000000002aa8d96c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578588:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578594:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428ded00) 00010000:00010000:2.0:1787826904.578596:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826904.578598:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826904.578623:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954138 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346756f expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578636:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795414d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346756f expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.578643:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d53428de700) 00010000:00010000:2.0:1787826904.578645:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826904.578647:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3a00, rc 0) 00000100:00100000:2.0:1787826904.578700:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+13:18296:x1874672134200192:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 934us (1076us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787826904.578715:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:2.0:1787826904.580247:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.580307:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134200320 00000100:00100000:0.0:1787826904.580313:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134200320 00000100:00100000:0.0:1787826904.580348:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 167 00000100:00100000:0.0:1787826904.580357:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134200320:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:0.0:1787826904.580368:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826904.580382:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467576 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826904.580694:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826904.580712:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=279s v=(0 0) 00010000:00010000:0.0:1787826904.580716:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826904.580725:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 7 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.580741:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 7 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.580753:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1c00, rc 0) 00000100:00100000:0.0:1787826904.580790:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2390:x1874672134200320:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 435us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.580805:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 167 00000100:00100000:0.0:1787826904.581783:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826904.581840:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134200576 00000100:00100000:1.0:1787826904.581847:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134200576 00000100:00100000:1.0:1787826904.581882:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 121 00000100:00100000:1.0:1787826904.581891:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+13:18296:x1874672134200576:12345-192.168.203.6@tcp:36:iozone.0 00010000:00010000:1.0:1787826904.581939:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826904.581959:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795414d lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346756f expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.581973:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d53428de700) 00010000:00010000:1.0:1787826904.581982:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826904.582105:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.582115:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.582127:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826904.582156:0:10060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000004:00010000:1.0:1787826904.582170:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bebb02d reply state 00000000a055df4e transno 4294967380 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.582177:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.582181:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d5453332c00) 00010000:00010000:1.0:1787826904.582183:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826904.582185:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826904.582268:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+15:18296:x1874672134200576:12345-192.168.203.6@tcp:36:iozone.0 Request processed in 379us (485us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787826904.582275:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 121 00000020:00080000:1.0:1787826904.582280:0:10060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826904.583020:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.583068:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134200704 00000100:00100000:0.0:1787826904.583074:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134200704 00000100:00100000:0.0:1787826904.583104:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:0.0:1787826904.583112:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+15:18296:x1874672134200704:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:0.0:1787826904.583125:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826904.583136:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954169 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346757d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.583167:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954169 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346757d expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.583176:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954169 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346757d expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.583186:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d5453332c00) 00010000:00010000:0.0:1787826904.583188:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826904.583190:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0000, rc 0) 00000100:00100000:0.0:1787826904.583244:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:18296:x1874672134200704:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 104us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.583252:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:2.0:1787826904.586078:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.586142:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134200832 00000100:00100000:0.0:1787826904.586150:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134200832 00000100:00100000:0.0:1787826904.586196:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 168 00000100:00100000:0.0:1787826904.586207:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:18296:x1874672134200832:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:0.0:1787826904.586280:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826904.586297:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467584 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.586326:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 8 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.586343:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826904.586347:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826904.586353:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.586384:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 8 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.586406:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 8 pid: 8399 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.586419:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8402:1874672143719680:192.168.203.6@tcp:104: 00000100:00100000:0.0:1787826904.586498:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826904.587641:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8402:1874672143719680:192.168.203.6@tcp:104: 00010000:00010000:0.0:1787826904.587682:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.587698:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0600, rc 0) 00000100:00100000:0.0:1787826904.587947:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:18296:x1874672134200832:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 1740us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.587955:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 168 00000100:00100000:2.0:1787826904.588486:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.588558:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134200960 00000100:00100000:3.0:1787826904.588570:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134200960 00010000:00010000:3.0:1787826904.588608:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 8 pid: 8399 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826904.588639:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:3.0:1787826904.588649:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134200960:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826904.588692:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826904.588699:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 8 pid: 8399 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.588716:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 8 pid: 8399 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.588750:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d4bade8/0xc0fefc09a795415b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467576 expref: 8 pid: 8399 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.588767:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826904.588773:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826904.588780:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.588790:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.588829:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826904.588844:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6470:1874672143719808:192.168.203.6@tcp:105: 00000100:00100000:3.0:1787826904.588923:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5476386f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826904.590301:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6470:1874672143719808:192.168.203.6@tcp:105: 00010000:00010000:3.0:1787826904.590324:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826904.590398:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134200960:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 1746us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826904.590473:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:2.0:1787826904.590511:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.590568:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134201088 00000100:00100000:0.0:1787826904.590575:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134201088 00002000:00010000:0.0:1787826904.590607:0:8407:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/16 (0->18446744073709551615) 00002000:00100000:0.0:1787826904.590612:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f995e00 with x1874672134201088 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826904.590620:0:8407:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f995e00. 00000100:00100000:0.0:1787826904.590642:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:0.0:1787826904.590662:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f995e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134201088:12345-192.168.203.6@tcp:10:iozone.0 00002000:00010000:0.0:1787826904.590819:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826904.590822:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10:0x0] updating lvb mtime from disk: 0 -> 1787826904 00002000:00010000:0.0:1787826904.590824:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826904.590825:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10:0x0] updating lvb ctime from disk: 0 -> 1787826904 00002000:00010000:0.0:1787826904.590826:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826904.590866:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f995e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134201088:12345-192.168.203.6@tcp:10:iozone.0 Request processed in 208us (362us total) trans 25769803778 rc 0/0 00000100:00100000:0.0:1787826904.590871:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00002000:00010000:0.0:1787826904.590874:0:8407:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/16 (0->18446744073709551615) 00002000:00100000:0.0:1787826904.590877:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f995e00 with x1874672134201088 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826904.590882:0:8407:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f995e00. 00000100:00100000:2.0:1787826904.591867:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.591903:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134201344 00000100:00100000:3.0:1787826904.591909:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134201344 00000100:00100000:3.0:1787826904.591955:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:3.0:1787826904.591964:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:18296:x1874672134201344:12345-192.168.203.6@tcp:35:iozone.0 00000100:00100000:3.0:1787826904.592124:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+17:18296:x1874672134201344:12345-192.168.203.6@tcp:35:iozone.0 Request processed in 161us (258us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1787826904.592132:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:2.0:1787826904.593038:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.593089:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134201472 00000100:00100000:0.0:1787826904.593093:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134201472 00000100:00100000:0.0:1787826904.593123:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 123 00000100:00100000:0.0:1787826904.593131:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:18296:x1874672134201472:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:0.0:1787826904.593144:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826904.593178:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7954177 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346758b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593259:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593273:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593284:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593295:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593301:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593306:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593371:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a795418c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593380:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a795418c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593384:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a795418c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826904.593411:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0xf:0x0]: returning size 0 00000004:00200000:0.0:1787826904.593415:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826904.593432:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a795418c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593455:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a795418c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593466:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593472:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593478:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593483:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826904.593488:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593495:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593506:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787826904.593508:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826904.593512:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593516:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a795417e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593525:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593528:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593536:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593539:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826904.593541:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593545:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593549:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428ded00) 00010000:00010000:0.0:1787826904.593551:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826904.593552:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593556:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593577:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a7954177 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346758b expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593588:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a795418c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346758b expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.593595:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d5453332c00) 00010000:00010000:0.0:1787826904.593597:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826904.593600:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0a00, rc 0) 00000100:00100000:0.0:1787826904.593633:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:18296:x1874672134201472:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 504us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.593646:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 123 00000100:00100000:2.0:1787826904.594975:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826904.595032:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134201728 00000100:00100000:1.0:1787826904.595038:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134201728 00000100:00100000:1.0:1787826904.595076:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 124 00000100:00100000:1.0:1787826904.595086:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+18:18296:x1874672134201728:12345-192.168.203.6@tcp:36:iozone.0 00010000:00010000:1.0:1787826904.595120:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787826904.595138:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0a00/0xc0fefc09a795418c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346758b expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595157:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954169 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346757d expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595181:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d5453332c00) 00010000:00010000:1.0:1787826904.595186:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826904.595201:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595210:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595249:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595262:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595270:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595287:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595341:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595350:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595357:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826904.595530:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000004:00080000:1.0:1787826904.595541:0:10060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 279458325081ns, next at 280458322599ns, rc = 0 00010000:00010000:1.0:1787826904.595597:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595608:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595615:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595623:0:10060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595629:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595635:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595662:0:10060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826904.595679:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595686:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.595689:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826904.595695:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.595698:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595705:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787826904.595707:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826904.595711:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.595712:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.595728:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595730:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.595736:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d5453332c00) 00010000:00010000:3.0:1787826904.595740:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826904.595743:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.595751:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a79541a8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595756:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d5453332c00) 00010000:00010000:3.0:1787826904.595759:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826904.595760:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826904.595764:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.595766:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826904.595769:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826904.595776:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541a1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595792:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595799:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595805:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595810:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826904.595814:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595820:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595827:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787826904.595829:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826904.595832:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595837:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954193 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826904.595859:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a39dc73 reply state 00000000514d9915 transno 4294967382 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595869:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.595915:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428ded00) 00010000:00010000:1.0:1787826904.595918:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826904.595921:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826904.595980:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+18:18296:x1874672134201728:12345-192.168.203.6@tcp:36:iozone.0 Request processed in 896us (1007us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1787826904.595988:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 124 00000100:00100000:2.0:1787826904.597186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.597261:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134201984 00000100:00100000:0.0:1787826904.597268:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134201984 00000100:00100000:0.0:1787826904.597307:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 125 00000100:00100000:0.0:1787826904.597316:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+18:18296:x1874672134201984:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:0.0:1787826904.597333:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826904.597346:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79541af lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467592 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597410:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597420:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597429:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597438:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597445:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597452:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826904.597685:0:6486:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x11:0x0], index 0: 0 00010000:00010000:0.0:1787826904.597798:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597815:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597823:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597853:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597860:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597866:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597872:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826904.597875:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597882:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597892:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787826904.597895:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826904.597898:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597904:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79541b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826904.597915:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003714b4b8 reply state 00000000a8218a3f transno 4294967383 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597943:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597950:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428ded00) 00010000:00010000:0.0:1787826904.597952:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826904.597955:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826904.597978:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79541af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.597993:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.598000:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:0.0:1787826904.598002:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826904.598004:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0c00, rc 0) 00000100:00100000:0.0:1787826904.598051:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+21:18296:x1874672134201984:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 736us (872us total) trans 4294967383 rc 0/0 00000100:00100000:0.0:1787826904.598058:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 125 00000100:00100000:2.0:1787826904.599377:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.599407:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134202240 00000100:00100000:3.0:1787826904.599413:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134202240 00000100:00100000:3.0:1787826904.599441:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 37 00000100:00100000:3.0:1787826904.599446:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+21:18296:x1874672134202240:12345-192.168.203.6@tcp:35:iozone.0 00000100:00100000:3.0:1787826904.599590:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:18296:x1874672134202240:12345-192.168.203.6@tcp:35:iozone.0 Request processed in 142us (213us total) trans 4294967384 rc 0/0 00000100:00100000:3.0:1787826904.599597:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 37 00000100:00100000:2.0:1787826904.600571:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.600604:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134202496 00000100:00100000:0.0:1787826904.600608:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134202496 00000100:00100000:0.0:1787826904.600631:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:0.0:1787826904.600636:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:18296:x1874672134202496:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:0.0:1787826904.600645:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826904.600658:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a79541d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467599 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.600726:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.600741:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.600747:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.600769:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.600778:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 23 pid: 6486 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.600787:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6485:1874672143719936:192.168.203.6@tcp:104: 00000100:00100000:0.0:1787826904.600829:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826904.601669:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6485:1874672143719936:192.168.203.6@tcp:104: 00010000:00010000:0.0:1787826904.601701:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.601881:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.601919:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134202624 00000100:00100000:0.0:1787826904.601923:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134202624 00010000:00010000:0.0:1787826904.601949:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 24 pid: 6486 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.601970:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:0.0:1787826904.601975:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f995680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2391:x1874672134202624:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826904.601982:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826904.601991:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 24 pid: 6486 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.602000:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 24 pid: 6486 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.602013:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79541c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467592 expref: 24 pid: 6486 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.602021:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:0.0:1787826904.602025:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.602033:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.602039:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.602062:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826904.602095:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.602096:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f995680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+23:2391:x1874672134202624:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 118us (214us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826904.602112:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.602117:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 63 00000004:00200000:2.0:1787826904.602130:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 0 00010000:00010000:2.0:1787826904.602207:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0200/0xc0fefc09a79541d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.602253:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.602262:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:2.0:1787826904.602265:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826904.602275:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1000, rc 0) 00000100:00100000:2.0:1787826904.602310:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+23:18296:x1874672134202496:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 1672us (1741us total) trans 4294967385 rc 0/0 00000100:00100000:2.0:1787826904.602336:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:2.0:1787826904.603267:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826904.603303:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134202752 00000100:00100000:1.0:1787826904.603308:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134202752 00000100:00100000:1.0:1787826904.603343:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 127 00000100:00100000:1.0:1787826904.603352:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+23:18296:x1874672134202752:12345-192.168.203.6@tcp:44:iozone.0 00000001:00080000:0.0:1787826904.604531:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967385 is committed 00000004:00080000:0.0:1787826904.604547:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000004:00080000:0.0:1787826904.604560:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00010000:00010000:1.0:1787826904.604576:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604587:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604595:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604602:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826904.604606:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604624:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604649:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee27d887 (ffff8d5450fb5800) 00010000:00010000:1.0:1787826904.604653:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826904.604658:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.604667:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143720064:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826904.604669:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0e00/0xc0fefc09a7954123 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.604678:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+13:18296:x1874672134202752:12345-192.168.203.6@tcp:44:iozone.0 Request processed in 1323us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826904.604685:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143720192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826904.604690:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 127 00010000:00010000:1.0:1787826904.604695:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604704:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604711:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604717:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826904.604721:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604728:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826904.604735:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826904.604739:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428ded00) 00010000:00010000:1.0:1787826904.604744:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826904.604747:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604761:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2a00/0xc0fefc09a7954146 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.604762:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143720192 00000100:00100000:0.0:1787826904.604767:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143720192 00010000:00010000:1.0:1787826904.604780:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604788:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604794:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604800:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112800 already unused, calling callback (ffffffffc1a0e4f0) 00000100:00100000:2.0:1787826904.604806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826904.604807:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826904.604807:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826904.604817:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.604820:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143720064 00010000:00010000:1.0:1787826904.604831:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff8d5453332c00) 00000100:00100000:0.0:1787826904.604832:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143720064 00010000:00010000:1.0:1787826904.604835:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826904.604840:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604847:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112800/0xc0fefc09a7954162 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.604869:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00010000:00010000:1.0:1787826904.604871:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.604877:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787826904.604880:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143720192:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826904.604888:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.604889:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143720064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826904.604906:0:8401:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:15 count 1 00002000:00080000:0.0:1787826904.604907:0:19008:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:16 count 1 00010000:00010000:1.0:1787826904.604914:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604922:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787826904.604939:0:19008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.604939:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604940:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604969:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.604973:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.604974:0:19008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.604990:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428ded00) 00010000:00010000:0.0:1787826904.604994:0:19008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826904.604998:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826904.604999:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787826904.605000:0:19008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826904.605003:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.605008:0:19008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.605009:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826904.605021:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795419a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.605021:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 4/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.605048:0:19008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.605053:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.605056:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.605064:0:19008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 7 pid: 8402 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.605072:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.605077:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 7 pid: 8402 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.605089:0:19008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19008:1874672143720320:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826904.605093:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.605105:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143720448:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826904.605111:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787826904.605116:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.605136:0:19008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5343445000 going to sleep for 11 seconds 00010000:00010000:1.0:1787826904.605136:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.605144:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5442a88600 going to sleep for 11 seconds 00010000:00010000:1.0:1787826904.605149:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428ded00) 00010000:00010000:1.0:1787826904.605154:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826904.605157:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.605164:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0800/0xc0fefc09a79541bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.605571:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.605611:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134202880 00000100:00100000:0.0:1787826904.605616:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134202880 00000100:00100000:0.0:1787826904.605645:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 171 00000100:00100000:0.0:1787826904.605658:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134202880:12345-192.168.203.6@tcp:16:iozone.0 00000100:00100000:0.0:1787826904.607088:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134202880:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 1428us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.607098:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 171 00000100:00100000:1.0:1787826904.607158:0:19008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19008:1874672143720320:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787826904.607182:0:19008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826904.607271:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826904.607285:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143720448:192.168.203.6@tcp:104: 00000100:00100000:0.0:1787826904.607303:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203008 00010000:00010000:2.0:1787826904.607305:0:8401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.607309:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203008 00000100:00100000:3.0:1787826904.607310:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00010000:0.0:1787826904.607335:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 8 pid: 8402 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826904.607352:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203136 00000100:00100000:1.0:1787826904.607357:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203136 00000100:00100000:0.0:1787826904.607368:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 64 00010000:00010000:1.0:1787826904.607379:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 9 pid: 8402 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.607380:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54516ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2390:x1874672134203008:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826904.607395:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826904.607411:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 9 pid: 8402 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826904.607418:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 65 00010000:00010000:0.0:1787826904.607432:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 9 pid: 8402 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826904.607434:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2390:x1874672134203136:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826904.607449:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826904.607456:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 9 pid: 8402 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607460:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a7954170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467584 expref: 9 pid: 8402 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607488:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826904.607494:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826904.607496:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 8 pid: 8402 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607500:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607516:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000112b44cd/0xc0fefc09a7954115 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467568 expref: 8 pid: 8402 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607538:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607542:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826904.607550:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826904.607556:0:8417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607565:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607574:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826904.607595:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826904.607605:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54516ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2390:x1874672134203008:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 227us (334us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826904.607609:0:19008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826904.607616:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 64 00010000:00010000:2.0:1787826904.607627:0:19008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826904.607628:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2390:x1874672134203136:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 195us (318us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826904.607633:0:8401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.607643:0:19008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826904.607653:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 65 00010000:00010000:2.0:1787826904.607664:0:19008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.607666:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826904.607685:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.607694:0:19008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826904.607694:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607705:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826904.607717:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826904.607721:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607734:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0000 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:0.0:1787826904.607739:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607749:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607763:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607768:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826904.607773:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c057a5/0xc0fefc09a79541e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607776:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607792:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787826904.607796:0:10301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.607798:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826904.607808:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826904.607812:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826904.607813:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3618:x1874672143720192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2935us (3082us total) trans 25769803779 rc 0/0 00000100:00100000:2.0:1787826904.607825:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00010000:1.0:1787826904.607828:0:10301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607844:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.607853:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078cd5851/0xc0fefc09a79541ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826904.607857:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000004:00080000:2.0:1787826904.607866:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d546e108b40, transno 25769803777 00010000:00010000:1.0:1787826904.607872:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826904.607875:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826904.607877:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826904.607883:0:3618:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d534486f480 x1874672143720192/t25769803779(25769803779) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787826920 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787826904.607891:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d534486f480/2, rc 0, transno 25769803779 00000100:00100000:2.0:1787826904.607896:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143720192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826904.607964:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.607988:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1874672143720064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3093us (3175us total) trans 25769803780 rc 0/0 00000100:00100000:1.0:1787826904.607997:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203264 00000100:00100000:3.0:1787826904.607997:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000004:00080000:2.0:1787826904.608001:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d534486d2c0/2, rc 0, transno 25769803780 00000100:00100000:1.0:1787826904.608003:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203264 00000100:00100000:2.0:1787826904.608007:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143720064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826904.608039:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:1.0:1787826904.608049:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:18296:x1874672134203264:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:1.0:1787826904.608062:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826904.608075:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675a0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.608114:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a0 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.608126:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a0 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826904.608165:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:1.0:1787826904.608168:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826904.608171:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345112a00, rc 0) 00000100:00100000:1.0:1787826904.608200:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+9:18296:x1874672134203264:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 152us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826904.608206:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:1.0:1787826904.609179:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826904.609210:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203392 00000100:00100000:0.0:1787826904.609231:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203392 00000100:00100000:0.0:1787826904.609257:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 172 00000100:00100000:0.0:1787826904.609263:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:18296:x1874672134203392:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:0.0:1787826904.609269:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826904.609278:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006886bf14/0xc0fefc09a79541fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675a7 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826904.609293:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826904.609302:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=279s v=(0 0) 00010000:00010000:0.0:1787826904.609306:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826904.609313:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006886bf14/0xc0fefc09a79541fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.609324:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006886bf14/0xc0fefc09a79541fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826904.609333:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1800, rc 0) 00000100:00100000:0.0:1787826904.609362:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:18296:x1874672134203392:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 100us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.609367:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 172 00000100:00100000:0.0:1787826904.610152:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826904.610190:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203520 00000100:00100000:2.0:1787826904.610194:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203520 00000100:00100000:2.0:1787826904.610234:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:2.0:1787826904.610242:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+9:18296:x1874672134203520:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:2.0:1787826904.610249:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826904.610261:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954203 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675ae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.610284:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795420a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.610293:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795420a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.610302:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795420a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.610368:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954203 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ae expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.610377:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795420a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ae expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826904.610386:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:2.0:1787826904.610388:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826904.610390:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3000, rc 0) 00000100:00100000:2.0:1787826904.610420:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:18296:x1874672134203520:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 180us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826904.610424:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:1.0:1787826904.657434:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826904.657456:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143720960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.657466:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143720704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826904.657477:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143720832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826904.657530:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826904.657535:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826904.657550:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143721088:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.657580:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143720960 00000100:00100000:1.0:1787826904.657583:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143720576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.657587:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143720960 00000100:00100000:0.0:1787826904.657589:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143721344:0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.657596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826904.657625:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826904.657638:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143721600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.657648:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787826904.657652:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826904.657664:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143720960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826904.657673:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143721472:0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.657679:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826904.657682:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143721856:0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.657727:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143720832 00000100:00100000:3.0:1787826904.657733:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143720960:12345-0@lo:400:kworker.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826904.657734:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826904.657741:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143720832 00000100:00100000:0.0:1787826904.657748:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721088 00000100:00100000:3.0:1787826904.657748:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787826904.657753:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721088 00000100:00100000:3.0:1787826904.657773:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721600 00000100:00100000:1.0:1787826904.657774:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143721984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.657779:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721600 00000100:00100000:2.0:1787826904.657787:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787826904.657798:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787826904.657799:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143720832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826904.657810:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143721088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826904.657813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826904.657822:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721472 00000100:00100000:3.0:1787826904.657827:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721472 00000100:00100000:1.0:1787826904.657847:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143720960:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.657850:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721984 00000100:00100000:2.0:1787826904.657852:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143720832:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826904.657855:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721984 00000100:00100000:2.0:1787826904.657864:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787826904.657875:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143721088:12345-0@lo:400:kworker.0 Request processed in 68us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826904.657882:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143720576 00000100:00100000:0.0:1787826904.657886:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787826904.657887:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787826904.657888:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143720576 00000100:00100000:3.0:1787826904.657900:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f995680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143721600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.657925:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143721088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826904.657926:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826904.657953:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00010000:00080000:2.0:1787826904.657961:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534486e1c0 x1874672143721600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826904.657962:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f995680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143721600:12345-0@lo:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826904.657965:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143720576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826904.657973:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143721216:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.657981:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787826904.657992:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143721600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.658001:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143720704 00000100:00100000:3.0:1787826904.658005:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143720704 00000100:00100000:0.0:1787826904.658016:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826904.658025:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787826904.658031:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143720576:12345-0@lo:400:kworker.0 Request processed in 68us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.658038:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143721728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.658042:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787826904.658046:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143721472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.658056:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143721984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826904.658062:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826904.658063:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1787826904.658093:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721344 00000100:00100000:0.0:1787826904.658097:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721344 00000100:00100000:2.0:1787826904.658108:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143721472:12345-0@lo:400:kworker.0 Request processed in 65us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826904.658116:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143721984:12345-0@lo:400:kworker.0 Request processed in 61us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826904.658119:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787826904.658128:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787826904.658132:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721216 00000100:00100000:0.0:1787826904.658135:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721216 00000100:00100000:3.0:1787826904.658143:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787826904.658147:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143720704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826904.658153:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721728 00000100:00100000:0.0:1787826904.658156:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721728 00000100:00100000:2.0:1787826904.658177:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787826904.658188:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143721344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.658191:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787826904.658199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143720704:12345-0@lo:400:kworker.0 Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.658200:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787826904.658206:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143721216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826904.658236:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787826904.658246:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143721728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.658255:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143721344:12345-0@lo:400:kworker.0 Request processed in 68us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826904.658274:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787826904.658278:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143720704:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.658284:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143721216:12345-0@lo:400:kworker.0 Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826904.658294:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787826904.658299:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143721728:12345-0@lo:400:kworker.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826904.658310:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787826904.658311:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143721216:0@lo:400:kworker.0 00000100:00080000:2.0:1787826904.658316:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826904.658322:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826904.658325:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826904.658328:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787826904.658330:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534486f840 x1874672143721728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826904.658341:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143721728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.658356:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826904.658374:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143721472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826904.658404:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143720832:0@lo:400:kworker.0 00010000:00080000:0.0:1787826904.658406:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534486de00 x1874672143721984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826904.658421:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143721984:0@lo:400:kworker.0 00010000:00080000:3.0:1787826904.658431:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534486e940 x1874672143721344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826904.658436:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143721856 00000100:00100000:0.0:1787826904.658438:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143720576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.658442:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143721856 00000100:00100000:3.0:1787826904.658453:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143721344:0@lo:400:kworker.0 00000100:00100000:2.0:1787826904.658484:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787826904.658494:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143721856:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787826904.658500:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826904.658535:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143721856:12345-0@lo:400:kworker.0 Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826904.658541:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787826904.658576:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143721856:0@lo:400:kworker.0 00000100:00100000:1.0:1787826904.830876:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826904.830975:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203648 00000100:00100000:3.0:1787826904.830985:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203648 00002000:00100000:3.0:1787826904.831031:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (0->4194303) req@ffff8d546e154000 x1874672134203648/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:505/0 lens 488/0 e 0 to 0 dl 1787826915 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826904.831042:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e154000 with x1874672134203648 ext(0->4194303) 00002000:00010000:3.0:1787826904.831047:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e154000 00000100:00100000:3.0:1787826904.831078:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:3.0:1787826904.831090:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134203648:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826904.850497:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134203648:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19402us (19620us total) trans 25769803781 rc 0/0 00000100:00100000:3.0:1787826904.850510:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00002000:00100000:3.0:1787826904.850523:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (0->4194303) req@ffff8d546e154000 x1874672134203648/t25769803781(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:505/0 lens 488/448 e 0 to 0 dl 1787826915 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826904.850548:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e154000 with x1874672134203648 ext(0->4194303) 00002000:00010000:3.0:1787826904.850555:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e154000 00000100:00100000:2.0:1787826905.048306:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826905.048382:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203776 00000100:00100000:3.0:1787826905.048392:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203776 00002000:00100000:3.0:1787826905.048438:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (4194304->8388607) req@ffff8d546f6d8780 x1874672134203776/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/0 e 0 to 0 dl 1787826916 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826905.048448:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d8780 with x1874672134203776 ext(4194304->8388607) 00002000:00010000:3.0:1787826905.048454:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d8780 00000100:00100000:3.0:1787826905.048489:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:3.0:1787826905.048499:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2390:x1874672134203776:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826905.068023:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2390:x1874672134203776:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19517us (19718us total) trans 25769803782 rc 0/0 00000100:00100000:3.0:1787826905.068036:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00002000:00100000:3.0:1787826905.068048:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (4194304->8388607) req@ffff8d546f6d8780 x1874672134203776/t25769803782(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/448 e 0 to 0 dl 1787826916 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826905.068058:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d8780 with x1874672134203776 ext(4194304->8388607) 00002000:00010000:3.0:1787826905.068064:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d8780 00000100:00100000:1.0:1787826905.170409:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143722112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826905.170481:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826905.170485:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143722240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826905.170531:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826905.170574:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143722240 00000100:00100000:1.0:1787826905.170581:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143722240 00000100:00100000:1.0:1787826905.170642:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787826905.170651:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143722240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826905.170672:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826905.170674:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143722112 00000100:00100000:2.0:1787826905.170680:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143722112 00000100:00100000:2.0:1787826905.170719:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787826905.170729:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143722112:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826905.170730:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143722240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826905.170742:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000004:00000024:2.0:1787826905.170759:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00010000:00080000:1.0:1787826905.170790:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546f6d8f00 x1874672143722240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826905.170820:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143722240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826905.170909:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143722368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826905.171766:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143722112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1036us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826905.171766:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826905.171784:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787826905.171811:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143722112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826905.171819:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143722368 00000100:00100000:1.0:1787826905.171826:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143722368 00000100:00100000:1.0:1787826905.171863:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787826905.171870:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143722368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826905.171882:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826905.171922:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143722368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826905.171947:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00080000:3.0:1787826905.171961:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd5e00 x1874672143722368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826905.171975:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143722368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826905.260271:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826905.260461:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134203904 00000100:00100000:2.0:1787826905.260477:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134203904 00002000:00100000:2.0:1787826905.260546:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (8388608->12582911) req@ffff8d546e15d2c0 x1874672134203904/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/0 e 0 to 0 dl 1787826916 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826905.260570:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15d2c0 with x1874672134203904 ext(8388608->12582911) 00002000:00010000:2.0:1787826905.260577:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15d2c0 00000100:00100000:2.0:1787826905.260617:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:2.0:1787826905.260628:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134203904:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826905.281962:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+13:2391:x1874672134203904:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21324us (21688us total) trans 25769803783 rc 0/0 00000100:00100000:3.0:1787826905.281978:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00002000:00100000:3.0:1787826905.281990:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (8388608->12582911) req@ffff8d546e15d2c0 x1874672134203904/t25769803783(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/448 e 0 to 0 dl 1787826916 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826905.281998:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15d2c0 with x1874672134203904 ext(8388608->12582911) 00002000:00010000:3.0:1787826905.282003:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15d2c0 00010000:00010000:0.0:1787826905.297353:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826905.491822:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826905.491879:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204032 00000100:00100000:0.0:1787826905.491888:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204032 00002000:00100000:0.0:1787826905.491938:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (12582912->16777215) req@ffff8d546f6d9680 x1874672134204032/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/0 e 0 to 0 dl 1787826916 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826905.491949:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d9680 with x1874672134204032 ext(12582912->16777215) 00002000:00010000:0.0:1787826905.491955:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d9680 00000100:00100000:0.0:1787826905.491985:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:0.0:1787826905.491995:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+13:2390:x1874672134204032:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826905.509705:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2390:x1874672134204032:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17700us (17880us total) trans 25769803784 rc 0/0 00000100:00100000:0.0:1787826905.509719:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 25 00002000:00100000:0.0:1787826905.509740:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (12582912->16777215) req@ffff8d546f6d9680 x1874672134204032/t25769803784(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/448 e 0 to 0 dl 1787826916 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826905.509752:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d9680 with x1874672134204032 ext(12582912->16777215) 00002000:00010000:0.0:1787826905.509770:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d9680 00000100:00100000:1.0:1787826905.712536:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826905.712615:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204160 00000100:00100000:3.0:1787826905.712625:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204160 00002000:00100000:3.0:1787826905.712673:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (16777216->20971519) req@ffff8d547f7d6580 x1874672134204160/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/0 e 0 to 0 dl 1787826916 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826905.712683:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7d6580 with x1874672134204160 ext(16777216->20971519) 00002000:00010000:3.0:1787826905.712689:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7d6580 00000100:00100000:3.0:1787826905.712722:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:3.0:1787826905.712731:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2390:x1874672134204160:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826905.732393:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2390:x1874672134204160:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19652us (19854us total) trans 25769803785 rc 0/0 00000100:00100000:0.0:1787826905.732408:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 26 00002000:00100000:0.0:1787826905.732420:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (16777216->20971519) req@ffff8d547f7d6580 x1874672134204160/t25769803785(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/448 e 0 to 0 dl 1787826916 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826905.732430:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7d6580 with x1874672134204160 ext(16777216->20971519) 00002000:00010000:0.0:1787826905.732436:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7d6580 00000100:00100000:3.0:1787826905.941840:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826905.941904:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204288 00000100:00100000:1.0:1787826905.941913:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204288 00002000:00100000:1.0:1787826905.941969:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (20971520->25165823) req@ffff8d534486e940 x1874672134204288/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/0 e 0 to 0 dl 1787826916 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826905.941977:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486e940 with x1874672134204288 ext(20971520->25165823) 00002000:00010000:1.0:1787826905.941981:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486e940 00000100:00100000:1.0:1787826905.942006:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:1.0:1787826905.942012:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2393:x1874672134204288:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826905.962527:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2393:x1874672134204288:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20505us (20686us total) trans 25769803786 rc 0/0 00000100:00100000:2.0:1787826905.962541:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 27 00002000:00100000:2.0:1787826905.962554:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (20971520->25165823) req@ffff8d534486e940 x1874672134204288/t25769803786(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:506/0 lens 488/448 e 0 to 0 dl 1787826916 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826905.962565:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486e940 with x1874672134204288 ext(20971520->25165823) 00002000:00010000:2.0:1787826905.962571:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486e940 00000100:00100000:1.0:1787826906.150020:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826906.150074:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204416 00000100:00100000:2.0:1787826906.150082:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204416 00000100:00080000:1.0:1787826906.150124:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826906.150136:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (25165824->29360127) req@ffff8d5343b59a40 x1874672134204416/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/0 e 0 to 0 dl 1787826917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826906.150148:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b59a40 with x1874672134204416 ext(25165824->29360127) 00002000:00010000:2.0:1787826906.150153:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b59a40 00000100:00100000:2.0:1787826906.150177:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:2.0:1787826906.150196:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2391:x1874672134204416:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826906.169027:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+21:2391:x1874672134204416:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18816us (18999us total) trans 25769803787 rc 0/0 00000100:00100000:2.0:1787826906.169043:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00002000:00100000:2.0:1787826906.169055:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (25165824->29360127) req@ffff8d5343b59a40 x1874672134204416/t25769803787(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/448 e 0 to 0 dl 1787826917 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826906.169066:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b59a40 with x1874672134204416 ext(25165824->29360127) 00002000:00010000:2.0:1787826906.169071:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b59a40 00000100:00100000:2.0:1787826906.193738:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143722496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826906.193746:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143722624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826906.193780:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143722752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826906.193816:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826906.193817:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826906.193857:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143722496 00000100:00100000:1.0:1787826906.193864:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143722496 00000100:00100000:0.0:1787826906.193865:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143722752 00000100:00100000:0.0:1787826906.193871:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143722752 00000100:00080000:3.0:1787826906.193903:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826906.193934:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787826906.193939:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787826906.193948:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143722496:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826906.193953:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143722752:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1787826906.193983:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 67732928 pending 29532160 free 3898347520 avail 3666825216 00000004:00000024:0.0:1787826906.193996:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826906.194045:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143722496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826906.194053:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787826906.194060:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143722752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826906.194069:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787826906.194084:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826906.194122:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143722624 00000100:00100000:1.0:1787826906.194126:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143722624 00000100:00100000:2.0:1787826906.194134:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143722496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826906.194146:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143722752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826906.194172:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787826906.194179:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874672143722624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826906.194188:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 67732928 pending 29532160 free 3898347520 avail 3666825216 00000100:00080000:0.0:1787826906.194239:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826906.194256:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874672143722624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826906.194264:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787826906.194316:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143722624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787826906.321350:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826906.382289:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826906.382354:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204544 00000100:00100000:0.0:1787826906.382363:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204544 00002000:00100000:0.0:1787826906.382404:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (29360128->33554431) req@ffff8d5343b5a1c0 x1874672134204544/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/0 e 0 to 0 dl 1787826917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826906.382413:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5a1c0 with x1874672134204544 ext(29360128->33554431) 00002000:00010000:0.0:1787826906.382417:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5a1c0 00000100:00100000:0.0:1787826906.382445:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:0.0:1787826906.382454:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+21:2390:x1874672134204544:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826906.403680:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+23:2390:x1874672134204544:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21215us (21385us total) trans 25769803788 rc 0/0 00000100:00100000:0.0:1787826906.403694:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 29 00002000:00100000:0.0:1787826906.403707:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (29360128->33554431) req@ffff8d5343b5a1c0 x1874672134204544/t25769803788(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/448 e 0 to 0 dl 1787826917 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826906.403719:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5a1c0 with x1874672134204544 ext(29360128->33554431) 00002000:00010000:0.0:1787826906.403725:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5a1c0 00000100:00100000:1.0:1787826906.597820:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826906.597962:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204672 00000100:00100000:0.0:1787826906.597979:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204672 00002000:00100000:0.0:1787826906.598029:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (33554432->37748735) req@ffff8d5343b5b480 x1874672134204672/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/0 e 0 to 0 dl 1787826917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826906.598041:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5b480 with x1874672134204672 ext(33554432->37748735) 00002000:00010000:0.0:1787826906.598047:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5b480 00000100:00100000:0.0:1787826906.598075:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:0.0:1787826906.598085:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+23:2392:x1874672134204672:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826906.618166:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2392:x1874672134204672:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20074us (20346us total) trans 25769803789 rc 0/0 00000100:00100000:0.0:1787826906.618176:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 30 00002000:00100000:0.0:1787826906.618187:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (33554432->37748735) req@ffff8d5343b5b480 x1874672134204672/t25769803789(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/448 e 0 to 0 dl 1787826917 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826906.618195:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5b480 with x1874672134204672 ext(33554432->37748735) 00002000:00010000:0.0:1787826906.618200:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5b480 00000100:00100000:1.0:1787826906.820012:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826906.820062:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204800 00000100:00100000:2.0:1787826906.820070:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204800 00002000:00100000:2.0:1787826906.820121:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (37748736->41943039) req@ffff8d5343b5ad00 x1874672134204800/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/0 e 0 to 0 dl 1787826917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826906.820133:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5ad00 with x1874672134204800 ext(37748736->41943039) 00002000:00010000:2.0:1787826906.820139:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5ad00 00000100:00100000:2.0:1787826906.820174:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:2.0:1787826906.820182:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2390:x1874672134204800:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826906.840262:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2390:x1874672134204800:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20072us (20249us total) trans 25769803790 rc 0/0 00000100:00100000:3.0:1787826906.840277:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 31 00002000:00100000:3.0:1787826906.840310:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (37748736->41943039) req@ffff8d5343b5ad00 x1874672134204800/t25769803790(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:507/0 lens 488/448 e 0 to 0 dl 1787826917 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826906.840320:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5ad00 with x1874672134204800 ext(37748736->41943039) 00002000:00010000:3.0:1787826906.840327:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5ad00 00000100:00100000:2.0:1787826907.039781:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826907.039872:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134204928 00000100:00100000:3.0:1787826907.039887:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134204928 00002000:00100000:3.0:1787826907.039967:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (41943040->46137343) req@ffff8d546f6db480 x1874672134204928/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/0 e 0 to 0 dl 1787826918 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.039978:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6db480 with x1874672134204928 ext(41943040->46137343) 00002000:00010000:3.0:1787826907.039984:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6db480 00000100:00100000:3.0:1787826907.040017:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:3.0:1787826907.040025:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2392:x1874672134204928:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826907.059573:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+29:2392:x1874672134204928:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19541us (19792us total) trans 25769803791 rc 0/0 00000100:00100000:3.0:1787826907.059583:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 32 00002000:00100000:3.0:1787826907.059594:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (41943040->46137343) req@ffff8d546f6db480 x1874672134204928/t25769803791(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/448 e 0 to 0 dl 1787826918 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.059602:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6db480 with x1874672134204928 ext(41943040->46137343) 00002000:00010000:3.0:1787826907.059606:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6db480 00000100:00100000:1.0:1787826907.263162:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826907.263269:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205056 00000100:00100000:0.0:1787826907.263292:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205056 00002000:00100000:0.0:1787826907.263338:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (46137344->50331647) req@ffff8d5343b58f00 x1874672134205056/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/0 e 0 to 0 dl 1787826918 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826907.263350:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b58f00 with x1874672134205056 ext(46137344->50331647) 00002000:00010000:0.0:1787826907.263356:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b58f00 00000100:00100000:0.0:1787826907.263386:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:0.0:1787826907.263396:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+29:2392:x1874672134205056:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826907.287928:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+31:2392:x1874672134205056:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24514us (24755us total) trans 25769803792 rc 0/0 00000100:00100000:3.0:1787826907.287940:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 33 00002000:00100000:3.0:1787826907.287951:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (46137344->50331647) req@ffff8d5343b58f00 x1874672134205056/t25769803792(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/448 e 0 to 0 dl 1787826918 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.287972:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b58f00 with x1874672134205056 ext(46137344->50331647) 00002000:00010000:3.0:1787826907.287977:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b58f00 00010000:00010000:0.0:1787826907.345408:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826907.495103:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826907.495155:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205184 00000100:00100000:3.0:1787826907.495164:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205184 00002000:00100000:3.0:1787826907.495202:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (50331648->54525951) req@ffff8d5344bd5680 x1874672134205184/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/0 e 0 to 0 dl 1787826918 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.495211:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd5680 with x1874672134205184 ext(50331648->54525951) 00002000:00010000:3.0:1787826907.495244:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd5680 00000100:00100000:3.0:1787826907.495267:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 34 00000100:00100000:3.0:1787826907.495273:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+31:2393:x1874672134205184:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826907.515698:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+33:2393:x1874672134205184:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20414us (20591us total) trans 25769803793 rc 0/0 00000100:00100000:3.0:1787826907.515714:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 34 00002000:00100000:3.0:1787826907.515727:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (50331648->54525951) req@ffff8d5344bd5680 x1874672134205184/t25769803793(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/448 e 0 to 0 dl 1787826918 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.515738:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd5680 with x1874672134205184 ext(50331648->54525951) 00002000:00010000:3.0:1787826907.515745:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd5680 00000100:00100000:2.0:1787826907.723315:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826907.723377:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205312 00000100:00100000:3.0:1787826907.723387:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205312 00002000:00100000:3.0:1787826907.723434:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (54525952->58720255) req@ffff8d546f6d9e00 x1874672134205312/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/0 e 0 to 0 dl 1787826918 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.723445:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d9e00 with x1874672134205312 ext(54525952->58720255) 00002000:00010000:3.0:1787826907.723451:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d9e00 00000100:00100000:3.0:1787826907.723497:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00100000:3.0:1787826907.723507:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+33:2392:x1874672134205312:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826907.742598:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+35:2392:x1874672134205312:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19083us (19287us total) trans 25769803794 rc 0/0 00000100:00100000:3.0:1787826907.742613:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 35 00002000:00100000:3.0:1787826907.742626:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (54525952->58720255) req@ffff8d546f6d9e00 x1874672134205312/t25769803794(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/448 e 0 to 0 dl 1787826918 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.742637:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d9e00 with x1874672134205312 ext(54525952->58720255) 00002000:00010000:3.0:1787826907.742643:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d9e00 00000100:00100000:2.0:1787826907.955963:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826907.956038:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205440 00000100:00100000:3.0:1787826907.956048:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205440 00002000:00100000:3.0:1787826907.956095:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (58720256->62914559) req@ffff8d546f6d8000 x1874672134205440/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/0 e 0 to 0 dl 1787826918 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.956106:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d8000 with x1874672134205440 ext(58720256->62914559) 00002000:00010000:3.0:1787826907.956112:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d8000 00000100:00100000:3.0:1787826907.956149:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:3.0:1787826907.956159:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+35:2393:x1874672134205440:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826907.974387:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+37:2393:x1874672134205440:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18218us (18422us total) trans 25769803795 rc 0/0 00000100:00100000:3.0:1787826907.974401:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 36 00002000:00100000:3.0:1787826907.974413:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (58720256->62914559) req@ffff8d546f6d8000 x1874672134205440/t25769803795(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:508/0 lens 488/448 e 0 to 0 dl 1787826918 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826907.974423:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d8000 with x1874672134205440 ext(58720256->62914559) 00002000:00010000:3.0:1787826907.974440:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d8000 00000100:00100000:0.0:1787826908.181990:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826908.182064:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205568 00000100:00100000:3.0:1787826908.182074:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205568 00000100:00080000:0.0:1787826908.182131:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787826908.182136:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (62914560->67108863) req@ffff8d5344bd70c0 x1874672134205568/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/0 e 0 to 0 dl 1787826919 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826908.182148:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd70c0 with x1874672134205568 ext(62914560->67108863) 00002000:00010000:3.0:1787826908.182154:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd70c0 00000100:00100000:3.0:1787826908.182184:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 37 00000100:00100000:3.0:1787826908.182195:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+37:2392:x1874672134205568:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826908.201455:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+39:2392:x1874672134205568:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19253us (19464us total) trans 25769803796 rc 0/0 00000100:00100000:3.0:1787826908.201469:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 37 00002000:00100000:3.0:1787826908.201482:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (62914560->67108863) req@ffff8d5344bd70c0 x1874672134205568/t25769803796(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/448 e 0 to 0 dl 1787826919 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826908.201493:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd70c0 with x1874672134205568 ext(62914560->67108863) 00002000:00010000:3.0:1787826908.201499:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd70c0 00010000:00010000:1.0:1787826908.369406:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826908.406336:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826908.406436:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205696 00000100:00100000:0.0:1787826908.406446:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205696 00002000:00100000:0.0:1787826908.406495:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (67108864->71303167) req@ffff8d5444f0b840 x1874672134205696/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/0 e 0 to 0 dl 1787826919 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826908.406507:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f0b840 with x1874672134205696 ext(67108864->71303167) 00002000:00010000:0.0:1787826908.406512:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f0b840 00000100:00100000:0.0:1787826908.406539:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:0.0:1787826908.406549:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+39:2393:x1874672134205696:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826908.424926:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+41:2393:x1874672134205696:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18356us (18576us total) trans 25769803797 rc 0/0 00000100:00100000:0.0:1787826908.424940:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 38 00002000:00100000:0.0:1787826908.424953:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (67108864->71303167) req@ffff8d5444f0b840 x1874672134205696/t25769803797(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/448 e 0 to 0 dl 1787826919 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826908.424965:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f0b840 with x1874672134205696 ext(67108864->71303167) 00002000:00010000:0.0:1787826908.424980:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f0b840 00000100:00100000:2.0:1787826908.631782:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826908.631836:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205824 00000100:00100000:3.0:1787826908.631844:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205824 00002000:00100000:3.0:1787826908.631892:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (71303168->75497471) req@ffff8d546f6da1c0 x1874672134205824/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/0 e 0 to 0 dl 1787826919 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826908.631899:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6da1c0 with x1874672134205824 ext(71303168->75497471) 00002000:00010000:3.0:1787826908.631915:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6da1c0 00000100:00100000:3.0:1787826908.631947:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:3.0:1787826908.631959:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+41:2391:x1874672134205824:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826908.648699:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+43:2391:x1874672134205824:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16725us (16906us total) trans 25769803798 rc 0/0 00000100:00100000:3.0:1787826908.648715:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 39 00002000:00100000:3.0:1787826908.648725:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (71303168->75497471) req@ffff8d546f6da1c0 x1874672134205824/t25769803798(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/448 e 0 to 0 dl 1787826919 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826908.648733:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6da1c0 with x1874672134205824 ext(71303168->75497471) 00002000:00010000:3.0:1787826908.648737:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6da1c0 00000100:00100000:1.0:1787826908.870486:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826908.870553:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134205952 00000100:00100000:3.0:1787826908.870562:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134205952 00002000:00100000:3.0:1787826908.870621:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (75497472->79691775) req@ffff8d5444f09680 x1874672134205952/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/0 e 0 to 0 dl 1787826919 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826908.870630:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f09680 with x1874672134205952 ext(75497472->79691775) 00002000:00010000:3.0:1787826908.870634:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f09680 00000100:00100000:3.0:1787826908.870668:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:3.0:1787826908.870681:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+43:2390:x1874672134205952:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826908.883187:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+45:2390:x1874672134205952:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12500us (12702us total) trans 25769803799 rc 0/0 00000100:00100000:2.0:1787826908.883197:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 40 00002000:00100000:2.0:1787826908.883207:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (75497472->79691775) req@ffff8d5444f09680 x1874672134205952/t25769803799(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:509/0 lens 488/448 e 0 to 0 dl 1787826919 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826908.883235:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f09680 with x1874672134205952 ext(75497472->79691775) 00002000:00010000:2.0:1787826908.883242:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f09680 00000100:00100000:0.0:1787826909.098194:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826909.098251:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206080 00000100:00100000:3.0:1787826909.098260:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206080 00002000:00100000:3.0:1787826909.098308:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (79691776->83886079) req@ffff8d5344bd5e00 x1874672134206080/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/0 e 0 to 0 dl 1787826920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826909.098320:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd5e00 with x1874672134206080 ext(79691776->83886079) 00002000:00010000:3.0:1787826909.098326:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd5e00 00000100:00100000:3.0:1787826909.098357:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:3.0:1787826909.098367:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+45:2392:x1874672134206080:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826909.114963:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+47:2392:x1874672134206080:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16586us (16767us total) trans 25769803800 rc 0/0 00000100:00100000:2.0:1787826909.114979:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 41 00002000:00100000:2.0:1787826909.114993:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (79691776->83886079) req@ffff8d5344bd5e00 x1874672134206080/t25769803800(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/448 e 0 to 0 dl 1787826920 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826909.115003:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd5e00 with x1874672134206080 ext(79691776->83886079) 00002000:00010000:2.0:1787826909.115010:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd5e00 00000100:00100000:2.0:1787826909.332046:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826909.332114:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206208 00000100:00100000:0.0:1787826909.332124:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206208 00002000:00100000:0.0:1787826909.332170:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (83886080->88080383) req@ffff8d546f6da940 x1874672134206208/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/0 e 0 to 0 dl 1787826920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826909.332181:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6da940 with x1874672134206208 ext(83886080->88080383) 00002000:00010000:0.0:1787826909.332192:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6da940 00000100:00100000:2.0:1787826909.332255:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:2.0:1787826909.332267:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+47:2393:x1874672134206208:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826909.347113:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+49:2393:x1874672134206208:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14840us (15067us total) trans 25769803801 rc 0/0 00000100:00100000:1.0:1787826909.347127:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 42 00002000:00100000:1.0:1787826909.347141:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (83886080->88080383) req@ffff8d546f6da940 x1874672134206208/t25769803801(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/448 e 0 to 0 dl 1787826920 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826909.347168:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6da940 with x1874672134206208 ext(83886080->88080383) 00002000:00010000:1.0:1787826909.347174:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6da940 00010000:00010000:0.0:1787826909.393417:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826909.569022:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826909.569102:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206336 00000100:00100000:2.0:1787826909.569112:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206336 00002000:00100000:2.0:1787826909.569161:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (88080384->92274687) req@ffff8d545aa7c000 x1874672134206336/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/0 e 0 to 0 dl 1787826920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826909.569175:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7c000 with x1874672134206336 ext(88080384->92274687) 00002000:00010000:2.0:1787826909.569180:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7c000 00000100:00100000:0.0:1787826909.569261:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:0.0:1787826909.569275:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+49:2392:x1874672134206336:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826909.585035:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826909.585072:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826909.585099:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206464 00000100:00100000:2.0:1787826909.585103:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826909.585109:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206464 00000100:00100000:1.0:1787826909.585129:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206592 00000100:00100000:1.0:1787826909.585135:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206592 00000100:00100000:2.0:1787826909.585151:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826909.585170:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206720 00000100:00100000:0.0:1787826909.585176:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206720 00000100:00100000:3.0:1787826909.585185:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 462 00000100:00100000:1.0:1787826909.585198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 261 00000100:00100000:3.0:1787826909.585199:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134206464:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826909.585241:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206848 00000100:00100000:0.0:1787826909.585246:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 262 00000100:00100000:2.0:1787826909.585246:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206848 00000100:00100000:0.0:1787826909.585257:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134206720:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826909.585257:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134206592:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826909.585279:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00100000:2.0:1787826909.585288:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134206848:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826909.585295:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134206464:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 99us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826909.585304:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 462 00000100:00100000:1.0:1787826909.585310:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134206592:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826909.585319:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134206720:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 64us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826909.585320:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134206848:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826909.585322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 261 00000100:00100000:0.0:1787826909.585333:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 262 00000100:00100000:2.0:1787826909.585333:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00080000:2.0:1787826909.585357:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826909.585361:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826909.585364:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826909.588051:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+51:2392:x1874672134206336:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18774us (19033us total) trans 25769803802 rc 0/0 00000100:00100000:1.0:1787826909.588064:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 43 00002000:00100000:1.0:1787826909.588078:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (88080384->92274687) req@ffff8d545aa7c000 x1874672134206336/t25769803802(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/448 e 0 to 0 dl 1787826920 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826909.588088:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7c000 with x1874672134206336 ext(88080384->92274687) 00002000:00010000:1.0:1787826909.588094:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7c000 00000100:00100000:3.0:1787826909.777467:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349266d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143722880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.777477:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143723264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.777482:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143723008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826909.777565:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826909.777566:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826909.777571:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143723136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.777608:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143722880 00000100:00100000:0.0:1787826909.777617:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143722880 00000100:00100000:2.0:1787826909.777629:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826909.777650:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349266940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143723392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.777651:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143723776:0@lo:400:kworker.0 00000100:00100000:2.0:1787826909.777659:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143723648:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.777669:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1787826909.777690:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143722880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.777697:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826909.777704:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826909.777710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826909.777732:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143724288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826909.777736:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724160:0@lo:400:kworker.0 00000100:00100000:3.0:1787826909.777753:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143723904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.777757:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143722880:12345-0@lo:400:kworker.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826909.777776:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1787826909.777780:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826909.777785:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826909.777805:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723136 00000100:00100000:2.0:1787826909.777811:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787826909.777811:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723136 00000100:00100000:2.0:1787826909.777822:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143723520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.777837:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723392 00000100:00100000:1.0:1787826909.777841:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723264 00000100:00100000:0.0:1787826909.777843:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723392 00000100:00100000:1.0:1787826909.777853:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723264 00000100:00100000:2.0:1787826909.777856:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826909.777859:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787826909.777871:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143723136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826909.777878:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349266580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724032:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.777885:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787826909.777910:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723776 00000100:00100000:0.0:1787826909.777912:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143723392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.777916:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723776 00000100:00100000:2.0:1787826909.777926:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826909.777940:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143723136:12345-0@lo:400:kworker.0 Request processed in 70us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826909.777949:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787826909.777963:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724288 00000100:00100000:2.0:1787826909.777967:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143723136:0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.777968:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724288 00000100:00100000:0.0:1787826909.777974:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143723392:12345-0@lo:400:kworker.0 Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826909.777977:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723648 00000100:00100000:3.0:1787826909.777984:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723648 00000100:00100000:0.0:1787826909.777988:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787826909.778000:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787826909.778012:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143723264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826909.778023:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724160 00000100:00100000:2.0:1787826909.778026:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723520 00000100:00100000:3.0:1787826909.778029:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724160 00000100:00100000:0.0:1787826909.778031:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826909.778045:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723520 00000100:00100000:3.0:1787826909.778062:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724032 00000100:00100000:1.0:1787826909.778066:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143723264:12345-0@lo:400:kworker.0 Request processed in 55us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826909.778067:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724032 00000100:00100000:1.0:1787826909.778078:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787826909.778087:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787826909.778094:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723008 00000100:00100000:2.0:1787826909.778100:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143723648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.778101:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723008 00000100:00100000:3.0:1787826909.778101:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787826909.778112:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787826909.778119:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143724160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.778126:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143723776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.778145:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787826909.778157:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143724288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826909.778167:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143723648:12345-0@lo:400:kworker.0 Request processed in 71us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826909.778175:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143724160:12345-0@lo:400:kworker.0 Request processed in 58us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826909.778179:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787826909.778186:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143723776:12345-0@lo:400:kworker.0 Request processed in 63us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826909.778190:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787826909.778200:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787826909.778206:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143724288:12345-0@lo:400:kworker.0 Request processed in 49us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826909.778206:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787826909.778239:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787826909.778244:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349265a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143723520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.778251:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787826909.778255:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1874672143724032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.778263:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787826909.778265:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143723008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826909.778287:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349265a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143723520:12345-0@lo:400:kworker.0 Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826909.778296:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787826909.778301:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826909.778320:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826909.778322:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1874672143724032:12345-0@lo:400:kworker.0 Request processed in 73us (396us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826909.778326:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826909.778330:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1787826909.778332:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826909.778333:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143724416:0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.778342:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143723008:12345-0@lo:400:kworker.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826909.778360:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143723520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.778361:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787826909.778371:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826909.778383:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349266580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826909.778385:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143723904 00000100:00100000:1.0:1787826909.778391:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724416 00000100:00100000:3.0:1787826909.778391:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143723904 00000100:00100000:1.0:1787826909.778398:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724416 00010000:00080000:2.0:1787826909.778407:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5349265e00 x1874672143723648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826909.778409:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349266d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143722880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826909.778424:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787826909.778428:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143723648:0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.778433:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787826909.778439:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143723904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.778445:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349266940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143723392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826909.778449:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143724416:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787826909.778451:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492661c0 x1874672143724160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826909.778467:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.778492:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143723008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826909.778495:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143723904:12345-0@lo:400:kworker.0 Request processed in 61us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826909.778503:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1787826909.778504:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826909.778509:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143724416:12345-0@lo:400:kworker.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826909.778521:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787826909.778543:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143723776:0@lo:400:kworker.0 00010000:00080000:0.0:1787826909.778548:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5349267840 x1874672143723904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826909.778562:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143724288:0@lo:400:kworker.0 00000100:00100000:0.0:1787826909.778563:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143723904:0@lo:400:kworker.0 00000100:00100000:3.0:1787826909.778576:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143723264:0@lo:400:kworker.0 00010000:00080000:0.0:1787826909.778590:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5349267480 x1874672143724416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826909.778600:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143724416:0@lo:400:kworker.0 00000100:00100000:2.0:1787826909.808859:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826909.808932:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134206976 00000100:00100000:0.0:1787826909.808941:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134206976 00002000:00100000:0.0:1787826909.808989:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (92274688->96468991) req@ffff8d53492c4000 x1874672134206976/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/0 e 0 to 0 dl 1787826920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826909.809000:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4000 with x1874672134206976 ext(92274688->96468991) 00002000:00010000:0.0:1787826909.809005:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4000 00000100:00100000:0.0:1787826909.809035:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:0.0:1787826909.809050:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+51:2393:x1874672134206976:12345-192.168.203.6@tcp:4:iozone.0 00000001:00080000:0.0:1787826909.819511:0:20125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803802 is committed 00000001:00080000:0.0:1787826909.819562:0:20125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803780 is committed 00000100:00100000:3.0:1787826909.821435:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134206976:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12384us (12579us total) trans 25769803803 rc 0/0 00000100:00100000:3.0:1787826909.821447:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00002000:00100000:3.0:1787826909.821459:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (92274688->96468991) req@ffff8d53492c4000 x1874672134206976/t25769803803(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:510/0 lens 488/448 e 0 to 0 dl 1787826920 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826909.821485:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4000 with x1874672134206976 ext(92274688->96468991) 00002000:00010000:3.0:1787826909.821491:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4000 00000100:00100000:0.0:1787826910.039926:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826910.039992:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134207104 00000100:00100000:2.0:1787826910.040002:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134207104 00000100:00080000:0.0:1787826910.040060:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826910.040075:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (96468992->100663295) req@ffff8d547f74f480 x1874672134207104/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/0 e 0 to 0 dl 1787826921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826910.040088:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f74f480 with x1874672134207104 ext(96468992->100663295) 00002000:00010000:2.0:1787826910.040101:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f74f480 00000100:00100000:2.0:1787826910.040133:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 45 00000100:00100000:2.0:1787826910.040143:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134207104:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826910.054349:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134207104:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14191us (14412us total) trans 25769803804 rc 0/0 00000100:00100000:2.0:1787826910.054363:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 45 00002000:00100000:2.0:1787826910.054375:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (96468992->100663295) req@ffff8d547f74f480 x1874672134207104/t25769803804(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/448 e 0 to 0 dl 1787826921 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826910.054387:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f74f480 with x1874672134207104 ext(96468992->100663295) 00002000:00010000:2.0:1787826910.054393:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f74f480 00000100:00100000:1.0:1787826910.260861:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826910.260928:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134207232 00000100:00100000:2.0:1787826910.260936:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134207232 00002000:00100000:2.0:1787826910.260980:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (100663296->104857599) req@ffff8d5444f08780 x1874672134207232/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/0 e 0 to 0 dl 1787826921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826910.260991:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f08780 with x1874672134207232 ext(100663296->104857599) 00002000:00010000:2.0:1787826910.260997:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f08780 00000100:00100000:2.0:1787826910.261027:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:2.0:1787826910.261035:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134207232:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826910.276359:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134207232:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15314us (15497us total) trans 25769803805 rc 0/0 00000100:00100000:3.0:1787826910.276374:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 46 00002000:00100000:3.0:1787826910.276387:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (100663296->104857599) req@ffff8d5444f08780 x1874672134207232/t25769803805(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/448 e 0 to 0 dl 1787826921 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826910.276398:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f08780 with x1874672134207232 ext(100663296->104857599) 00002000:00010000:3.0:1787826910.276404:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f08780 00000100:00100000:0.0:1787826910.289380:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143724672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826910.289381:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826910.289456:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826910.289457:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826910.289494:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143724544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826910.289502:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724800 00000100:00100000:1.0:1787826910.289509:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724800 00000100:00100000:0.0:1787826910.289534:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826910.289562:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724544 00000100:00100000:1.0:1787826910.289566:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724544 00000100:00100000:3.0:1787826910.289576:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787826910.289585:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724672 00000100:00100000:0.0:1787826910.289589:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724672 00000100:00100000:1.0:1787826910.289590:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787826910.289597:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143724544:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826910.289619:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00002000:00000024:1.0:1787826910.289624:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826910.289625:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143724672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826910.289659:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826910.289670:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143724800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826910.289675:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143724544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826910.289685:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00002000:00000024:2.0:1787826910.289687:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826910.289703:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143724672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826910.289711:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787826910.289765:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143724672:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787826910.289780:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74e940 x1874672143724544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826910.289789:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143724544:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787826910.290089:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c5a40 x1874672143724800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826910.290091:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143724800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 502us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826910.290107:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787826910.290113:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787826910.417380:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826910.525338:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826910.525455:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134207360 00000100:00100000:0.0:1787826910.525465:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134207360 00002000:00100000:0.0:1787826910.525514:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (104857600->109051903) req@ffff8d546f6a0000 x1874672134207360/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/0 e 0 to 0 dl 1787826921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826910.525526:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0000 with x1874672134207360 ext(104857600->109051903) 00002000:00010000:0.0:1787826910.525532:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0000 00000100:00100000:0.0:1787826910.525569:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00100000:0.0:1787826910.525580:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2391:x1874672134207360:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826910.540722:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2391:x1874672134207360:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15137us (15384us total) trans 25769803806 rc 0/0 00000100:00100000:0.0:1787826910.540734:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 47 00002000:00100000:0.0:1787826910.540744:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (104857600->109051903) req@ffff8d546f6a0000 x1874672134207360/t25769803806(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/448 e 0 to 0 dl 1787826921 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826910.540752:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0000 with x1874672134207360 ext(104857600->109051903) 00002000:00010000:0.0:1787826910.540757:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0000 00000100:00100000:1.0:1787826910.745193:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826910.745249:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134207488 00000100:00100000:3.0:1787826910.745256:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134207488 00002000:00100000:3.0:1787826910.745300:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (109051904->113246207) req@ffff8d546f6a1e00 x1874672134207488/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/0 e 0 to 0 dl 1787826921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826910.745308:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a1e00 with x1874672134207488 ext(109051904->113246207) 00002000:00010000:3.0:1787826910.745312:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a1e00 00000100:00100000:3.0:1787826910.745333:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:3.0:1787826910.745339:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134207488:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826910.757645:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2390:x1874672134207488:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12296us (12449us total) trans 25769803807 rc 0/0 00000100:00100000:3.0:1787826910.757660:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 48 00002000:00100000:3.0:1787826910.757670:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (109051904->113246207) req@ffff8d546f6a1e00 x1874672134207488/t25769803807(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/448 e 0 to 0 dl 1787826921 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826910.757682:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a1e00 with x1874672134207488 ext(109051904->113246207) 00002000:00010000:3.0:1787826910.757687:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a1e00 00000100:00100000:1.0:1787826910.977317:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826910.977380:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134207616 00000100:00100000:2.0:1787826910.977390:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134207616 00002000:00100000:2.0:1787826910.977435:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (113246208->117440511) req@ffff8d546f6a03c0 x1874672134207616/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/0 e 0 to 0 dl 1787826921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826910.977443:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a03c0 with x1874672134207616 ext(113246208->117440511) 00002000:00010000:2.0:1787826910.977447:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a03c0 00000100:00100000:2.0:1787826910.977471:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 49 00000100:00100000:2.0:1787826910.977478:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134207616:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826910.991771:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134207616:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14280us (14453us total) trans 25769803808 rc 0/0 00000100:00100000:3.0:1787826910.991788:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 49 00002000:00100000:3.0:1787826910.991802:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (113246208->117440511) req@ffff8d546f6a03c0 x1874672134207616/t25769803808(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:511/0 lens 488/448 e 0 to 0 dl 1787826921 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826910.991813:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a03c0 with x1874672134207616 ext(113246208->117440511) 00002000:00010000:3.0:1787826910.991819:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a03c0 00000100:00100000:2.0:1787826911.204908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826911.204969:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134207744 00000100:00100000:3.0:1787826911.204979:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134207744 00002000:00100000:3.0:1787826911.205028:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (117440512->121634815) req@ffff8d53492c4f00 x1874672134207744/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/0 e 0 to 0 dl 1787826922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826911.205040:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4f00 with x1874672134207744 ext(117440512->121634815) 00002000:00010000:3.0:1787826911.205046:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4f00 00000100:00100000:3.0:1787826911.205076:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 50 00000100:00100000:3.0:1787826911.205084:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134207744:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826911.217774:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134207744:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12682us (12866us total) trans 25769803809 rc 0/0 00000100:00100000:3.0:1787826911.217798:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 50 00002000:00100000:3.0:1787826911.217812:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (117440512->121634815) req@ffff8d53492c4f00 x1874672134207744/t25769803809(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/448 e 0 to 0 dl 1787826922 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826911.217823:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4f00 with x1874672134207744 ext(117440512->121634815) 00002000:00010000:3.0:1787826911.217829:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4f00 00000100:00100000:1.0:1787826911.313384:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826911.313409:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826911.313417:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143725184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826911.313483:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826911.313486:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826911.313528:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143724928 00000100:00100000:3.0:1787826911.313535:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725184 00000100:00100000:0.0:1787826911.313536:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143724928 00000100:00100000:3.0:1787826911.313541:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725184 00000100:00100000:2.0:1787826911.313572:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826911.313583:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143725056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826911.313587:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787826911.313589:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826911.313594:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787826911.313600:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143724928:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826911.313620:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826911.313622:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143725184:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:0.0:1787826911.313633:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00002000:00000024:3.0:1787826911.313640:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160548288 pending 29532160 free 3822850048 avail 3591327744 00000100:00100000:1.0:1787826911.313653:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725056 00000100:00100000:1.0:1787826911.313659:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725056 00000100:00100000:0.0:1787826911.313682:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143724928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826911.313694:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143725184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (211us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826911.313701:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826911.313702:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787826911.313711:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787826911.313711:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787826911.313720:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143725056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826911.313731:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160548288 pending 29532160 free 3822850048 avail 3591327744 00000100:00100000:2.0:1787826911.313742:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143724928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826911.313763:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:3.0:1787826911.313769:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d534486f480, transno 25769803779 00000100:00100000:1.0:1787826911.313777:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143725056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000004:00080000:3.0:1787826911.313783:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d534486d2c0, transno 25769803780 00000100:00100000:3.0:1787826911.313793:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143725184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826911.313795:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787826911.313820:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143725056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826911.427805:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826911.427856:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134207872 00000100:00100000:0.0:1787826911.427864:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134207872 00002000:00100000:0.0:1787826911.427914:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (121634816->125829119) req@ffff8d534243ed00 x1874672134207872/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/0 e 0 to 0 dl 1787826922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826911.427922:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243ed00 with x1874672134207872 ext(121634816->125829119) 00002000:00010000:0.0:1787826911.427927:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243ed00 00000100:00100000:0.0:1787826911.427949:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 51 00000100:00100000:0.0:1787826911.427956:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134207872:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826911.440031:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134207872:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12066us (12228us total) trans 25769803810 rc 0/0 00000100:00100000:0.0:1787826911.440042:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 51 00002000:00100000:0.0:1787826911.440052:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (121634816->125829119) req@ffff8d534243ed00 x1874672134207872/t25769803810(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/448 e 0 to 0 dl 1787826922 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826911.440059:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243ed00 with x1874672134207872 ext(121634816->125829119) 00002000:00010000:0.0:1787826911.440064:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243ed00 00010000:00010000:0.0:1787826911.441387:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826911.642005:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826911.642070:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208000 00000100:00100000:0.0:1787826911.642079:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208000 00002000:00100000:0.0:1787826911.642126:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (125829120->130023423) req@ffff8d534243e580 x1874672134208000/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/0 e 0 to 0 dl 1787826922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826911.642137:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243e580 with x1874672134208000 ext(125829120->130023423) 00002000:00010000:0.0:1787826911.642142:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243e580 00000100:00100000:0.0:1787826911.642171:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 52 00000100:00100000:0.0:1787826911.642192:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134208000:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826911.657141:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134208000:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14940us (15136us total) trans 25769803811 rc 0/0 00000100:00100000:0.0:1787826911.657163:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 52 00002000:00100000:0.0:1787826911.657178:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (125829120->130023423) req@ffff8d534243e580 x1874672134208000/t25769803811(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/448 e 0 to 0 dl 1787826922 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826911.657188:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243e580 with x1874672134208000 ext(125829120->130023423) 00002000:00010000:0.0:1787826911.657194:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243e580 00000100:00100000:1.0:1787826911.871406:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826911.871466:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208128 00000100:00100000:3.0:1787826911.871477:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208128 00002000:00100000:3.0:1787826911.871524:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (130023424->134217727) req@ffff8d534243fc00 x1874672134208128/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/0 e 0 to 0 dl 1787826922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826911.871537:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243fc00 with x1874672134208128 ext(130023424->134217727) 00002000:00010000:3.0:1787826911.871549:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243fc00 00000100:00100000:3.0:1787826911.871595:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 53 00000100:00100000:3.0:1787826911.871603:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134208128:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826911.884675:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134208128:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13063us (13269us total) trans 25769803812 rc 0/0 00000100:00100000:3.0:1787826911.884691:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 53 00002000:00100000:3.0:1787826911.884715:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (130023424->134217727) req@ffff8d534243fc00 x1874672134208128/t25769803812(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:512/0 lens 488/448 e 0 to 0 dl 1787826922 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826911.884727:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243fc00 with x1874672134208128 ext(130023424->134217727) 00002000:00010000:3.0:1787826911.884734:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243fc00 00000100:00100000:0.0:1787826912.093438:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826912.093510:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208256 00000100:00100000:3.0:1787826912.093520:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208256 00000100:00080000:2.0:1787826912.093586:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787826912.093587:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (134217728->138412031) req@ffff8d53492bcb40 x1874672134208256/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/0 e 0 to 0 dl 1787826923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826912.093602:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bcb40 with x1874672134208256 ext(134217728->138412031) 00002000:00010000:3.0:1787826912.093608:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bcb40 00000100:00100000:3.0:1787826912.093647:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 54 00000100:00100000:3.0:1787826912.093657:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134208256:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826912.108415:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134208256:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14750us (14976us total) trans 25769803813 rc 0/0 00000100:00100000:2.0:1787826912.108437:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 54 00002000:00100000:2.0:1787826912.108447:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (134217728->138412031) req@ffff8d53492bcb40 x1874672134208256/t25769803813(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/448 e 0 to 0 dl 1787826923 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826912.108455:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bcb40 with x1874672134208256 ext(134217728->138412031) 00002000:00010000:2.0:1787826912.108460:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bcb40 00000100:00100000:1.0:1787826912.310000:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826912.310066:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208384 00000100:00100000:0.0:1787826912.310075:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208384 00002000:00100000:0.0:1787826912.310123:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (138412032->142606335) req@ffff8d534243c3c0 x1874672134208384/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/0 e 0 to 0 dl 1787826923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826912.310134:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243c3c0 with x1874672134208384 ext(138412032->142606335) 00002000:00010000:0.0:1787826912.310139:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243c3c0 00000100:00100000:0.0:1787826912.310168:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:0.0:1787826912.310179:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134208384:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826912.324610:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134208384:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14425us (14607us total) trans 25769803814 rc 0/0 00000100:00100000:2.0:1787826912.324620:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 55 00002000:00100000:2.0:1787826912.324630:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (138412032->142606335) req@ffff8d534243c3c0 x1874672134208384/t25769803814(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/448 e 0 to 0 dl 1787826923 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826912.324638:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243c3c0 with x1874672134208384 ext(138412032->142606335) 00002000:00010000:2.0:1787826912.324643:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243c3c0 00010000:00010000:1.0:1787826912.465420:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826912.529328:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826912.529391:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208512 00000100:00100000:3.0:1787826912.529399:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208512 00002000:00100000:3.0:1787826912.529438:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (142606336->146800639) req@ffff8d53492bf0c0 x1874672134208512/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/0 e 0 to 0 dl 1787826923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826912.529446:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bf0c0 with x1874672134208512 ext(142606336->146800639) 00002000:00010000:3.0:1787826912.529453:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bf0c0 00000100:00100000:3.0:1787826912.529474:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:3.0:1787826912.529495:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134208512:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826912.544067:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134208512:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14563us (14737us total) trans 25769803815 rc 0/0 00000100:00100000:2.0:1787826912.544082:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 56 00002000:00100000:2.0:1787826912.544093:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (142606336->146800639) req@ffff8d53492bf0c0 x1874672134208512/t25769803815(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/448 e 0 to 0 dl 1787826923 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826912.544100:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bf0c0 with x1874672134208512 ext(142606336->146800639) 00002000:00010000:2.0:1787826912.544109:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bf0c0 00000100:00100000:1.0:1787826912.765950:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826912.766041:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208640 00000100:00100000:3.0:1787826912.766058:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208640 00002000:00100000:3.0:1787826912.766126:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (146800640->150994943) req@ffff8d534243d680 x1874672134208640/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/0 e 0 to 0 dl 1787826923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826912.766140:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243d680 with x1874672134208640 ext(146800640->150994943) 00002000:00010000:3.0:1787826912.766146:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243d680 00000100:00100000:3.0:1787826912.766183:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:3.0:1787826912.766191:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134208640:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826912.781113:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2390:x1874672134208640:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14904us (15153us total) trans 25769803816 rc 0/0 00000100:00100000:2.0:1787826912.781133:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 57 00002000:00100000:2.0:1787826912.781159:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (146800640->150994943) req@ffff8d534243d680 x1874672134208640/t25769803816(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/448 e 0 to 0 dl 1787826923 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826912.781170:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243d680 with x1874672134208640 ext(146800640->150994943) 00002000:00010000:2.0:1787826912.781179:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243d680 00000100:00100000:1.0:1787826912.998613:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826912.998662:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208768 00000100:00100000:0.0:1787826912.998671:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208768 00002000:00100000:0.0:1787826912.998716:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (150994944->155189247) req@ffff8d53492cb0c0 x1874672134208768/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/0 e 0 to 0 dl 1787826923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826912.998727:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492cb0c0 with x1874672134208768 ext(150994944->155189247) 00002000:00010000:0.0:1787826912.998732:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492cb0c0 00000100:00100000:0.0:1787826912.998767:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 58 00000100:00100000:0.0:1787826912.998778:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134208768:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826913.011395:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134208768:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12606us (12773us total) trans 25769803817 rc 0/0 00000100:00100000:2.0:1787826913.011409:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 58 00002000:00100000:2.0:1787826913.011422:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (150994944->155189247) req@ffff8d53492cb0c0 x1874672134208768/t25769803817(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:513/0 lens 488/448 e 0 to 0 dl 1787826923 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826913.011433:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492cb0c0 with x1874672134208768 ext(150994944->155189247) 00002000:00010000:2.0:1787826913.011438:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492cb0c0 00000020:01000004:2.0:1787826913.149440:0:21116:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787826913.149492:0:21116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.149507:0:21116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.149516:0:21116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.149533:0:21116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.149558:0:21116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787826913.149570:0:21116:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787826913.149605:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1787826913.149610:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1787826913.149614:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826913.149626:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787826913.149628:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113200 already unused, calling callback (ffffffffc13fec20) 00000100:00080000:2.0:1787826913.149633:0:21116:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1787826913.149634:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826913.149647:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826913.149655:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787826913.149659:0:21116:0:(import.c:65:import_set_state_nolock()) ffff8d544558f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:0.0:1787826913.149663:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826913.149668:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787826913.149671:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787826913.149706:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826913.149714:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826913.149716:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143725312:0@lo:39:umount.0 00010000:00010000:0.0:1787826913.149737:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826913.149747:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5345113200/0xc0fefc09a79540ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79540b3 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826913.149756:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143725440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826913.149760:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826913.149769:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826913.149773:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826913.149783:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826913.149795:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826913.149830:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725312 00000100:00100000:0.0:1787826913.149836:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725312 00000100:00100000:3.0:1787826913.149845:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725440 00000100:00100000:3.0:1787826913.149852:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725440 00000100:00080000:1.0:1787826913.149889:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826913.149906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787826913.149911:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787826913.149919:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143725312:12345-0@lo:39:umount.0 00000100:00100000:3.0:1787826913.149922:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143725440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826913.149938:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1787826913.149948:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79540cf 00010000:00010000:3.0:1787826913.149956:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d3800/0xc0fefc09a79540b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a79540ac expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826913.149958:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d5448300800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787826913.149971:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826913.150002:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826913.150025:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143725440:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826913.150034:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787826913.150046:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143725440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826913.150048:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143725312:12345-0@lo:39:umount.0 Request processed in 132us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826913.150060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1787826913.150066:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d544558f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826913.150077:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143725312:0@lo:39:umount.0 00000020:00000080:0.0:1787826913.150078:0:6514:0:(genops.c:885:class_export_put()) final put ffff8d5448306800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:2.0:1787826913.150082:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787826913.150090:0:21116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d53492c7c00 x1874672143725312/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826923 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826913.150099:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787826913.150104:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826913.150118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448306800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787826913.150163:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5448300800 for lustre-MDT0000 00000100:00080000:2.0:1787826913.150900:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826913.150904:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787826913.150907:0:21116:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787826913.150917:0:21116:0:(import.c:65:import_set_state_nolock()) ffff8d544558d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787826913.150961:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143725568:0@lo:39:umount.0 00000100:00100000:1.0:1787826913.150992:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826913.151035:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725568 00000100:00100000:3.0:1787826913.151041:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725568 00000100:00080000:1.0:1787826913.151084:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826913.151088:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787826913.151105:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143725568:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787826913.151121:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79540dd 00000100:00080000:3.0:1787826913.151125:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d5343808800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826913.151143:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826913.151167:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143725568:12345-0@lo:39:umount.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826913.151173:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000020:00000080:3.0:1787826913.151180:0:6485:0:(genops.c:885:class_export_put()) final put ffff8d5343808000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00080000:1.0:1787826913.151194:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c6580 x1874672143725568/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826913.151202:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d544558d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1787826913.151205:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343808000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:1.0:1787826913.151238:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143725568:0@lo:39:umount.0 00000100:00080000:2.0:1787826913.151251:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826913.151255:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787826913.151259:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826913.151276:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5343808800 for lustre-MDT0001 00010000:00010000:2.0:1787826913.152004:0:21116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.152014:0:21116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.152022:0:21116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.152029:0:21116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.152055:0:21116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826913.152061:0:21116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.152067:0:21116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.152073:0:21116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826913.152080:0:21116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826913.152085:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826913.152100:0:21116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787826913.152105:0:21116:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1787826913.152107:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826913.152117:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3e00 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:0.0:1787826913.152128:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787826913.152128:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826913.152131:0:21116:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1787826913.152136:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1787826913.152137:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:1.0:1787826913.152144:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787826913.152145:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787826913.152149:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0400 already unused, calling callback (ffffffffc13fec20) 00000020:02000400:2.0:1787826913.152152:0:21116:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 10000000:00010000:0.0:1787826913.152155:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826913.152159:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826913.152173:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826913.152174:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826913.152177:0:10301:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787826913.152181:0:10301:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:00010000:0.0:1787826913.152189:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826913.152195:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826913.152199:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826913.152207:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787826913.152231:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787826913.152234:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826913.152250:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826913.152257:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826913.152259:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826913.152271:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826913.152271:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3e00/0xc0fefc09a795406d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954074 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826913.152279:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143725696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826913.152290:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0400/0xc0fefc09a795409e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79540a5 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826913.152299:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826913.152303:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826913.152305:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826913.152306:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826913.152308:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826913.152312:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826913.152326:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826913.152334:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143725824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826913.152367:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826913.152390:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725696 00000100:00100000:0.0:1787826913.152395:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725696 00000100:00100000:3.0:1787826913.152412:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725824 00000100:00100000:3.0:1787826913.152417:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725824 00000100:00100000:0.0:1787826913.152434:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826913.152444:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143725696:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826913.152448:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787826913.152459:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826913.152460:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143725824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826913.152471:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826913.152475:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a7954074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795406d expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826913.152485:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d3600/0xc0fefc09a79540a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795409e expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826913.152489:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826913.152494:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826913.152533:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3617:x1874672143725824:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826913.152544:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787826913.152545:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143725696:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826913.152555:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787826913.152573:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143725696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826913.152597:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143725824:0@lo:103:ldlm_bl.0 00002000:00000080:2.0:1787826913.153609:0:21116:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:2.0:1787826913.153631:0:21116:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:0.0:1787826913.154600:0:20125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803817 is committed 00000020:00000080:2.0:1787826913.154697:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1787826913.154707:0:21116:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5344bda800 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 25769803817 stale:0 00000020:00080000:2.0:1787826913.154714:0:21116:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5344bde800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 25769803780 stale:0 00000020:00080000:2.0:1787826913.154718:0:21116:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5344bdc800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:2.0:1787826913.154723:0:21116:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5342780000) has exports, disconnecting them 00000020:00080000:2.0:1787826913.154728:0:21116:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d5344bda800), last request at 1787826912 00000020:00000080:2.0:1787826913.154745:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954097 00000020:00010000:2.0:1787826913.154753:0:21116:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d5344bda800: total 0 00000100:00080000:2.0:1787826913.154756:0:21116:0:(import.c:65:import_set_state_nolock()) ffff8d544558a000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787826913.154789:0:7427:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d5344bda800: total 0 00010000:00010000:1.0:1787826913.154795:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787826913.154806:0:21116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d5344bda800): rc 0 00000020:00080000:2.0:1787826913.154810:0:21116:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5344bde800), last request at 1787826911 00000020:00000080:2.0:1787826913.154812:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954090 00000100:00080000:2.0:1787826913.154814:0:21116:0:(import.c:65:import_set_state_nolock()) ffff8d5344bdf000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826913.154825:0:21116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5344bde800): rc 0 00000020:00000080:2.0:1787826913.154828:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d5344bde800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1787826913.154842:0:21116:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5344bdc800), last request at 1787826911 00000020:00000080:2.0:1787826913.154846:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954089 00010000:00010000:0.0:1787826913.154848:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826913.154850:0:7427:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d5344bda800, canceled 0 locks, left on hash table 1. 00000100:00080000:2.0:1787826913.154851:0:21116:0:(import.c:65:import_set_state_nolock()) ffff8d546e145000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826913.154864:0:21116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5344bdc800): rc 0 00000020:00000080:2.0:1787826913.154867:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d5344bdc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787826913.154867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5344bde800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00010000:00010000:0.0:1787826913.154882:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826913.154899:0:7427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb size from disk: 0 -> 155189248 00002000:00010000:1.0:1787826913.154904:0:7427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb mtime from disk: 0 -> 1787826912 00002000:00010000:1.0:1787826913.154907:0:7427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb ctime from disk: 0 -> 1787826912 00002000:00010000:1.0:1787826913.154910:0:7427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb blocks from disk: 0 -> 303104 00000020:00000080:3.0:1787826913.154911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5344bdc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00080000:2.0:1787826913.154912:0:21116:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5342780000) has no exports 00000020:00000080:3.0:1787826913.154933:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5344bdf000 for lustre-OST0000 00010000:00010000:1.0:1787826913.154935:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006886bf14/0xc0fefc09a79541fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 2 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787826913.154939:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d546e145000 for lustre-OST0000 00010000:00010000:1.0:1787826913.154967:0:7427:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d5344bda800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787826913.161153:0:7427:0:(genops.c:885:class_export_put()) final put ffff8d5344bda800/2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:1.0:1787826913.161179:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826913.161182:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826913.161185:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826913.161250:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5344bda800/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:3.0:1787826913.161295:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d544558a000 for lustre-OST0000 00000020:01000000:2.0:1787826913.161842:0:21116:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d53426f4420 - data ffff8d5448ac8ca8/ffff8d5344497c00 00000020:01000000:2.0:1787826913.161986:0:21116:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d547d1e7480 - data ffff8d5469b1f288/ffff8d5345115c00 00100000:10000000:2.0:1787826913.167715:0:21116:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787826913.172362:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954082 00000020:00000080:3.0:1787826913.172373:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d5344bd8800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787826913.172393:0:21116:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d547f8e4000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787826913.172397:0:21116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e4000 2 00000020:01000004:3.0:1787826913.172401:0:21116:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d547f8e4000 from lustre-OST0000 00000020:00000080:0.0:1787826913.172419:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5344bd8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787826913.172422:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826913.172434:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787826913.172439:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d5344bdb000/lustre-OST0000_UUID 00000020:00000080:3.0:1787826913.172442:0:21116:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5344bdb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787826913.172450:0:21116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787826913.172503:0:21116:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:3.0:1787826913.172508:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787826913.172511:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826913.172517:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787826913.172524:0:21116:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d544558e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787826913.172530:0:21116:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d53437f3370) has exports, disconnecting them 00000020:00080000:3.0:1787826913.172534:0:21116:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d544558e000), last request at 1787826894 00000020:00000080:3.0:1787826913.172537:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79540c1 00000020:00080000:3.0:1787826913.172547:0:21116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d544558e000): rc 0 00000020:00000080:3.0:1787826913.172551:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d544558e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787826913.172588:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544558e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787826913.174610:0:21116:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787826913.174614:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826913.174618:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787826913.174624:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826913.174654:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d544558f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787826913.174742:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826913.174749:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787826913.174752:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d547f847800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787826913.174754:0:21116:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f847800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787826913.174758:0:21116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787826913.174803:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787826913.174805:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826913.174809:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787826913.174812:0:21116:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d544558c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787826913.174816:0:21116:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d53437f19b8) has exports, disconnecting them 00000020:00080000:3.0:1787826913.174819:0:21116:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d544558c000), last request at 1787826894 00000020:00000080:3.0:1787826913.174822:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79540d6 00000020:00080000:3.0:1787826913.174829:0:21116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d544558c000): rc 0 00000020:00000080:3.0:1787826913.174831:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d544558c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787826913.174885:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544558c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787826913.176296:0:21116:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787826913.176299:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826913.176302:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787826913.176305:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826913.176325:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d544558d800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787826913.176480:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826913.176489:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787826913.176493:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d5445589800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787826913.176496:0:21116:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5445589800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787826913.176504:0:21116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787826913.176609:0:21116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d547f8e4000 1 00000020:00000080:2.0:1787826913.176619:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954066 00000020:00000080:2.0:1787826913.176624:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d5442bd4000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787826913.176639:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787826913.176643:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5442bd4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787826913.176644:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826913.176651:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787826913.176656:0:21116:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d5450eecd28) has no exports 00000020:00000080:2.0:1787826913.218922:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826913.218937:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787826913.218942:0:21116:0:(genops.c:885:class_export_put()) final put ffff8d547f8e0800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787826913.218946:0:21116:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547f8e0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787826913.218956:0:21116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787826913.219063:0:21116:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d547f8e0000 00000020:02000400:2.0:1787826913.219111:0:21116:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:2.0:1787826913.233016:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826913.233063:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208896 00000100:00100000:3.0:1787826913.233070:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208896 00000100:00100000:3.0:1787826913.233107:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00100000:3.0:1787826913.233114:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2393:x1874672134208896:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:3.0:1787826913.233124:0:8407:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:3.0:1787826913.233182:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2393:x1874672134208896:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 65us (170us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826913.233191:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00100000:1.0:1787826913.461762:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826913.461814:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209024 00000100:00100000:2.0:1787826913.461823:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209024 00000100:00100000:2.0:1787826913.461865:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 60 00000100:00100000:2.0:1787826913.461885:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0+-99:2392:x1874672134209024:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:2.0:1787826913.461895:0:8405:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:2.0:1787826913.461948:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0+-99:2392:x1874672134209024:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 63us (192us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826913.461956:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 60 00010000:00010000:1.0:1787826913.489426:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826913.693537:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826913.693590:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209152 00000100:00100000:2.0:1787826913.693599:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209152 00000100:00100000:2.0:1787826913.693646:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:2.0:1787826913.693652:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2393:x1874672134209152:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:2.0:1787826913.693659:0:16779:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:2.0:1787826913.693711:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2393:x1874672134209152:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 57us (180us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826913.693719:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:1.0:1787826913.929273:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826913.929324:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209280 00000100:00100000:0.0:1787826913.929333:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209280 00000100:00100000:0.0:1787826913.929382:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:0.0:1787826913.929400:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0+-99:2390:x1874672134209280:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:0.0:1787826913.929410:0:8406:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:0.0:1787826913.929473:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0+-99:2390:x1874672134209280:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 74us (209us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826913.929481:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:1.0:1787826914.132305:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826914.132402:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209408 00000100:00100000:0.0:1787826914.132421:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209408 00000100:00100000:0.0:1787826914.132465:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:0.0:1787826914.132473:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2390:x1874672134209408:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:0.0:1787826914.132483:0:8407:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:0.0:1787826914.132550:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2390:x1874672134209408:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 75us (250us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826914.132557:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:1.0:1787826914.343428:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826914.343499:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209536 00000100:00100000:2.0:1787826914.343508:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209536 00000100:00100000:2.0:1787826914.343558:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:2.0:1787826914.343566:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0+-99:2392:x1874672134209536:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:2.0:1787826914.343576:0:8405:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:2.0:1787826914.343639:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0+-99:2392:x1874672134209536:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 72us (219us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826914.343647:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 64 00010000:00010000:0.0:1787826914.513363:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826914.547597:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826914.547673:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209664 00000100:00100000:2.0:1787826914.547683:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209664 00000100:00100000:2.0:1787826914.547734:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:2.0:1787826914.547744:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2393:x1874672134209664:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:2.0:1787826914.547753:0:16779:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:2.0:1787826914.547813:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2393:x1874672134209664:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 70us (222us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826914.547821:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:1.0:1787826914.705173:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826914.705204:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826914.705269:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209792 00000100:00100000:1.0:1787826914.705277:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826914.705281:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209792 00000100:00100000:3.0:1787826914.705295:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209920 00000100:00100000:3.0:1787826914.705300:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209920 00000100:00100000:1.0:1787826914.705310:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826914.705315:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210176 00000100:00100000:0.0:1787826914.705321:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210176 00000100:00100000:2.0:1787826914.705348:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 464 00000100:00100000:3.0:1787826914.705355:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210048 00000100:00100000:3.0:1787826914.705360:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210048 00000100:00100000:2.0:1787826914.705363:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134209792:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826914.705378:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:0.0:1787826914.705389:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134210176:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826914.705407:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 269 00000100:00100000:3.0:1787826914.705417:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134209920:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826914.705438:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134209792:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826914.705439:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 270 00000100:00100000:0.0:1787826914.705441:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134210176:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826914.705452:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 464 00000100:00100000:1.0:1787826914.705455:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134210048:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826914.705456:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134209920:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 40us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826914.705469:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 269 00000100:00100000:0.0:1787826914.705476:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:1.0:1787826914.705502:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134210048:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826914.705509:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 270 00000100:00080000:0.0:1787826914.705512:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826914.705518:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826914.705521:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826914.751311:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826914.751368:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210304 00000100:00100000:0.0:1787826914.751376:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210304 00000100:00100000:0.0:1787826914.751411:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:0.0:1787826914.751417:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0+-99:2392:x1874672134210304:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:0.0:1787826914.751423:0:8406:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:0.0:1787826914.751469:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0+-99:2392:x1874672134210304:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 52us (168us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826914.751474:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:3.0:1787826914.897504:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143725952:0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.897549:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143726080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.897579:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826914.897583:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143726208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.897607:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826914.897631:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826914.897644:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143726592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.897649:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143726464:0@lo:400:kworker.0 00000100:00100000:0.0:1787826914.897671:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143726720:0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.897678:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826914.897712:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826914.897712:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143726976:0@lo:400:kworker.0 00000100:00100000:0.0:1787826914.897721:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143725952 00000100:00100000:0.0:1787826914.897728:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143725952 00000100:00100000:1.0:1787826914.897737:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143726336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.897760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826914.897761:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143727104:0@lo:400:kworker.0 00000100:00100000:0.0:1787826914.897788:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1787826914.897795:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726208 00000100:00100000:0.0:1787826914.897801:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143725952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826914.897802:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726208 00000100:00100000:2.0:1787826914.897817:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826914.897840:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726464 00000100:00100000:1.0:1787826914.897844:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726464 00000100:00100000:3.0:1787826914.897846:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726592 00000100:00100000:3.0:1787826914.897851:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726592 00000100:00100000:0.0:1787826914.897880:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143725952:12345-0@lo:400:kworker.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826914.897886:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726080 00000100:00100000:1.0:1787826914.897887:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787826914.897891:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143727104 00000100:00100000:2.0:1787826914.897892:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726080 00000100:00100000:0.0:1787826914.897893:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1787826914.897898:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143727104 00000100:00100000:1.0:1787826914.897899:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143726208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.897932:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726976 00000100:00100000:2.0:1787826914.897936:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726976 00000100:00100000:1.0:1787826914.897943:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143726208:12345-0@lo:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826914.897943:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787826914.897949:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787826914.897959:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1874672143726592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826914.897968:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000020:00080000:3.0:1787826914.897972:0:10061:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826914.897981:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143726464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.897984:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787826914.897993:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143725952:0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.898000:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143726080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.898014:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1874672143726592:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826914.898019:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787826914.898044:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787826914.898048:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826914.898052:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1874672143727104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.898055:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143726080:12345-0@lo:400:kworker.0 Request processed in 56us (443us total) trans 0 rc 0/0 00000020:00080000:3.0:1787826914.898060:0:10061:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826914.898069:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787826914.898079:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143726848:0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.898088:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726336 00000100:00100000:3.0:1787826914.898089:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1874672143727104:12345-0@lo:400:kworker.0 Request processed in 38us (272us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826914.898094:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726336 00000100:00100000:3.0:1787826914.898098:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787826914.898120:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787826914.898128:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826914.898130:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.898138:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726848 00000100:00100000:3.0:1787826914.898142:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726848 00000100:00100000:1.0:1787826914.898165:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143726464:12345-0@lo:400:kworker.0 Request processed in 187us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826914.898176:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787826914.898181:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143726976:12345-0@lo:400:kworker.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826914.898188:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787826914.898189:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143726336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826914.898192:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787826914.898201:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787826914.898208:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143726848:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826914.898249:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826914.898255:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826914.898261:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143726336:12345-0@lo:400:kworker.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826914.898269:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787826914.898274:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826914.898281:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143726464:0@lo:400:kworker.0 00000100:00100000:0.0:1787826914.898289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143726848:12345-0@lo:400:kworker.0 Request processed in 84us (160us total) trans 0 rc 0/0 00010000:00080000:1.0:1787826914.898296:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492bf840 x1874672143726976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826914.898297:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143726720 00000100:00100000:0.0:1787826914.898302:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787826914.898303:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143726720 00000100:00100000:2.0:1787826914.898304:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143727232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826914.898316:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143726976:0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.898342:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787826914.898346:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826914.898350:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143726336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826914.898358:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143727232 00000100:00100000:3.0:1787826914.898358:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e39ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143726720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826914.898365:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143727232 00000100:00100000:0.0:1787826914.898374:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143726848:0@lo:400:kworker.0 00000100:00100000:2.0:1787826914.898392:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143726208:0@lo:400:kworker.0 00000100:00100000:1.0:1787826914.898405:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787826914.898412:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e39ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143726720:12345-0@lo:400:kworker.0 Request processed in 58us (138us total) trans 0 rc 0/0 00010000:00080000:2.0:1787826914.898413:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492bde00 x1874672143726720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826914.898419:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143727232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.898425:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787826914.898449:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143726720:0@lo:400:kworker.0 00000100:00080000:0.0:1787826914.898452:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826914.898459:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826914.898464:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787826914.898476:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143727232:12345-0@lo:400:kworker.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826914.898486:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:2.0:1787826914.898490:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492be1c0 x1874672143727232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826914.898502:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143727232:0@lo:400:kworker.0 00000100:00080000:2.0:1787826914.898543:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787826914.903836:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1787826914.903842:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826914.903851:0:3619:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 270 00000100:00080000:0.0:1787826914.903871:0:3619:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826914.903906:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53492bfc00 x1874672143727360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826914.903931:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143727104:0@lo:400:kworker.0 00000100:00100000:0.0:1787826914.903959:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143726080:0@lo:400:kworker.0 00000100:00080000:0.0:1787826914.903972:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787826914.903976:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143727360:0@lo:8:ptlrpcd_00_03.0 00000100:00080000:0.0:1787826914.903977:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826914.903983:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1787826914.904007:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1787826914.904009:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826914.904013:0:3619:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 270 00000100:00080000:0.0:1787826914.904018:0:3619:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826914.904032:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53492bc3c0 x1874672143727488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826914.904039:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826914.904051:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143726592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826914.904075:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143727360 00000100:00100000:1.0:1787826914.904081:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143727488:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:3.0:1787826914.904090:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143727360 00000100:00100000:1.0:1787826914.904101:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826914.904134:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143727488 00000100:00100000:3.0:1787826914.904138:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143727488 00000100:00100000:3.0:1787826914.904162:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787826914.904169:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143727360:12345-0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1787826914.904170:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787826914.904180:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143727488:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:3.0:1787826914.904190:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1787826914.904194:0:19009:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826914.904274:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143727488:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 93us (172us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826914.904278:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143727360:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 108us (242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826914.904287:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787826914.904294:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1787826914.904295:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826914.904302:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826914.904308:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143727488:0@lo:8:ptlrpcd_00_03.0 00000100:00080000:2.0:1787826914.904320:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826914.904324:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826914.904327:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143727360:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:2.0:1787826914.951453:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826914.951521:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210432 00000100:00100000:0.0:1787826914.951531:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210432 00000100:00100000:0.0:1787826914.951590:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:0.0:1787826914.951598:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2393:x1874672134210432:12345-192.168.203.6@tcp:4:iozone.0 00000020:00080000:0.0:1787826914.951606:0:8407:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:0.0:1787826914.951665:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0+-99:2393:x1874672134210432:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 66us (219us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826914.951676:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:0.0:1787826915.409392:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826915.409398:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143727744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826915.409409:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143727616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826915.409523:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826915.409532:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143727872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826915.410097:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826915.410099:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826915.410143:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143727616 00000100:00100000:1.0:1787826915.410143:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143727744 00000100:00100000:1.0:1787826915.410151:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143727744 00000100:00100000:0.0:1787826915.410160:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143727616 00000100:00100000:0.0:1787826915.410209:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787826915.410210:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787826915.410243:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143727744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826915.410246:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143727616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826915.410280:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:1.0:1787826915.410280:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826915.410329:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143727616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826915.410337:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787826915.410345:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143727744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826915.410354:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00080000:3.0:1787826915.410376:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492bd680 x1874672143727744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826915.410383:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143727616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826915.410392:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143727744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826915.410467:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826915.410514:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143727872 00000100:00100000:1.0:1787826915.410518:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143727872 00000100:00100000:1.0:1787826915.410541:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787826915.410548:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143727872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826915.410560:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826915.410594:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143727872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826915.410600:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00080000:2.0:1787826915.410629:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492c70c0 x1874672143727872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826915.410643:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143727872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826915.537411:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826916.433408:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143728000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826916.433463:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826916.433507:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728000 00000100:00100000:0.0:1787826916.433515:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728000 00000100:00100000:0.0:1787826916.433574:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787826916.433584:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143728000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826916.433616:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826916.433665:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143728000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826916.433673:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787826916.433711:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143728000:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826916.561454:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826917.585448:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826918.609393:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826919.633401:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826919.825113:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826919.825156:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826919.825182:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826919.825247:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826919.825261:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210688 00000100:00100000:2.0:1787826919.825275:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210560 00000100:00100000:3.0:1787826919.825275:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210688 00000100:00100000:0.0:1787826919.825294:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210816 00000100:00100000:1.0:1787826919.825303:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826919.825310:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210816 00000100:00100000:2.0:1787826919.825312:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210560 00000100:00100000:1.0:1787826919.825337:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211072 00000100:00100000:1.0:1787826919.825344:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211072 00000100:00100000:0.0:1787826919.825359:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 275 00000100:00100000:3.0:1787826919.825372:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 276 00000100:00100000:0.0:1787826919.825383:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134210688:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826919.825388:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210944 00000100:00100000:3.0:1787826919.825392:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134210816:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826919.825396:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210944 00000100:00100000:2.0:1787826919.825397:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 466 00000100:00100000:1.0:1787826919.825419:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:2.0:1787826919.825452:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134210560:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826919.825453:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134211072:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826919.825457:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134210688:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826919.825470:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134210816:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 83us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826919.825478:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 275 00000100:00100000:3.0:1787826919.825487:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 276 00000100:00100000:1.0:1787826919.825515:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134211072:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826919.825521:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:3.0:1787826919.825527:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00100000:2.0:1787826919.825536:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134210560:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 106us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826919.825538:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1874672134210944:12345-192.168.203.6@tcp:400:kworker.0 00000020:00080000:3.0:1787826919.825561:0:8402:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:2.0:1787826919.825562:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 466 00000100:00080000:1.0:1787826919.825582:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826919.825589:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826919.825594:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826919.825620:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1874672134210944:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 82us (314us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826919.825650:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00100000:1.0:1787826919.832000:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826919.832062:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211200 00000100:00100000:0.0:1787826919.832074:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211200 00000100:00100000:0.0:1787826919.832114:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 178 00000100:00100000:0.0:1787826919.832123:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2389:x1874672134211200:12345-192.168.203.6@tcp:8:ptlrpcd_00_01.0 00010000:00020000:0.0:1787826919.832146:0:19008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826919.832196:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2389:x1874672134211200:12345-192.168.203.6@tcp:8:ptlrpcd_00_01.0 Request processed in 73us (200us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826919.832204:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 178 00000100:00100000:3.0:1787826920.017475:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143728128:0@lo:400:kworker.0 00000100:00100000:0.0:1787826920.017509:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143728256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.017549:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826920.017555:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143728384:0@lo:400:kworker.0 00000100:00080000:1.0:1787826920.017562:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787826920.017565:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826920.017577:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826920.017580:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826920.017586:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 289 00000100:00080000:1.0:1787826920.017592:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826920.017598:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826920.017608:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826920.017616:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e072d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143728640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826920.017621:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e070780 x1874672143728768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826920.017631:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728256 00000100:00100000:0.0:1787826920.017638:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728256 00000100:00100000:2.0:1787826920.017646:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728384 00000100:00100000:3.0:1787826920.017652:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826920.017669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826920.017673:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826920.017675:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826920.017680:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 289 00000100:00100000:3.0:1787826920.017680:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00080000:1.0:1787826920.017684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787826920.017685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787826920.017690:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143728512:0@lo:400:kworker.0 00000100:00080000:1.0:1787826920.017691:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826920.017696:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143728256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826920.017707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f81d680 x1874672143729280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826920.017728:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826920.017741:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143728896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.017754:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143729152:0@lo:400:kworker.0 00000100:00100000:2.0:1787826920.017759:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728384 00000100:00100000:0.0:1787826920.017761:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143728256:12345-0@lo:400:kworker.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826920.017771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787826920.017771:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826920.017793:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826920.017796:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728512 00000100:00100000:0.0:1787826920.017800:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728512 00000100:00100000:2.0:1787826920.017803:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728640 00000100:00100000:2.0:1787826920.017808:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728640 00000100:00100000:1.0:1787826920.017814:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143728256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.017836:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143729408:0@lo:400:kworker.0 00000100:00100000:0.0:1787826920.017840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729152 00000100:00100000:1.0:1787826920.017844:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826920.017845:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729152 00000100:00100000:1.0:1787826920.017854:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143729024:0@lo:400:kworker.0 00000100:00100000:2.0:1787826920.017855:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787826920.017865:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826920.017870:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143728384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826920.017880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787826920.017888:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826920.017890:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143728512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.017913:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728128 00000100:00100000:3.0:1787826920.017918:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728128 00000100:00100000:1.0:1787826920.017922:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729024 00000100:00100000:2.0:1787826920.017928:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143728384:12345-0@lo:400:kworker.0 Request processed in 60us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826920.017929:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729024 00000100:00100000:2.0:1787826920.017939:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787826920.017945:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143728512:12345-0@lo:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826920.017954:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787826920.017958:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1787826920.017966:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787826920.017966:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787826920.017971:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143728128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826920.017979:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143728640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826920.017986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787826920.017989:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143729152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826920.017995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143729024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.018016:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143728128:12345-0@lo:400:kworker.0 Request processed in 49us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826920.018024:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1787826920.018041:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143728640:12345-0@lo:400:kworker.0 Request processed in 65us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826920.018051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143729024:12345-0@lo:400:kworker.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826920.018051:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143729152:12345-0@lo:400:kworker.0 Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826920.018052:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787826920.018064:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787826920.018066:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728896 00000100:00100000:0.0:1787826920.018068:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787826920.018071:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728896 00000100:00080000:1.0:1787826920.018087:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826920.018088:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e070780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143728768:0@lo:8:kworker.0 00000100:00080000:1.0:1787826920.018093:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826920.018097:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826920.018103:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143728512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.018105:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729408 00000100:00100000:3.0:1787826920.018110:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729408 00000100:00100000:1.0:1787826920.018114:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00010000:00080000:0.0:1787826920.018119:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d545aa7c780 x1874672143729152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826920.018124:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143728896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826920.018130:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826920.018136:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143729152:0@lo:400:kworker.0 00000100:00100000:0.0:1787826920.018150:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e072d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143728640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.018152:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143728768 00000100:00100000:3.0:1787826920.018156:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143728768 00000100:00100000:0.0:1787826920.018165:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143728128:0@lo:400:kworker.0 00000100:00100000:2.0:1787826920.018170:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143729280:0@lo:8:kworker.0 00000100:00100000:1.0:1787826920.018172:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143728896:12345-0@lo:400:kworker.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826920.018181:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787826920.018194:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787826920.018200:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143729408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826920.018209:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826920.018247:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787826920.018248:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143729024:0@lo:400:kworker.0 00000100:00100000:1.0:1787826920.018255:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143728768:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787826920.018265:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e0730c0 x1874672143728896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:1.0:1787826920.018271:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826920.018274:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143728896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.018280:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143729408:12345-0@lo:400:kworker.0 Request processed in 81us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826920.018290:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787826920.018293:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729280 00000100:00100000:2.0:1787826920.018298:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729280 00000100:00100000:1.0:1787826920.018313:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143728768:12345-0@lo:8:kworker.0 Request processed in 56us (187us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826920.018320:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1787826920.018321:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826920.018327:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787826920.018335:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143729280:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787826920.018347:0:19008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787826920.018372:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d54533e4f00 x1874672143729408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826920.018383:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143728384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826920.018384:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143729408:0@lo:400:kworker.0 00000100:00100000:2.0:1787826920.018386:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143729280:12345-0@lo:8:kworker.0 Request processed in 50us (180us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826920.018398:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1787826920.018445:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826920.018450:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826920.018454:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e070780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143728768:0@lo:8:kworker.0 00000100:00080000:2.0:1787826920.018463:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826920.018466:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826920.018468:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143729280:0@lo:8:kworker.0 00000100:00100000:3.0:1787826920.529406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143729664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826920.529482:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826920.529517:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826920.529522:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143729536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826920.529533:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729664 00000100:00100000:3.0:1787826920.529542:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826920.529551:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729664 00000100:00100000:3.0:1787826920.529561:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143729792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826920.529587:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729536 00000100:00100000:0.0:1787826920.529594:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729536 00000100:00100000:3.0:1787826920.529600:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826920.529622:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787826920.529634:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787826920.529637:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143729664:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826920.529642:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729792 00000100:00100000:0.0:1787826920.529648:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143729536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826920.529648:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729792 00002000:00000024:0.0:1787826920.529674:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787826920.529678:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826920.529684:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787826920.529693:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143729792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826920.529718:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826920.529733:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143729536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826920.529739:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787826920.529750:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143729664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826920.529764:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143729792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826920.529773:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787826920.529783:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00080000:2.0:1787826920.529940:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492c5a40 x1874672143729536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826920.529958:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143729536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826920.529971:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143729792:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787826920.529982:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492be580 x1874672143729664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826920.529993:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143729664:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826920.657375:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826921.553384:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143729920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826921.553464:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826921.553508:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143729920 00000100:00100000:0.0:1787826921.553519:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143729920 00000100:00100000:0.0:1787826921.553574:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787826921.553584:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143729920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826921.553616:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826921.553668:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143729920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826921.553675:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787826921.553711:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143729920:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826921.681380:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826922.705491:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826923.729494:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826924.753314:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826924.945444:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826924.945482:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826924.945504:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211712 00000100:00100000:0.0:1787826924.945513:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211712 00000100:00100000:3.0:1787826924.945517:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826924.945524:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211840 00000100:00100000:2.0:1787826924.945529:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211840 00000100:00100000:3.0:1787826924.945560:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826924.945562:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 181 00000100:00100000:0.0:1787826924.945572:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134211712:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:2.0:1787826924.945584:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 182 00000100:00100000:3.0:1787826924.945592:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00010000:00020000:0.0:1787826924.945594:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826924.945596:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134211840:12345-192.168.203.6@tcp:9:kworker.0 00000100:00100000:3.0:1787826924.945614:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211328 00000100:00100000:3.0:1787826924.945617:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211328 00000020:00000080:2.0:1787826924.945620:0:8399:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7953fe1 00000100:00080000:2.0:1787826924.945628:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d5448301000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787826924.945648:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 468 00000100:00100000:0.0:1787826924.945654:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874672134211712:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 82us (215us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826924.945660:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134211328:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826924.945667:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 181 00000001:00000004:2.0:1787826924.945674:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:0.0:1787826924.945692:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826924.945700:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134211328:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826924.945707:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 468 00000100:00100000:0.0:1787826924.945709:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211584 00000100:00100000:0.0:1787826924.945713:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211584 00000100:00100000:3.0:1787826924.945740:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211456 00000100:00100000:3.0:1787826924.945745:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211456 00000100:00100000:0.0:1787826924.945756:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 281 00000100:00100000:0.0:1787826924.945766:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134211584:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826924.945779:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 282 00000100:00100000:3.0:1787826924.945804:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134211456:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826924.945806:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+2:2389:x1874672134211840:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 215us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826924.945813:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 182 00000100:00100000:0.0:1787826924.945818:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134211584:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826924.945826:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 281 00010000:00010000:2.0:1787826924.945839:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826924.945840:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134211456:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 52us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826924.945847:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 282 00000100:00080000:0.0:1787826924.945959:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826924.945963:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826925.137331:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143730048:0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.137357:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143730176:0@lo:400:kworker.0 00000100:00080000:2.0:1787826925.137367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826925.137373:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826925.137376:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826925.137383:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 294 00000100:00080000:2.0:1787826925.137388:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1787826925.137395:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826925.137397:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826925.137404:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826925.137418:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5349267480 x1874672143730688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826925.137466:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143730816:0@lo:400:kworker.0 00000100:00100000:0.0:1787826925.137468:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143730560:0@lo:400:kworker.0 00000100:00080000:2.0:1787826925.137469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826925.137478:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826925.137480:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826925.137485:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 294 00000100:00080000:2.0:1787826925.137488:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826925.137500:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826925.137509:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826925.137515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826925.137519:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5349267c00 x1874672143731200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826925.137534:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826925.137544:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143730304:0@lo:400:kworker.0 00000100:00100000:0.0:1787826925.137547:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143731328:0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.137573:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143730688:0@lo:8:kworker.0 00000100:00100000:0.0:1787826925.137587:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826925.137597:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826925.137615:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826925.137625:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143730432:0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.137627:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826925.137630:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143730944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.137658:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143731200:0@lo:8:kworker.0 00000100:00100000:0.0:1787826925.137664:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826925.137683:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730176 00000100:00100000:0.0:1787826925.137688:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143731072:0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.137691:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730176 00000100:00100000:2.0:1787826925.137700:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826925.137717:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826925.137736:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730432 00000100:00100000:1.0:1787826925.137741:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730432 00000100:00100000:2.0:1787826925.137752:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730560 00000100:00100000:2.0:1787826925.137757:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730560 00000100:00100000:0.0:1787826925.137767:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730048 00000100:00100000:0.0:1787826925.137771:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730048 00000100:00100000:1.0:1787826925.137771:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731072 00000100:00100000:1.0:1787826925.137777:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731072 00000100:00100000:2.0:1787826925.137805:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730304 00000100:00100000:2.0:1787826925.137810:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730304 00000100:00100000:0.0:1787826925.137814:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1787826925.137822:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143730048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.137834:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787826925.137843:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787826925.137848:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143730176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.137857:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143730560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826925.137864:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143730048:12345-0@lo:400:kworker.0 Request processed in 42us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826925.137869:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1787826925.137901:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143730176:12345-0@lo:400:kworker.0 Request processed in 57us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826925.137906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787826925.137914:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787826925.137916:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143730560:12345-0@lo:400:kworker.0 Request processed in 63us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826925.137919:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143730432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.137929:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787826925.137939:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787826925.137951:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143731072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.137952:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787826925.137958:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143730432:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826925.137964:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143730304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826925.137966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787826925.138006:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143730432:0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.138006:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143731072:12345-0@lo:400:kworker.0 Request processed in 59us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826925.138014:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143730304:12345-0@lo:400:kworker.0 Request processed in 51us (416us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826925.138022:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d53492652c0 x1874672143731072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826925.138027:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787826925.138034:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787826925.138044:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143731072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.138056:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730816 00000100:00100000:0.0:1787826925.138058:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143730560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.138061:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730816 00000100:00100000:0.0:1787826925.138070:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143730048:0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.138070:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731328 00000100:00100000:1.0:1787826925.138077:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731328 00000100:00100000:2.0:1787826925.138097:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730688 00000100:00100000:2.0:1787826925.138102:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730688 00000100:00100000:1.0:1787826925.138114:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731200 00000100:00100000:1.0:1787826925.138119:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731200 00000100:00100000:0.0:1787826925.138126:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787826925.138133:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787826925.138137:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143730816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.138145:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143731328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.138150:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787826925.138156:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143730688:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787826925.138175:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143730816:12345-0@lo:400:kworker.0 Request processed in 41us (665us total) trans 0 rc 0/0 00010000:00020000:1.0:1787826925.138177:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826925.138186:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787826925.138206:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787826925.138257:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143730688:12345-0@lo:8:kworker.0 Request processed in 99us (631us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826925.138267:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1787826925.138300:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826925.138306:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826925.138331:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787826925.138371:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5349267840 x1874672143730816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826925.138383:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143730816:0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.138404:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143730176:0@lo:400:kworker.0 00000100:00100000:1.0:1787826925.138438:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143730304:0@lo:400:kworker.0 00000100:00100000:0.0:1787826925.138442:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349265e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143731200:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787826925.138453:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826925.138460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143730944 00000100:00100000:1.0:1787826925.138465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143730944 00000100:00100000:0.0:1787826925.138491:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349265e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143731200:12345-0@lo:8:kworker.0 Request processed in 277us (791us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826925.138499:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787826925.138504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787826925.138515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143730944:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826925.138527:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826925.138564:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143730944:12345-0@lo:400:kworker.0 Request processed in 51us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826925.138582:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787826925.138596:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143730944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.138598:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143731328:12345-0@lo:400:kworker.0 Request processed in 69us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826925.138609:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1787826925.138643:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826925.138647:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826925.138651:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143730688:0@lo:8:kworker.0 00000100:00080000:2.0:1787826925.138665:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00080000:1.0:1787826925.138666:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5349264f00 x1874672143731328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826925.138671:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826925.138679:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143731200:0@lo:8:kworker.0 00000100:00100000:1.0:1787826925.138687:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143731328:0@lo:400:kworker.0 00000100:00100000:2.0:1787826925.650345:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143731456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826925.650411:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826925.650449:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826925.650456:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143731584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826925.650481:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826925.650513:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731456 00000100:00100000:2.0:1787826925.650521:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731456 00000100:00100000:2.0:1787826925.650559:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731584 00000100:00100000:2.0:1787826925.650562:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731584 00000100:00100000:2.0:1787826925.650598:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787826925.650609:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349266580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143731456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826925.650776:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826925.650828:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787826925.650841:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349266580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143731456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 233us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826925.650842:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349265680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143731584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826925.650856:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00002000:00000024:3.0:1787826925.650860:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1787826925.650897:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5349267c00 x1874672143731456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826925.650905:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349265680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143731584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826925.650916:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787826925.650939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143731456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826925.650954:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143731712:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787826925.650966:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5349267480 x1874672143731584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826925.650980:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143731584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826925.650990:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826925.651023:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731712 00000100:00100000:2.0:1787826925.651028:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731712 00000100:00100000:2.0:1787826925.651065:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787826925.651073:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143731712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826925.651096:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826925.651131:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143731712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826925.651138:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787826925.651322:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143731712:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787826925.777388:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787826925.977121:0:21537:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787826925.977125:0:21537:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787826925.977126:0:21537:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787826925.977257:0:21537:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d5343808800 00000020:01000004:3.0:1787826925.977272:0:21537:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787826925.977291:0:21537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787826925.977304:0:21537:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d53437f3370) 00000020:00000080:3.0:1787826925.977322:0:21537:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787826926.009446:0:21537:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787826926.011544:0:21537:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787826926.011950:0:21537:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787826926.012125:0:21537:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787826926.012284:0:21537:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787826926.012442:0:21537:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787826926.012599:0:21537:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1787826926.013466:0:21537:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787826926.013651:0:21537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787826926.013662:0:21537:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787826926.013673:0:21537:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7954218 00000020:01000004:1.0:1787826926.013678:0:21537:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787826926.013699:0:21537:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787826926.013702:0:21537:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787826926.013707:0:21537:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787826926.013731:0:21537:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787826926.013734:0:21537:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787826926.018418:0:21537:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787826926.018452:0:21537:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787826926.018460:0:21537:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787826926.018461:0:21537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826926.018462:0:21537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826926.018464:0:21537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826926.018465:0:21537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826926.018466:0:21537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826926.018467:0:21537:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826926.018469:0:21537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826926.018470:0:21537:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826926.018473:0:21537:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787826926.018475:0:21537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826926.018476:0:21537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826926.018477:0:21537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826926.018478:0:21537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826926.018479:0:21537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826926.018480:0:21537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826926.018481:0:21537:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826926.018482:0:21537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826926.018483:0:21537:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826926.018505:0:21537:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787826926.018523:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143731840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787826926.018588:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.018639:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826926.018706:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731840 00000100:00100000:3.0:1787826926.018715:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731840 00000100:00100000:3.0:1787826926.018763:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1787826926.018773:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:21537:x1874672143731840:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787826926.018827:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787826926.018831:0:6478:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787826926.018835:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787826926.019060:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:21537:x1874672143731840:12345-0@lo:253:mount.lustre.0 Request processed in 285us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.019069:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1787826926.019090:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143731840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787826926.019104:0:21537:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787826926.019106:0:21537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826926.019107:0:21537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826926.019108:0:21537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826926.019109:0:21537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826926.019110:0:21537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826926.019111:0:21537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826926.019112:0:21537:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826926.019113:0:21537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826926.019114:0:21537:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787826926.019131:0:21537:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d5343808800 from lustre-OST0000 10000000:01000000:1.0:1787826926.019162:0:21537:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787826926.019164:0:21537:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787826926.019180:0:21537:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:1.0:1787826926.019188:0:21537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826926.019372:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143731968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826926.019399:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.019423:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826926.019456:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143731968 00000100:00100000:0.0:1787826926.019462:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143731968 00000100:00100000:0.0:1787826926.019490:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1787826926.019495:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:21537:x1874672143731968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826926.019559:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:21537:x1874672143731968:12345-0@lo:501:mount.lustre.0 Request processed in 62us (159us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826926.019578:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143731968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826926.019583:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 10000000:01000000:1.0:1787826926.019597:0:21537:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787826926.019627:0:21537:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787826926.019633:0:21537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.019648:0:21537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826926.019670:0:21537:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d5343808800 10000000:01000000:1.0:1787826926.019675:0:21537:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787826926.019680:0:21537:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787826926.019683:0:21537:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826926.019687:0:21537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787826926.019690:0:21537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787826926.019706:0:21537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.019712:0:21537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.019718:0:21537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826926.019730:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826926.019748:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.019763:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826926.019799:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732096 00000100:00100000:2.0:1787826926.019804:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732096 00000100:00100000:2.0:1787826926.019825:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1787826926.019830:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:21537:x1874672143732096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826926.019837:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826926.019847:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7954226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795421f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.019868:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7954226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795421f expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.019879:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7954226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795421f expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.019899:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2a00, rc 0) 00000100:00100000:2.0:1787826926.019948:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732096:12345-0@lo:101:mount.lustre.0 Request processed in 116us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.019955:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1787826926.019959:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826926.019973:0:21537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.019983:0:21537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826926.020530:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000040:00080000:1.0:1787826926.020902:0:21537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826926.021054:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:1.0:1787826926.021076:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:1.0:1787826926.021087:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:1.0:1787826926.021100:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:1.0:1787826926.021113:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:1.0:1787826926.021125:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:1.0:1787826926.021137:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:1.0:1787826926.021151:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:1.0:1787826926.021159:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 80 off9712 00000040:00080000:1.0:1787826926.021166:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9936 00000040:00080000:1.0:1787826926.021172:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10160 00000040:00080000:1.0:1787826926.021180:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 120 off10280 00000040:00080000:1.0:1787826926.021189:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 224 off10504 00000040:00080000:1.0:1787826926.021192:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 14 00000100:00100000:1.0:1787826926.021255:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826926.021287:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.021316:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826926.021340:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732224 00000100:00100000:3.0:1787826926.021346:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732224 00000100:00100000:3.0:1787826926.021381:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1787826926.021391:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826926.021479:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732224:12345-0@lo:501:mount.lustre.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.021487:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1787826926.021489:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826926.021512:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826926.021539:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.021552:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826926.021575:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732352 00000100:00100000:3.0:1787826926.021580:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732352 00000100:00100000:3.0:1787826926.021613:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1787826926.021620:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826926.021692:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732352:12345-0@lo:503:mount.lustre.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.021700:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1787826926.021704:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732352:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826926.021986:0:21537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826926.022024:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826926.022053:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.022067:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826926.022092:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732480 00000100:00100000:0.0:1787826926.022098:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732480 00000100:00100000:0.0:1787826926.022130:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1787826926.022139:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826926.022243:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732480:12345-0@lo:502:mount.lustre.0 Request processed in 104us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826926.022252:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1787826926.022258:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826926.022369:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:1.0:1787826926.022390:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:1.0:1787826926.022404:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:1.0:1787826926.022416:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:1.0:1787826926.022429:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:1.0:1787826926.022446:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:1.0:1787826926.022457:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:1.0:1787826926.022469:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:1.0:1787826926.022481:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 80 off9712 00000040:00080000:1.0:1787826926.022492:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9936 00000040:00080000:1.0:1787826926.022504:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10160 00000040:00080000:1.0:1787826926.022516:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 120 off10280 00000100:00100000:1.0:1787826926.022534:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826926.022564:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.022642:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d544709d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826926.022671:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732608 00000100:00100000:3.0:1787826926.022675:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732608 00000100:00100000:3.0:1787826926.022700:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1787826926.022705:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826926.022816:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732608:12345-0@lo:502:mount.lustre.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.022822:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1787826926.022881:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826926.022913:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 224 off10504 00000040:00080000:1.0:1787826926.022917:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787826926.023297:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826926.023303:0:21541:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787826926.023308:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826926.023310:0:21541:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787826926.023314:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826926.023324:0:21541:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5342780000) 00000020:00000080:1.0:1787826926.023339:0:21541:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787826926.023343:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826926.023384:0:21541:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5343808800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787826926.023389:0:21541:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826926.023394:0:21541:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7954234 00010000:00010000:1.0:1787826926.025924:0:21541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1787826926.026258:0:21541:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 25769803776 lx: 1874672143596416 gen 0 00000001:00080000:1.0:1787826926.026287:0:21541:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 25769803780 srv lr: 25769803776 lx: 1874672143720064 gen 0 00000001:00080000:1.0:1787826926.026302:0:21541:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 25769803817 srv lr: 25769803776 lx: 1874672134208768 gen 0 00000001:00000004:1.0:1787826926.026319:0:21541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 25769803817 00080000:10000000:1.0:1787826926.027150:0:21541:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xf:0x0] (8/32) registered 00000020:00000080:3.0:1787826926.027978:0:21541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787826926.027988:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826926.027995:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826926.027998:0:21541:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787826926.028002:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787826926.028004:0:21541:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787826926.028006:0:21541:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826926.028008:0:21541:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826926.028010:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787826926.028013:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826926.028015:0:21541:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787826926.028018:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826926.028023:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826926.028024:0:21541:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787826926.028029:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787826926.028031:0:21541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787826926.028034:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826926.028036:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826926.028037:0:21541:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787826926.028040:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826926.028043:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826926.028045:0:21541:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787826926.028049:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787826926.028070:0:21541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826926.028073:0:21541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826926.028075:0:21541:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787826926.028085:0:21541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000020:01000000:0.0:1787826926.028169:0:21537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787826926.028200:0:21537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787826926.028241:0:21537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826926.028253:0:21537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826926.028262:0:21537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5343808800 from 1 10000000:01000000:0.0:1787826926.028265:0:21537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826926.028308:0:21537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826926.028317:0:21537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826926.028328:0:21537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826926.028348:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826926.028414:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.028450:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826926.028464:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732736 00000100:00100000:3.0:1787826926.028472:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732736 00000100:00100000:3.0:1787826926.028521:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1787826926.028533:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:21537:x1874672143732736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826926.028546:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826926.028559:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e079a00/0xc0fefc09a7954257 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7954250 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.028584:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e079a00/0xc0fefc09a7954257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7954250 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.028594:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e079a00/0xc0fefc09a7954257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7954250 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.028603:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e079a00, rc 0) 00000100:00100000:3.0:1787826926.028647:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143732736:12345-0@lo:101:mount.lustre.0 Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.028654:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1787826926.028681:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826926.028695:0:21537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826926.028715:0:21537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826926.029392:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 7 count 7 00000040:00080000:0.0:1787826926.029560:0:21537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826926.029744:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:0.0:1787826926.029769:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:0.0:1787826926.029797:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:0.0:1787826926.029813:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:0.0:1787826926.029821:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:0.0:1787826926.029836:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:0.0:1787826926.029840:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 6 count 7 00000100:00100000:0.0:1787826926.029878:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826926.029903:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.029931:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826926.029949:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732864 00000100:00100000:2.0:1787826926.029954:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732864 00000100:00100000:2.0:1787826926.029991:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1787826926.030000:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143732864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826926.030079:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143732864:12345-0@lo:501:mount.lustre.0 Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.030095:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1787826926.030100:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826926.030123:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826926.030159:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.030174:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826926.030185:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143732992 00000100:00100000:1.0:1787826926.030189:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143732992 00000100:00100000:1.0:1787826926.030238:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1787826926.030248:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143732992:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826926.030327:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143732992:12345-0@lo:503:mount.lustre.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.030334:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1787826926.030347:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143732992:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826926.030592:0:21537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826926.030637:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826926.030678:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.030699:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826926.030716:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143733120 00000100:00100000:1.0:1787826926.030721:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143733120 00000100:00100000:1.0:1787826926.030755:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1787826926.030762:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143733120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826926.030836:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143733120:12345-0@lo:502:mount.lustre.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.030842:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1787826926.030849:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826926.030988:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:0.0:1787826926.031014:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:0.0:1787826926.031027:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:0.0:1787826926.031041:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:0.0:1787826926.031057:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000100:00100000:0.0:1787826926.031077:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826926.031110:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.031131:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826926.031132:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143733248 00000100:00100000:1.0:1787826926.031137:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143733248 00000100:00100000:1.0:1787826926.031160:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1787826926.031167:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143733248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826926.031260:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143733248:12345-0@lo:502:mount.lustre.0 Request processed in 92us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.031268:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1787826926.031294:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826926.031346:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:2.0:1787826926.031356:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1787826926.031846:0:21545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826926.031855:0:21545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826926.031858:0:21545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787826926.031865:0:21545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5343808800 00000020:00000080:0.0:1787826926.031867:0:21545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826926.031873:0:21545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826926.031874:0:21545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826926.031875:0:21545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787826926.031877:0:21545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826926.031879:0:21545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826926.031880:0:21545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787826926.031882:0:21545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5343808800 00000020:00000080:0.0:1787826926.031884:0:21545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826926.031919:0:21545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826926.031921:0:21545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826926.031922:0:21545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787826926.031924:0:21545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 7 count 7 00000020:01000000:2.0:1787826926.031981:0:21537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787826926.032012:0:21537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826926.032029:0:21537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.032040:0:21537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826926.032113:0:21537:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787826926.032116:0:21537:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d5343808800 10000000:01000000:2.0:1787826926.032120:0:21537:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d5343808800 10000000:01000000:2.0:1787826926.032124:0:21537:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826926.032135:0:21537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5343808800 from 1 10000000:01000000:2.0:1787826926.032137:0:21537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826926.032157:0:21537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.032163:0:21537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.032169:0:21537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826926.032179:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826926.032211:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826926.032257:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54438d6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826926.032286:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143733376 00000100:00100000:3.0:1787826926.032290:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143733376 00000100:00100000:3.0:1787826926.032357:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1787826926.032365:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:21537:x1874672143733376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826926.032374:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826926.032386:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e078600/0xc0fefc09a7954265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795425e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.032407:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e078600/0xc0fefc09a7954265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795425e expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.032426:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e078600/0xc0fefc09a7954265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795425e expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.032434:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e078600, rc 0) 00000100:00100000:3.0:1787826926.032478:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733376:12345-0@lo:101:mount.lustre.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.032484:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1787826926.032520:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826926.032535:0:21537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.032545:0:21537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826926.033538:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 52 count 51 00000040:00080000:0.0:1787826926.033754:0:21537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826926.033893:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:0.0:1787826926.033924:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:0.0:1787826926.033949:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:0.0:1787826926.033971:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:0.0:1787826926.033988:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:0.0:1787826926.034008:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:0.0:1787826926.034024:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:0.0:1787826926.034043:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:0.0:1787826926.034061:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:0.0:1787826926.034079:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:0.0:1787826926.034100:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:0.0:1787826926.034113:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:0.0:1787826926.034121:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:0.0:1787826926.034131:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:0.0:1787826926.034141:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:0.0:1787826926.034149:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:0.0:1787826926.034156:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:0.0:1787826926.034164:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:0.0:1787826926.034172:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:0.0:1787826926.034194:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:0.0:1787826926.034239:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:0.0:1787826926.034262:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:0.0:1787826926.034281:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:0.0:1787826926.034301:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:0.0:1787826926.034317:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 160 off12472 00000040:00080000:0.0:1787826926.034333:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12696 00000040:00080000:0.0:1787826926.034353:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12920 00000040:00080000:0.0:1787826926.034369:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off13000 00000040:00080000:0.0:1787826926.034384:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13224 00000040:00080000:0.0:1787826926.034398:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13448 00000040:00080000:0.0:1787826926.034407:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13536 00000040:00080000:0.0:1787826926.034423:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13664 00000040:00080000:0.0:1787826926.034443:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13808 00000040:00080000:0.0:1787826926.034473:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13936 00000040:00080000:0.0:1787826926.034490:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14160 00000040:00080000:0.0:1787826926.034505:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14384 00000040:00080000:0.0:1787826926.034515:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14464 00000040:00080000:0.0:1787826926.034549:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14688 00000040:00080000:0.0:1787826926.034572:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14912 00000040:00080000:0.0:1787826926.034592:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 88 off15000 00000040:00080000:0.0:1787826926.034609:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 128 off15128 00000040:00080000:0.0:1787826926.034627:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].42, 144 off15272 00000040:00080000:0.0:1787826926.034643:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].43, 128 off15400 00000040:00080000:0.0:1787826926.034659:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].44, 224 off15624 00000040:00080000:0.0:1787826926.034676:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].45, 224 off15848 00000040:00080000:0.0:1787826926.034692:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].46, 80 off15928 00000040:00080000:0.0:1787826926.034709:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].47, 224 off16152 00000040:00080000:0.0:1787826926.034726:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].48, 232 off16384 00000040:00080000:0.0:1787826926.034879:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].49, 224 off16608 00000040:00080000:0.0:1787826926.034904:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].50, 120 off16728 00000040:00080000:0.0:1787826926.034931:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].51, 224 off16952 00000040:00080000:0.0:1787826926.034938:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 51 count 51 00000100:00100000:0.0:1787826926.035004:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826926.035055:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.035093:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826926.035098:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143733504 00000100:00100000:1.0:1787826926.035105:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143733504 00000100:00100000:1.0:1787826926.035143:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1787826926.035153:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826926.035284:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733504:12345-0@lo:501:mount.lustre.0 Request processed in 134us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.035293:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1787826926.035300:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826926.035332:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826926.035369:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.035398:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826926.035413:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143733632 00000100:00100000:1.0:1787826926.035417:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143733632 00000100:00100000:1.0:1787826926.035444:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1787826926.035452:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826926.035536:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733632:12345-0@lo:503:mount.lustre.0 Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.035545:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1787826926.035550:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733632:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826926.035902:0:21537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826926.035955:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826926.035996:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.036019:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826926.036031:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143733760 00000100:00100000:1.0:1787826926.036037:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143733760 00000100:00100000:1.0:1787826926.036068:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1787826926.036077:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826926.036161:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733760:12345-0@lo:502:mount.lustre.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.036169:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1787826926.036172:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826926.036365:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:0.0:1787826926.036399:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:0.0:1787826926.036426:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:0.0:1787826926.036450:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:0.0:1787826926.036469:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:0.0:1787826926.036487:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:0.0:1787826926.036503:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:0.0:1787826926.036519:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:0.0:1787826926.036536:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:0.0:1787826926.036553:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:0.0:1787826926.036576:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:0.0:1787826926.036603:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:0.0:1787826926.036630:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:0.0:1787826926.036654:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:0.0:1787826926.036685:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:0.0:1787826926.036702:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:0.0:1787826926.036717:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:0.0:1787826926.036735:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:0.0:1787826926.036752:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:0.0:1787826926.036767:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:0.0:1787826926.036797:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:0.0:1787826926.036818:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:0.0:1787826926.036838:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:0.0:1787826926.036857:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:0.0:1787826926.036876:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 160 off12472 00000040:00080000:0.0:1787826926.036893:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12696 00000040:00080000:0.0:1787826926.036909:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12920 00000040:00080000:0.0:1787826926.036926:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off13000 00000040:00080000:0.0:1787826926.036953:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13224 00000040:00080000:0.0:1787826926.036972:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13448 00000040:00080000:0.0:1787826926.037004:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13536 00000040:00080000:0.0:1787826926.037024:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13664 00000040:00080000:0.0:1787826926.037040:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13808 00000040:00080000:0.0:1787826926.037057:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13936 00000040:00080000:0.0:1787826926.037074:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14160 00000040:00080000:0.0:1787826926.037090:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14384 00000040:00080000:0.0:1787826926.037109:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14464 00000040:00080000:0.0:1787826926.037126:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14688 00000040:00080000:0.0:1787826926.037144:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14912 00000040:00080000:0.0:1787826926.037165:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 88 off15000 00000040:00080000:0.0:1787826926.037182:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 128 off15128 00000040:00080000:0.0:1787826926.037192:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].42, 144 off15272 00000040:00080000:0.0:1787826926.037200:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].43, 128 off15400 00000040:00080000:0.0:1787826926.037209:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].44, 224 off15624 00000040:00080000:0.0:1787826926.037245:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].45, 224 off15848 00000040:00080000:0.0:1787826926.037265:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].46, 80 off15928 00000040:00080000:0.0:1787826926.037299:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].47, 224 off16152 00000040:00080000:0.0:1787826926.037321:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].48, 232 off16384 00000100:00100000:0.0:1787826926.037361:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826926.037402:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.037432:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826926.037560:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143733888 00000100:00100000:3.0:1787826926.037566:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143733888 00000100:00100000:3.0:1787826926.037603:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1787826926.037619:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826926.037717:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143733888:12345-0@lo:502:mount.lustre.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.037725:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1787826926.037735:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143733888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826926.037884:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].49, 224 off16608 00000040:00080000:0.0:1787826926.037911:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].50, 120 off16728 00000100:00100000:0.0:1787826926.037934:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143734016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826926.037974:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.037995:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d154cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826926.038011:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734016 00000100:00100000:1.0:1787826926.038015:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734016 00000100:00100000:1.0:1787826926.038037:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1787826926.038043:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143734016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826926.038104:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143734016:12345-0@lo:502:mount.lustre.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826926.038115:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143734016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826926.038121:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000040:00080000:0.0:1787826926.038166:0:21537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].51, 224 off16952 00000040:00080000:0.0:1787826926.038173:0:21537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787826926.038668:0:21548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787826926.038683:0:21548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d5450e8b370) 00000020:00000080:0.0:1787826926.038704:0:21548:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787826926.038772:0:21548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5343808800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787826926.038775:0:21548:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5343808800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787826926.038777:0:21548:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343808800 3 00010000:00080000:0.0:1787826926.038817:0:21548:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d53434cf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1787826926.040386:0:21548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:0.0:1787826926.040563:0:21548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787826926.040599:0:21548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787826926.040609:0:21548:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a7954273 00000100:00080000:0.0:1787826926.040618:0:21548:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826926.040623:0:21548:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d53434cf800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826926.040646:0:21548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53492be580 x1874672143734144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826926.040671:0:21548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787826926.040699:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143734144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826926.040735:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143734272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826926.040747:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826926.040757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826926.040761:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787826926.040763:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826926.040767:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 299 00000100:00080000:0.0:1787826926.040770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826926.040773:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787826926.040794:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.040800:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f81d680 x1874672143734656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826926.040816:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143734400:0@lo:400:kworker.0 00000100:00080000:0.0:1787826926.040824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1787826926.040828:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1787826926.040835:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787826926.040838:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787826926.040840:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e070780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143734784:0@lo:400:kworker.0 00000100:00080000:0.0:1787826926.040845:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 299 00000100:00100000:2.0:1787826926.040846:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826926.040852:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826926.040859:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787826926.040870:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826926.040876:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e0730c0 x1874672143734912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826926.040878:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143734528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826926.040885:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826926.040916:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826926.040931:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734144 00000100:00100000:3.0:1787826926.040937:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734144 00000100:00100000:2.0:1787826926.040964:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734272 00000100:00100000:3.0:1787826926.040965:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734400 00000100:00100000:3.0:1787826926.040968:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734400 00000100:00100000:2.0:1787826926.040971:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734272 00000100:00100000:3.0:1787826926.040992:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734784 00000100:00100000:3.0:1787826926.040996:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734784 00000100:00100000:2.0:1787826926.041004:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787826926.041012:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787826926.041016:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349267c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143734400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826926.041021:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1874672143734144:12345-0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787826926.041027:0:21548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787826926.041038:0:21548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d5450e8cd28) 00010000:00080000:3.0:1787826926.041047:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:0.0:1787826926.041055:0:21548:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:2.0:1787826926.041061:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349267c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143734400:12345-0@lo:400:kworker.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.041066:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787826926.041079:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787826926.041084:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143734272:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1787826926.041088:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a7954281 00000004:00100000:3.0:1787826926.041101:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787826926.041127:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143734272:12345-0@lo:400:kworker.0 Request processed in 43us (349us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826926.041128:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826926.041133:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000020:01000004:0.0:1787826926.041144:0:21548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5343808800 from lustre-OST0000, refs=3 00000100:00100000:2.0:1787826926.041144:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787826926.041149:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143734784:12345-0@lo:400:kworker.0 00000020:01000004:0.0:1787826926.041150:0:21548:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5343808800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787826926.041155:0:21548:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343808800 3 00000100:00100000:3.0:1787826926.041182:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143734144:12345-0@lo:38:llog_process_th.0 Request processed in 159us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.041190:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143734784:12345-0@lo:400:kworker.0 Request processed in 40us (309us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826926.041192:0:21548:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d53434cb800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00000100:00100000:3.0:1787826926.041193:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787826926.041205:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787826926.041257:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734528 00000100:00100000:2.0:1787826926.041261:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734528 00000100:00100000:2.0:1787826926.041293:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787826926.041302:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349266940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143734528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826926.041339:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349266940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143734528:12345-0@lo:400:kworker.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.041345:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787826926.041381:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143734656:0@lo:8:kworker.0 00000100:00100000:2.0:1787826926.041410:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826926.041433:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143734912:0@lo:8:kworker.0 00000100:00100000:2.0:1787826926.041458:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826926.041485:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826926.041492:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787826926.041497:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787826926.041501:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787826926.041502:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53434cf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826926.041507:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143734144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826926.041531:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734656 00000100:00100000:2.0:1787826926.041535:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734656 00000100:00100000:2.0:1787826926.041558:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143734912 00010000:00080000:3.0:1787826926.041559:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e070780 x1874672143734784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826926.041562:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143734912 00000100:00100000:3.0:1787826926.041574:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e070780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143734784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826926.041588:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787826926.041590:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143734272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826926.041596:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349266d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143734656:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787826926.041626:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143734528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826926.041638:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143734400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826926.041658:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349266d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143734656:12345-0@lo:8:kworker.0 Request processed in 61us (246us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787826926.041666:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787826926.041677:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787826926.041685:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143734912:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1787826926.041708:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826926.041713:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787826926.041718:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143734656:0@lo:8:kworker.0 00000100:00100000:3.0:1787826926.041731:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143734912:12345-0@lo:8:kworker.0 Request processed in 44us (270us total) trans 0 rc -11/-11 00000100:00080000:2.0:1787826926.041733:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826926.041739:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826926.041743:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787826926.041746:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143734912:0@lo:8:kworker.0 00010000:00010000:0.0:1787826926.043173:0:21548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:0.0:1787826926.043358:0:21548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787826926.043380:0:21548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787826926.043388:0:21548:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a7954288 00000100:00080000:0.0:1787826926.043393:0:21548:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826926.043396:0:21548:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d53434cb800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787826926.043411:0:21548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e0703c0 x1874672143735040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826926.043428:0:21548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787826926.043458:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143735040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826926.043497:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826926.043550:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143735040 00000100:00100000:2.0:1787826926.043555:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143735040 00000100:00100000:2.0:1787826926.043582:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787826926.043588:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1874672143735040:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787826926.043605:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 300 last 0 00000040:00080000:0.0:1787826926.043621:0:21548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 52 count 51 00000020:00000080:2.0:1787826926.043639:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a795428f 00000004:00100000:2.0:1787826926.043648:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826926.043667:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d53494c0000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1787826926.043689:0:21537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:2.0:1787826926.043714:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143735040:12345-0@lo:38:llog_process_th.0 Request processed in 124us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.043722:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:0.0:1787826926.043729:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e0703c0 x1874672143735040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787826926.043732:0:21537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1787826926.043744:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00010000:00010000:1.0:1787826926.043752:0:21537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826926.043755:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787826926.043763:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00010000:1.0:1787826926.043767:0:21537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826926.043768:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787826926.043772:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53434cb800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826926.043797:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143735040:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1787826926.043838:0:21537:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787826926.043841:0:21537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826926.043842:0:21537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826926.043844:0:21537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826926.043846:0:21537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826926.043848:0:21537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826926.043850:0:21537:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826926.043851:0:21537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826926.043857:0:21537:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826926.043861:0:21537:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787826926.043864:0:21537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826926.043865:0:21537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826926.043867:0:21537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826926.043869:0:21537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826926.043870:0:21537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826926.043872:0:21537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826926.043873:0:21537:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826926.043875:0:21537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826926.043876:0:21537:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826926.043902:0:21537:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787826926.043914:0:21537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143735168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787826926.043970:0:21537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826926.043992:0:21537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5451899a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826926.043998:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143735168 00000100:00100000:0.0:1787826926.044003:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143735168 00000100:00100000:0.0:1787826926.044038:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1787826926.044047:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143735168:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826926.044067:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787826926.044077:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787826926.046034:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826926.046048:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787826926.046059:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826926.046065:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826926.046085:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.046102:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.046111:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.046119:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.046126:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.046158:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.046184:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826926.046198:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143735296:0@lo:104: 00000100:00100000:0.0:1787826926.046282:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:21537:x1874672143735168:12345-0@lo:253:mount.lustre.0 Request processed in 2233us (2310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.046289:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826926.046297:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00010000:00010000:1.0:1787826926.046353:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.046364:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 23 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826926.046374:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143735424:0@lo:104: 00000100:00100000:1.0:1787826926.046408:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826926.046441:0:21537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:21537:1874672143735168:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1787826926.046444:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826926.046458:0:21537:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00010000:00010000:1.0:1787826926.046462:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 9 pid: 6478 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787826926.046463:0:21537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826926.046467:0:21537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826926.046470:0:21537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826926.046472:0:21537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826926.046479:0:21537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1787826926.046482:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143735552:192.168.203.6@tcp:104: 00000020:01000004:3.0:1787826926.046482:0:21537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826926.046484:0:21537:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826926.046486:0:21537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826926.046489:0:21537:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787826926.046506:0:21537:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787826926.046536:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5451899240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826926.046634:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787826926.046644:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143735296 00000100:00100000:2.0:1787826926.046647:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143735296 00000100:00100000:2.0:1787826926.046676:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143735424 00000100:00100000:2.0:1787826926.046679:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143735424 00000100:00100000:2.0:1787826926.046709:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787826926.046720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826926.046721:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143735296:12345-0@lo:104: 00010000:00010000:2.0:1787826926.046735:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826926.046736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343859c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143735424:12345-0@lo:104: 00010000:00010000:1.0:1787826926.046752:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.046808:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826926.046814:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143735296:12345-0@lo:104: Request processed in 98us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.046819:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1787826926.046823:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787826926.046838:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343859c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143735424:12345-0@lo:104: Request processed in 106us (431us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826926.046840:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826926.046848:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826926.046852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1787826926.046873:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079600 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826926.046878:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.046887:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826926.046894:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826926.046902:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826926.046930:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.046937:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826926.046957:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.046963:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a7954107 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826926.046968:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143735680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826926.046975:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826926.046978:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.046982:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1200 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787826926.046985:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.046997:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826926.047002:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826926.047006:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787826926.047012:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826926.047029:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.047033:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826926.047039:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143735680 00000100:00100000:1.0:1787826926.047044:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143735680 00010000:00010000:2.0:1787826926.047047:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.047052:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1200/0xc0fefc09a79540f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79540f9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.047063:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826926.047064:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826926.047065:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826926.047067:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826926.047073:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826926.047082:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143735808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826926.047094:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787826926.047103:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143735680:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826926.047108:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826926.047118:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826926.047125:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826926.047133:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143735808 00000100:00100000:0.0:1787826926.047139:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143735808 00010000:00010000:1.0:1787826926.047140:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826926.047156:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143735296:0@lo:104: 00010000:00010000:1.0:1787826926.047158:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d546e078200/0xc0fefc09a7954107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a7954100 expref: 25 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826926.047161:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 25 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826926.047166:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143735424:0@lo:104: 00010000:00010000:1.0:1787826926.047187:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826926.047202:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787826926.047230:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143735808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826926.047241:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826926.047246:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826926.047250:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143735680:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826926.047258:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1787826926.047340:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 23 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826926.047352:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345112400/0xc0fefc09a79540f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79540f2 expref: 23 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826926.047362:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826926.047396:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3618:x1874672143735808:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826926.047403:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787826926.047435:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143735808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826926.047442:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143735680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826926.047822:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143735552:192.168.203.6@tcp:104: 00010000:00010000:2.0:1787826926.047844:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787826926.047893:0:21537:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 25769803817 00000100:00100000:0.0:1787826926.047995:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826926.048014:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134211968 00000100:00100000:3.0:1787826926.048020:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134211968 00010000:00010000:3.0:1787826926.048040:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 10 pid: 6478 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826926.048104:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:3.0:1787826926.048113:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54516ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134211968:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826926.048122:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826926.048127:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 10 pid: 6478 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048135:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 10 pid: 6478 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048146:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d546e079c00/0xc0fefc09a79540eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467561 expref: 10 pid: 6478 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048158:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048166:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826926.048178:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006998888s 00010000:00010000:3.0:1787826926.048181:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048197:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048204:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048210:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048340:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113000 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787826926.048344:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048350:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048378:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.048386:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826926.048389:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826926.048396:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826926.048408:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345113000/0xc0fefc09a7954296 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826926.048428:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54516ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:291f6693-430f-40e2-b9af-10afb9cb8617+9:2391:x1874672134211968:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 315us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826926.048436:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 68 00010000:00080000:2.0:1787826926.048562:0:21553:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 21553 00010000:00080000:2.0:1787826926.048574:0:21553:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:2.0:1787826926.048578:0:21553:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:1.0:1787826926.048610:0:21537:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787826926.048639:0:21537:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787826926.048656:0:21537:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787826926.048669:0:21537:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787826926.049463:0:21537:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826926.049694:0:21537:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787826926.375265:0:21602:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826926.375465:0:21602:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787826926.674342:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826926.674363:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e072d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143735936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826926.674426:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826926.674482:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143735936 00000100:00100000:2.0:1787826926.674490:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143735936 00000100:00100000:2.0:1787826926.674536:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787826926.674546:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143735936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826926.674576:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826926.674624:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143735936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826926.674632:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787826926.674669:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e072d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143735936:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826926.801397:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826927.056917:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826927.056998:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134212096 00000100:00100000:0.0:1787826927.057010:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134212096 00000100:00100000:0.0:1787826927.057063:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 489 00000100:00100000:0.0:1787826927.057074:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+9:10866:x1874672134212096:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826927.057089:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826927.057108:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675b5 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826927.057135:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826927.057146:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826927.057155:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1e00, rc 0) 00000100:00100000:0.0:1787826927.057260:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134212096:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 142us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826927.057270:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 489 00000100:00100000:0.0:1787826927.058029:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826927.058064:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134212224 00000100:00100000:1.0:1787826927.058069:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134212224 00000100:00100000:1.0:1787826927.058094:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 490 00000100:00100000:1.0:1787826927.058101:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134212224:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826927.058114:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787826927.058127:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826927.058129:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787826927.058769:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134212224:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 667us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826927.058787:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 490 00000100:00100000:3.0:1787826927.059614:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.059668:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134212352 00000100:00100000:2.0:1787826927.059676:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134212352 00000100:00100000:2.0:1787826927.059702:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 187 00000100:00100000:2.0:1787826927.059707:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2389:x1874672134212352:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826927.059728:0:19008:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d53444b4800, cookie 0xc0fefc09a7954249 00010000:00080000:2.0:1787826927.059733:0:19008:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t25769803803 exp ffff8d53444b4800 cur 301 last 1787826926 00010000:02000400:2.0:1787826927.059738:0:19008:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:2.0:1787826927.063644:0:19008:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:2.0:1787826927.063663:0:19008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d53444b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 125329408 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787826927.063684:0:19008:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787826927.063865:0:19008:0:(import.c:65:import_set_state_nolock()) ffff8d53494c2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826927.063938:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134212352:12345-192.168.203.6@tcp:8:ll_cfg_requeue.0 Request processed in 4228us (4325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826927.063949:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 187 00000100:00100000:0.0:1787826927.065974:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.066019:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134212480 00000100:00100000:2.0:1787826927.066026:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134212480 00000100:00100000:2.0:1787826927.066069:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 188 00000100:00100000:2.0:1787826927.066076:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134212480:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787826927.066089:0:8399:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d546e0703c0 x1874672134212480/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 328/0 e 0 to 0 dl 1787826938 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826927.066103:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134212480:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 28us (135us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826927.066108:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 188 00010000:00080000:3.0:1787826927.066110:0:21553:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 10000000:01000000:3.0:1787826927.825279:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826927.825286:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 12 10000000:01000000:3.0:1787826927.825291:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826927.825336:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826927.825348:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826927.825359:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826927.825383:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826927.825471:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826927.825504:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736064 00000100:00100000:1.0:1787826927.825516:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736064 00000100:00100000:3.0:1787826927.825517:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5443801300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826927.825562:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1787826927.825571:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143736064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826927.825585:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826927.825590:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826927.825595:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79542a4 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826927.825615:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826927.825627:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826927.825647:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345113200, rc 0) 00000100:00100000:1.0:1787826927.825702:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143736064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826927.825710:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1787826927.825740:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826927.825756:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826927.825766:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826927.825826:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787826927.825857:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826927.825875:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5476386cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826927.825893:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736192 00000100:00100000:1.0:1787826927.825899:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736192 00000100:00100000:2.0:1787826927.825932:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1787826927.825939:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143736192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826927.825952:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826927.825964:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826927.825966:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787826927.826034:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143736192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826927.826040:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1787826927.826048:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736192:0@lo:256:ll_cfg_requeue.0 00000100:00080000:1.0:1787826927.826081:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 29, was 0): DISCONN 00010000:00080000:1.0:1787826927.826089:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:1.0:1787826927.826093:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826927.826097:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826927.826114:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e109e00 x1874672143736320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826927.826140:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143736320:0@lo:8:ll_cfg_requeue.0 10000000:01000000:1.0:1787826927.826145:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826927.826151:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826927.826158:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826927.826164:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787826927.826167:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787826927.826169:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 12 10000000:01000000:1.0:1787826927.826171:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787826927.826182:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826927.826194:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826927.826201:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736320 00010000:00010000:1.0:1787826927.826203:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826927.826207:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736320 00000100:00100000:1.0:1787826927.826241:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826927.826262:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787826927.826267:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143736320:12345-0@lo:8:ll_cfg_requeue.0 00000100:00100000:1.0:1787826927.826274:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787826927.826283:0:9498:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d5478923000, cookie 0xc0fefc09a795423b 00010000:00080000:2.0:1787826927.826288:0:9498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5478923000 cur 302 last 1787826926 00000100:00100000:1.0:1787826927.826302:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584840 going to sleep for 11 seconds 00002000:00100000:2.0:1787826927.826302:0:9498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d5478923000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787826927.826309:0:9498:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787826927.826312:0:9498:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787826927.826343:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736448 00000100:00100000:3.0:1787826927.826349:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736448 00000100:00100000:3.0:1787826927.826387:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1787826927.826397:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143736448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826927.826405:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826927.826414:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79542b2 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826927.826432:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826927.826451:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826927.826458:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e078400, rc 0) 00000100:00080000:2.0:1787826927.826475:0:9498:0:(import.c:65:import_set_state_nolock()) ffff8d53494c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826927.826497:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143736448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826927.826507:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1787826927.826510:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826927.826527:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826927.826528:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143736320:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 259us (363us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826927.826544:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826927.826546:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787826927.826583:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736576:0@lo:256:ll_cfg_requeue.0 00010000:00080000:2.0:1787826927.826584:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e109e00 x1874672143736320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826927.826598:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 7 00000100:00100000:1.0:1787826927.826608:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826927.826615:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00100000:1.0:1787826927.826620:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584840 going to sleep for 11 seconds 00000100:00080000:2.0:1787826927.826621:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787826927.826626:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:2.0:1787826927.826630:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00100000:1.0:1787826927.826633:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736576 00000100:00080000:2.0:1787826927.826634:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787826927.826638:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736576 00000100:00100000:1.0:1787826927.826666:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1787826927.826674:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143736576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826927.826685:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826927.826696:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826927.826699:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787826927.826740:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143736320:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787826927.826761:0:21850:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787826927.826764:0:21850:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1787826927.826781:0:21850:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1787826927.826790:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143736576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826927.826798:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00080000:2.0:1787826927.826813:0:21850:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787826927.826833:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143736576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787826927.826839:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143736704:0@lo:400:ldlm_lock_repla.0 00000100:00080000:1.0:1787826927.826858:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 29, was 0): DISCONN 00010000:00080000:1.0:1787826927.826864:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00100000:2.0:1787826927.826865:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826927.826868:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826927.826875:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787826927.826892:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e10b480 x1874672143736832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826927.826895:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736704 00000100:00100000:2.0:1787826927.826900:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736704 00000100:00100000:2.0:1787826927.826929:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 10000000:01000000:1.0:1787826927.826931:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826927.826937:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826927.826939:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143736704:12345-0@lo:400:ldlm_lock_repla.0 00010000:00010000:1.0:1787826927.826947:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787826927.826957:0:8401:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d53492670c0 x1874672143736704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:528/0 lens 224/0 e 0 to 0 dl 1787826938 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826927.826971:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143736832:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1787826927.826979:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143736704:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 43us (113us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826927.826984:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00080000:3.0:1787826927.826994:0:21553:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:1.0:1787826927.827002:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826927.827034:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736832 00000100:00100000:3.0:1787826927.827039:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736832 00000100:00100000:3.0:1787826927.827067:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787826927.827073:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143736832:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787826927.827088:0:19008:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d5478923800, cookie 0xc0fefc09a7954242 00010000:00080000:3.0:1787826927.827093:0:19008:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5478923800 cur 302 last 1787826926 00002000:00100000:3.0:1787826927.827103:0:19008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d5478923800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787826927.827107:0:19008:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787826927.827109:0:19008:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1787826927.827132:0:19008:0:(import.c:65:import_set_state_nolock()) ffff8d5344bd8800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1787826927.827156:0:21553:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:2.0:1787826927.827162:0:21553:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 25769803818 00010000:00080000:2.0:1787826927.827166:0:21553:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803818 00010000:00080000:2.0:1787826927.827170:0:21553:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803818 00000100:00100000:3.0:1787826927.827182:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143736832:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 107us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826927.827190:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00010000:00080000:1.0:1787826927.827245:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e10b480 x1874672143736832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826927.827256:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 7 00000100:00080000:1.0:1787826927.827262:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787826927.827265:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1787826927.827267:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000100:00080000:1.0:1787826927.827270:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 25769803780 last 0 00000100:00080000:1.0:1787826927.827279:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787826927.827448:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143736832:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787826927.827469:0:21851:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1787826927.827473:0:21851:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:3.0:1787826927.827477:0:21851:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:3.0:1787826927.827517:0:21851:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1787826927.827554:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143736960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1787826927.827585:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826927.827613:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143736960 00000100:00100000:3.0:1787826927.827617:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143736960 00000100:00100000:3.0:1787826927.827649:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787826927.827664:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143736960:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787826927.827675:0:8399:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d5349267840 x1874672143736960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:528/0 lens 224/0 e 0 to 0 dl 1787826938 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826927.827691:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143736960:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 28us (105us total) trans 0 rc 0/-999 00010000:00080000:2.0:1787826927.827701:0:21553:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 25769803818 00000100:00100000:3.0:1787826927.827701:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00010000:00080000:2.0:1787826927.827709:0:21553:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:2.0:1787826927.827716:0:21553:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826927.827718:0:21553:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826927.827726:0:21553:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d546e0703c0 x1874672134212480/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 328/0 e 0 to 0 dl 1787826938 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826927.827738:0:21553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826927.827756:0:21553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675a7 expref: -99 pid: 21553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826927.827788:0:21553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 6 pid: 21553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826927.827806:0:21553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 6 pid: 21553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826927.827815:0:21553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2600, rc 0) 00010000:00080000:2.0:1787826927.827859:0:21553:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1787826927.827869:0:21553:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1787826927.828874:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.828920:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134212608 00000100:00100000:2.0:1787826927.828924:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134212608 00000100:00100000:2.0:1787826927.828957:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 158 00000100:00100000:2.0:1787826927.828967:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134212608:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1787826927.828978:0:9498:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d534486f0c0 x1874672134212608/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 224/0 e 0 to 0 dl 1787826938 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826927.829004:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134212608:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 Request processed in 40us (164us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826927.829012:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 158 00010000:00080000:3.0:1787826927.829014:0:21553:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787826927.829114:0:21553:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00100000:1.0:1787826927.830433:0:21538:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:1.0:1787826927.830437:0:21538:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787826927.830439:0:21538:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:2.0:1787826927.830620:0:21553:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:2.0:1787826927.830630:0:21553:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d53492670c0 x1874672143736704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:528/0 lens 224/0 e 0 to 0 dl 1787826938 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826927.830700:0:21553:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d5349267840 x1874672143736960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:528/0 lens 224/0 e 0 to 0 dl 1787826938 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826927.830716:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787826927.830726:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d53492652c0 x1874672143736704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826943 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826927.830737:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d53492652c0 x1874672143736704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826943 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826927.830747:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00010000:00080000:2.0:1787826927.830747:0:21553:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d534486f0c0 x1874672134212608/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 224/0 e 0 to 0 dl 1787826938 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787826927.830764:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1787826927.830781:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00010000:02000000:2.0:1787826927.830805:0:21553:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:3.0:1787826927.835748:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835790:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835833:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835851:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835862:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835877:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835889:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835913:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.835934:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134208896 00000100:00100000:3.0:1787826927.835942:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134208896 00002000:00100000:3.0:1787826927.835989:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (155189248->159383551) req@ffff8d534486cf00 x1874672134208896/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836001:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486cf00 with x1874672134208896 ext(155189248->159383551) 00002000:00010000:3.0:1787826927.836020:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486cf00 00000100:00100000:3.0:1787826927.836034:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209408 00000100:00100000:3.0:1787826927.836038:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209408 00002000:00100000:3.0:1787826927.836053:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (171966464->176160767) req@ffff8d546e0fd2c0 x1874672134209408/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836060:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0fd2c0 with x1874672134209408 ext(171966464->176160767) 00002000:00010000:3.0:1787826927.836064:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0fd2c0 00000100:00100000:3.0:1787826927.836071:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209024 00000100:00100000:3.0:1787826927.836073:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209024 00002000:00100000:3.0:1787826927.836093:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (159383552->163577855) req@ffff8d546e0fc000 x1874672134209024/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836100:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0fc000 with x1874672134209024 ext(159383552->163577855) 00002000:00010000:3.0:1787826927.836104:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0fc000 00000100:00100000:3.0:1787826927.836118:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210432 00000100:00100000:3.0:1787826927.836122:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210432 00002000:00100000:3.0:1787826927.836133:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (188743680->192937983) req@ffff8d53439c3840 x1874672134210432/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836140:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53439c3840 with x1874672134210432 ext(188743680->192937983) 00002000:00010000:3.0:1787826927.836144:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53439c3840 00000100:00100000:3.0:1787826927.836148:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134210304 00000100:00100000:3.0:1787826927.836150:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134210304 00002000:00100000:3.0:1787826927.836160:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (184549376->188743679) req@ffff8d5343b0f480 x1874672134210304/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836167:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0f480 with x1874672134210304 ext(184549376->188743679) 00002000:00010000:3.0:1787826927.836170:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0f480 00000100:00100000:3.0:1787826927.836183:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209280 00000100:00100000:3.0:1787826927.836191:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209280 00002000:00100000:3.0:1787826927.836203:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (167772160->171966463) req@ffff8d5343b0da40 x1874672134209280/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836211:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0da40 with x1874672134209280 ext(167772160->171966463) 00002000:00010000:3.0:1787826927.836230:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0da40 00000100:00100000:3.0:1787826927.836239:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209664 00000100:00100000:3.0:1787826927.836242:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209664 00002000:00100000:3.0:1787826927.836253:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (180355072->184549375) req@ffff8d546f6a2580 x1874672134209664/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836260:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a2580 with x1874672134209664 ext(180355072->184549375) 00002000:00010000:3.0:1787826927.836263:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a2580 00000100:00100000:3.0:1787826927.836268:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209536 00000100:00100000:3.0:1787826927.836270:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209536 00002000:00100000:3.0:1787826927.836279:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (176160768->180355071) req@ffff8d547f74e940 x1874672134209536/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836286:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f74e940 with x1874672134209536 ext(176160768->180355071) 00002000:00010000:3.0:1787826927.836289:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f74e940 00000100:00100000:3.0:1787826927.836294:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134209152 00000100:00100000:3.0:1787826927.836296:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134209152 00002000:00100000:3.0:1787826927.836305:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (163577856->167772159) req@ffff8d5342441e00 x1874672134209152/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.836311:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342441e00 with x1874672134209152 ext(163577856->167772159) 00002000:00010000:3.0:1787826927.836314:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342441e00 00000100:00100000:3.0:1787826927.836324:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:3.0:1787826927.836332:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134208896:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826927.836566:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:3.0:1787826927.836574:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134209408:12345-192.168.203.6@tcp:4:iozone.0 00002000:00080000:2.0:1787826927.837429:0:21553:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787826927.837434:0:21553:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:3.0:1787826927.838322:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143737088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826927.838330:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143737216:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787826927.838391:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826927.838408:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826927.838418:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5476386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826927.838445:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737088 00000100:00100000:2.0:1787826927.838450:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737088 00000100:00100000:2.0:1787826927.838490:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787826927.838499:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143737088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826927.838514:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 125609408 pending 8437760 free 3768324096 avail 3536801792 00000100:00100000:2.0:1787826927.838558:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143737088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826927.838564:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787826927.838588:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737216 00000100:00100000:2.0:1787826927.838597:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737216 00000100:00100000:2.0:1787826927.838617:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787826927.838623:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143737216:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787826927.838765:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143737088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826927.839049:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143736704:0@lo:400:ldlm_lock_repla.0 00000100:00080000:1.0:1787826927.839082:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787826927.839090:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d53492c8f00 x1874672143736960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826943 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826927.839102:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d53492c8f00 x1874672143736960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826943 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826927.839111:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1787826927.839124:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1787826927.839129:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826927.839135:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143736960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826927.839202:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143737344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826927.839208:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143737472:0@lo:7:osp-pre-0-0.0 00000100:00100000:1.0:1787826927.839289:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826927.839312:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5474584840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826927.839330:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737472 00000100:00100000:3.0:1787826927.839332:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826927.839335:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737472 00000100:00100000:1.0:1787826927.839373:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787826927.839390:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143737472:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:1.0:1787826927.839499:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737344 00000100:00100000:1.0:1787826927.839503:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737344 00002000:00080000:2.0:1787826927.839519:0:8401:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787826927.839524:0:8401:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787826927.839532:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787826927.839540:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143737344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826927.839552:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 125609408 pending 8437760 free 3768324096 avail 3536801792 00000100:00100000:2.0:1787826927.839560:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143737216:12345-0@lo:7:osp-pre-0-1.0 Request processed in 936us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826927.839568:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787826927.839576:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143737216:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787826927.839588:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787826927.839616:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143737344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826927.839623:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00002000:00080000:1.0:1787826927.839647:0:19008:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000100:00100000:2.0:1787826927.839648:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143737344:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787826927.839651:0:19008:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:1.0:1787826927.839684:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143737472:12345-0@lo:7:osp-pre-0-0.0 Request processed in 296us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826927.839691:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787826927.839700:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143737472:0@lo:7:osp-pre-0-0.0 00000004:00080000:2.0:1787826927.839709:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x21:0x0] 00000100:00100000:0.0:1787826927.854499:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2393:x1874672134208896:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18157us (18747us total) trans 30064771073 rc 0/0 00000100:00100000:0.0:1787826927.854520:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 68 00002000:00100000:0.0:1787826927.854532:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (155189248->159383551) req@ffff8d534486cf00 x1874672134208896/t30064771073(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.854543:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486cf00 with x1874672134208896 ext(155189248->159383551) 00002000:00010000:0.0:1787826927.854555:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486cf00 00000100:00100000:0.0:1787826927.854595:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:0.0:1787826927.854607:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134209024:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826927.861278:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134209408:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24695us (25477us total) trans 30064771074 rc 0/0 00000100:00100000:2.0:1787826927.861292:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 69 00002000:00100000:2.0:1787826927.861306:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (171966464->176160767) req@ffff8d546e0fd2c0 x1874672134209408/t30064771074(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.861316:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0fd2c0 with x1874672134209408 ext(171966464->176160767) 00002000:00010000:2.0:1787826927.861328:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0fd2c0 00000100:00100000:2.0:1787826927.861364:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 71 00000100:00100000:2.0:1787826927.861385:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2393:x1874672134210432:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826927.864386:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.864419:0:16779:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787826927.864428:0:16779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787826927.864584:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134213888 00000100:00100000:2.0:1787826927.864592:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134213888 00002000:00100000:2.0:1787826927.864635:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (192937984->197132287) req@ffff8d53492652c0 x1874672134213888/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.864648:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492652c0 with x1874672134213888 ext(192937984->197132287) 00002000:00010000:2.0:1787826927.864654:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492652c0 00000100:00100000:0.0:1787826927.865136:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 72 00000100:00100000:0.0:1787826927.865148:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+21:2392:x1874672134210304:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.868257:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134209024:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13644us (32431us total) trans 30064771075 rc 0/0 00000100:00100000:0.0:1787826927.868272:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 70 00002000:00100000:0.0:1787826927.868285:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (159383552->163577855) req@ffff8d546e0fc000 x1874672134209024/t30064771075(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.868296:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0fc000 with x1874672134209024 ext(159383552->163577855) 00002000:00010000:0.0:1787826927.868308:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0fc000 00000100:00100000:0.0:1787826927.868345:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 73 00000100:00100000:0.0:1787826927.868357:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+19:2390:x1874672134209280:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.871095:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826927.871188:0:16779:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787826927.871208:0:16779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1787826927.871476:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214016 00000100:00100000:1.0:1787826927.871490:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214016 00002000:00100000:1.0:1787826927.871551:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (197132288->201326591) req@ffff8d546e0730c0 x1874672134214016/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826927.871564:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0730c0 with x1874672134214016 ext(197132288->201326591) 00002000:00010000:1.0:1787826927.871570:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0730c0 00000100:00100000:0.0:1787826927.872109:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 74 00000100:00100000:0.0:1787826927.872124:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134209664:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826927.873581:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826927.873619:0:16779:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1787826927.873637:0:16779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:1.0:1787826927.873756:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214144 00000100:00100000:1.0:1787826927.873765:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214144 00002000:00100000:1.0:1787826927.873818:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (201326592->205520895) req@ffff8d546e108780 x1874672134214144/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826927.873830:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e108780 with x1874672134214144 ext(201326592->205520895) 00002000:00010000:1.0:1787826927.873836:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e108780 00000100:00100000:1.0:1787826927.874352:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 75 00000100:00100000:1.0:1787826927.874365:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2392:x1874672134209536:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.877401:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+25:2393:x1874672134210432:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16004us (41542us total) trans 30064771076 rc 0/0 00000100:00100000:0.0:1787826927.877415:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 71 00002000:00100000:0.0:1787826927.877429:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (188743680->192937983) req@ffff8d53439c3840 x1874672134210432/t30064771076(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.877440:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53439c3840 with x1874672134210432 ext(188743680->192937983) 00002000:00010000:0.0:1787826927.877456:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53439c3840 00000100:00100000:0.0:1787826927.877491:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 76 00000100:00100000:0.0:1787826927.877509:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134209152:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.884401:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+27:2390:x1874672134209280:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16040us (48529us total) trans 30064771077 rc 0/0 00000100:00100000:0.0:1787826927.884419:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 73 00002000:00100000:0.0:1787826927.884429:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (167772160->171966463) req@ffff8d5343b0da40 x1874672134209280/t30064771077(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.884437:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0da40 with x1874672134209280 ext(167772160->171966463) 00002000:00010000:0.0:1787826927.884448:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0da40 00000100:00100000:0.0:1787826927.884480:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 77 00000100:00100000:0.0:1787826927.884488:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134213888:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826927.892979:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134210304:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 27814us (57106us total) trans 30064771078 rc 0/0 00000100:00100000:1.0:1787826927.892995:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 72 00002000:00100000:1.0:1787826927.893012:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (184549376->188743679) req@ffff8d5343b0f480 x1874672134210304/t30064771078(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826927.893022:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0f480 with x1874672134210304 ext(184549376->188743679) 00002000:00010000:1.0:1787826927.893040:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0f480 00000100:00100000:1.0:1787826927.893087:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 78 00000100:00100000:1.0:1787826927.893103:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+29:2393:x1874672134214016:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.894020:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826927.894069:0:16779:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:1.0:1787826927.894080:0:16779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_007' 00000100:00100000:3.0:1787826927.894281:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214272 00000100:00100000:3.0:1787826927.894297:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214272 00002000:00100000:3.0:1787826927.894354:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (205520896->209715199) req@ffff8d546e070780 x1874672134214272/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.894367:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e070780 with x1874672134214272 ext(205520896->209715199) 00002000:00010000:3.0:1787826927.894373:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e070780 00000100:00100000:0.0:1787826927.894848:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 79 00000100:00100000:0.0:1787826927.894862:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+31:2392:x1874672134214144:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.896605:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134209664:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24480us (60721us total) trans 30064771079 rc 0/0 00000100:00100000:0.0:1787826927.896616:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 74 00002000:00100000:0.0:1787826927.896627:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (180355072->184549375) req@ffff8d546f6a2580 x1874672134209664/t30064771079(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.896639:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a2580 with x1874672134209664 ext(180355072->184549375) 00002000:00010000:0.0:1787826927.896652:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a2580 00000100:00100000:0.0:1787826927.896682:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 80 00000100:00100000:0.0:1787826927.896690:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+29:2392:x1874672134214272:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.902956:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134209152:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 25438us (67023us total) trans 30064771080 rc 0/0 00000100:00100000:0.0:1787826927.902970:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 76 00002000:00100000:0.0:1787826927.902982:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (163577856->167772159) req@ffff8d5342441e00 x1874672134209152/t30064771080(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.902993:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342441e00 with x1874672134209152 ext(163577856->167772159) 00002000:00010000:0.0:1787826927.903005:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342441e00 00000100:00100000:0.0:1787826927.903340:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826927.903364:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214400 00000100:00100000:0.0:1787826927.903376:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214400 00002000:00100000:0.0:1787826927.903406:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (209715200->213909503) req@ffff8d546e072d00 x1874672134214400/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.903415:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e072d00 with x1874672134214400 ext(209715200->213909503) 00002000:00010000:0.0:1787826927.903419:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e072d00 00000100:00100000:0.0:1787826927.903437:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 81 00000100:00100000:0.0:1787826927.903444:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134214400:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826927.909720:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134209536:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 35343us (73813us total) trans 30064771081 rc 0/0 00000100:00100000:1.0:1787826927.909739:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 75 00002000:00100000:1.0:1787826927.909758:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (176160768->180355071) req@ffff8d547f74e940 x1874672134209536/t30064771081(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826927.909795:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f74e940 with x1874672134209536 ext(176160768->180355071) 00002000:00010000:1.0:1787826927.909810:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f74e940 00000100:00100000:0.0:1787826927.914900:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134213888:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 30403us (50514us total) trans 30064771082 rc 0/0 00000100:00100000:0.0:1787826927.914916:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 77 00002000:00100000:0.0:1787826927.914931:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (192937984->197132287) req@ffff8d53492652c0 x1874672134213888/t30064771082(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.914942:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492652c0 with x1874672134213888 ext(192937984->197132287) 00002000:00010000:0.0:1787826927.914949:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492652c0 00000100:00100000:3.0:1787826927.917871:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826927.917929:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214528 00000100:00100000:1.0:1787826927.917938:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214528 00002000:00100000:1.0:1787826927.917977:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (213909504->218103807) req@ffff8d5342442580 x1874672134214528/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826927.917989:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342442580 with x1874672134214528 ext(213909504->218103807) 00002000:00010000:1.0:1787826927.917994:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342442580 00000100:00100000:1.0:1787826927.918023:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 82 00000100:00100000:1.0:1787826927.918033:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134214528:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826927.919822:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134214016:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 26718us (48728us total) trans 30064771083 rc 0/0 00000100:00100000:2.0:1787826927.919835:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 78 00002000:00100000:2.0:1787826927.919846:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (197132288->201326591) req@ffff8d546e0730c0 x1874672134214016/t30064771083(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.919856:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0730c0 with x1874672134214016 ext(197132288->201326591) 00002000:00010000:2.0:1787826927.919862:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0730c0 00000100:00100000:1.0:1787826927.923103:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.923133:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214656 00000100:00100000:2.0:1787826927.923142:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214656 00002000:00100000:2.0:1787826927.923184:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (218103808->222298111) req@ffff8d546e10b480 x1874672134214656/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.923196:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10b480 with x1874672134214656 ext(218103808->222298111) 00002000:00010000:2.0:1787826927.923202:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10b480 00000100:00100000:2.0:1787826927.923264:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:2.0:1787826927.923278:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134214656:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.924745:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134214272:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 28053us (30728us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1787826927.924754:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 80 00002000:00100000:0.0:1787826927.924761:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (205520896->209715199) req@ffff8d546e070780 x1874672134214272/t30064771084(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.924780:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e070780 with x1874672134214272 ext(205520896->209715199) 00002000:00010000:0.0:1787826927.924784:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e070780 00000100:00100000:2.0:1787826927.924875:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.925128:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214784 00000100:00100000:3.0:1787826927.925134:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214784 00002000:00100000:3.0:1787826927.925169:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (222298112->226492415) req@ffff8d53492643c0 x1874672134214784/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.926144:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492643c0 with x1874672134214784 ext(222298112->226492415) 00002000:00010000:3.0:1787826927.926148:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492643c0 00000100:00100000:2.0:1787826927.926699:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 84 00000100:00100000:2.0:1787826927.926713:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134214784:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.930553:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134214144:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 35685us (56971us total) trans 30064771085 rc 0/0 00000100:00100000:0.0:1787826927.930568:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 79 00002000:00100000:0.0:1787826927.930588:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (201326592->205520895) req@ffff8d546e108780 x1874672134214144/t30064771085(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.930599:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e108780 with x1874672134214144 ext(201326592->205520895) 00002000:00010000:0.0:1787826927.930605:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e108780 00000100:00100000:0.0:1787826927.936527:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2390:x1874672134214400:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 33072us (33177us total) trans 30064771086 rc 0/0 00000100:00100000:0.0:1787826927.936543:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 81 00002000:00100000:0.0:1787826927.936557:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (209715200->213909503) req@ffff8d546e072d00 x1874672134214400/t30064771086(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.936568:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e072d00 with x1874672134214400 ext(209715200->213909503) 00002000:00010000:0.0:1787826927.936575:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e072d00 00000100:00100000:1.0:1787826927.940573:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.940624:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134214912 00000100:00100000:2.0:1787826927.940634:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134214912 00002000:00100000:2.0:1787826927.940682:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (226492416->230686719) req@ffff8d546e109e00 x1874672134214912/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.940695:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e109e00 with x1874672134214912 ext(226492416->230686719) 00002000:00010000:2.0:1787826927.940702:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e109e00 00000100:00100000:2.0:1787826927.940739:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 85 00000100:00100000:2.0:1787826927.940751:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134214912:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.942026:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826927.942057:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215040 00000100:00100000:0.0:1787826927.942063:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215040 00002000:00100000:0.0:1787826927.942092:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (230686720->234881023) req@ffff8d545aa7c780 x1874672134215040/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.942103:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7c780 with x1874672134215040 ext(230686720->234881023) 00002000:00010000:0.0:1787826927.942107:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7c780 00000100:00100000:0.0:1787826927.942131:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:0.0:1787826927.942141:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134215040:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.943260:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134214528:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 25227us (25497us total) trans 30064771087 rc 0/0 00000100:00100000:0.0:1787826927.943271:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 82 00002000:00100000:0.0:1787826927.943281:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (213909504->218103807) req@ffff8d5342442580 x1874672134214528/t30064771087(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.943297:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342442580 with x1874672134214528 ext(213909504->218103807) 00002000:00010000:0.0:1787826927.943301:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342442580 00000100:00100000:1.0:1787826927.950409:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134214656:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 27125us (27304us total) trans 30064771088 rc 0/0 00000100:00100000:1.0:1787826927.950444:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 83 00002000:00100000:1.0:1787826927.950459:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (218103808->222298111) req@ffff8d546e10b480 x1874672134214656/t30064771088(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826927.950471:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10b480 with x1874672134214656 ext(218103808->222298111) 00002000:00010000:1.0:1787826927.950477:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10b480 00000100:00100000:0.0:1787826927.954347:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826927.954376:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215168 00000100:00100000:0.0:1787826927.954383:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215168 00000100:00100000:2.0:1787826927.954405:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+45:2392:x1874672134214784:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 27688us (29520us total) trans 30064771089 rc 0/0 00002000:00100000:0.0:1787826927.954417:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (234881024->239075327) req@ffff8d547d2b2d00 x1874672134215168/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787826927.954422:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 84 00002000:00100000:0.0:1787826927.954432:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b2d00 with x1874672134215168 ext(234881024->239075327) 00002000:00100000:2.0:1787826927.954435:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (222298112->226492415) req@ffff8d53492643c0 x1874672134214784/t30064771089(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1787826927.954439:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b2d00 00002000:00100000:2.0:1787826927.954449:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492643c0 with x1874672134214784 ext(222298112->226492415) 00002000:00010000:2.0:1787826927.954460:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492643c0 00000100:00100000:0.0:1787826927.954472:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 87 00000100:00100000:0.0:1787826927.954482:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134215168:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826927.962392:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134214912:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21214us (21397us total) trans 30064771090 rc 0/0 00000100:00100000:3.0:1787826927.962415:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 85 00002000:00100000:3.0:1787826927.962648:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (226492416->230686719) req@ffff8d546e109e00 x1874672134214912/t30064771090(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.962657:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e109e00 with x1874672134214912 ext(226492416->230686719) 00002000:00010000:3.0:1787826927.962663:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e109e00 00000100:00100000:1.0:1787826927.964317:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826927.964348:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215296 00000100:00100000:1.0:1787826927.964355:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215296 00002000:00100000:1.0:1787826927.964393:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (239075328->243269631) req@ffff8d546e10bc00 x1874672134215296/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826927.964428:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10bc00 with x1874672134215296 ext(239075328->243269631) 00002000:00010000:1.0:1787826927.964433:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10bc00 00000100:00100000:1.0:1787826927.964461:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 88 00000100:00100000:1.0:1787826927.964472:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134215296:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826927.967493:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134215040:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 25346us (25464us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1787826927.967507:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 86 00002000:00100000:2.0:1787826927.967519:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (230686720->234881023) req@ffff8d545aa7c780 x1874672134215040/t30064771091(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.967530:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7c780 with x1874672134215040 ext(230686720->234881023) 00002000:00010000:2.0:1787826927.967536:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7c780 00000100:00100000:2.0:1787826927.971950:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826927.972009:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215424 00000100:00100000:0.0:1787826927.972019:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215424 00002000:00100000:0.0:1787826927.972065:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (243269632->247463935) req@ffff8d53492bfc00 x1874672134215424/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.972077:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bfc00 with x1874672134215424 ext(243269632->247463935) 00002000:00010000:0.0:1787826927.972084:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bfc00 00000100:00100000:3.0:1787826927.972133:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 89 00000100:00100000:3.0:1787826927.972148:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134215424:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826927.972290:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+49:2393:x1874672134215168:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17807us (17947us total) trans 30064771092 rc 0/0 00000100:00100000:2.0:1787826927.972300:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 87 00002000:00100000:2.0:1787826927.972307:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (234881024->239075327) req@ffff8d547d2b2d00 x1874672134215168/t30064771092(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.972318:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b2d00 with x1874672134215168 ext(234881024->239075327) 00002000:00010000:2.0:1787826927.972322:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b2d00 00000100:00100000:1.0:1787826927.976916:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826927.976970:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215552 00000100:00100000:3.0:1787826927.976979:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215552 00002000:00100000:3.0:1787826927.978500:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (247463936->251658239) req@ffff8d546e10ad00 x1874672134215552/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.978514:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10ad00 with x1874672134215552 ext(247463936->251658239) 00002000:00010000:3.0:1787826927.978520:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10ad00 00000100:00100000:1.0:1787826927.978584:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 90 00000100:00100000:1.0:1787826927.978600:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134215552:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826927.978762:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+51:2392:x1874672134215296:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14290us (14447us total) trans 30064771093 rc 0/0 00000100:00100000:2.0:1787826927.978785:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 88 00002000:00100000:2.0:1787826927.978794:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (239075328->243269631) req@ffff8d546e10bc00 x1874672134215296/t30064771093(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.978804:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10bc00 with x1874672134215296 ext(239075328->243269631) 00002000:00010000:2.0:1787826927.978808:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10bc00 00000100:00100000:2.0:1787826927.985051:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.985077:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215680 00000100:00100000:2.0:1787826927.985085:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215680 00002000:00100000:2.0:1787826927.985122:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (251658240->255852543) req@ffff8d53492be940 x1874672134215680/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.985135:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be940 with x1874672134215680 ext(251658240->255852543) 00002000:00010000:2.0:1787826927.985140:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be940 00000100:00100000:2.0:1787826927.985163:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 91 00000100:00100000:2.0:1787826927.985171:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134215680:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826927.987561:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134215424:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15412us (15612us total) trans 30064771094 rc 0/0 00000100:00100000:3.0:1787826927.987576:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 89 00002000:00100000:3.0:1787826927.987588:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (243269632->247463935) req@ffff8d53492bfc00 x1874672134215424/t30064771094(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826927.987598:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bfc00 with x1874672134215424 ext(243269632->247463935) 00002000:00010000:3.0:1787826927.987604:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bfc00 00000100:00100000:2.0:1787826927.993787:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826927.993990:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215808 00000100:00100000:0.0:1787826927.993997:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215808 00002000:00100000:0.0:1787826927.994029:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (255852544->260046847) req@ffff8d53492bc3c0 x1874672134215808/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.994038:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bc3c0 with x1874672134215808 ext(255852544->260046847) 00002000:00010000:0.0:1787826927.994042:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bc3c0 00000100:00100000:0.0:1787826927.994194:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 92 00000100:00100000:0.0:1787826927.994206:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+56:2393:x1874672134215808:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826927.998354:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+58:2393:x1874672134215552:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19752us (21438us total) trans 30064771095 rc 0/0 00000100:00100000:0.0:1787826927.998368:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 90 00002000:00100000:0.0:1787826927.998382:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (247463936->251658239) req@ffff8d546e10ad00 x1874672134215552/t30064771095(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826927.998395:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10ad00 with x1874672134215552 ext(247463936->251658239) 00002000:00010000:0.0:1787826927.998402:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10ad00 00000100:00100000:2.0:1787826927.999329:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826927.999354:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134215936 00000100:00100000:2.0:1787826927.999360:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134215936 00002000:00100000:2.0:1787826927.999389:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (260046848->264241151) req@ffff8d53492bd680 x1874672134215936/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1787826938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826927.999397:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bd680 with x1874672134215936 ext(260046848->264241151) 00002000:00010000:2.0:1787826927.999400:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bd680 00000100:00100000:2.0:1787826927.999420:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:2.0:1787826927.999427:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+58:2393:x1874672134215936:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826928.001783:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+58:2393:x1874672134215680:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16593us (16720us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1787826928.001799:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 91 00002000:00100000:0.0:1787826928.001811:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (251658240->255852543) req@ffff8d53492be940 x1874672134215680/t30064771096(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826928.001822:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be940 with x1874672134215680 ext(251658240->255852543) 00002000:00010000:0.0:1787826928.001827:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be940 00000100:00100000:3.0:1787826928.007238:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+58:2393:x1874672134215808:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13008us (13445us total) trans 30064771097 rc 0/0 00000100:00100000:3.0:1787826928.007249:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 92 00002000:00100000:3.0:1787826928.007267:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (255852544->260046847) req@ffff8d53492bc3c0 x1874672134215808/t30064771097(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826928.007274:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bc3c0 with x1874672134215808 ext(255852544->260046847) 00002000:00010000:3.0:1787826928.007279:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bc3c0 00000100:00100000:2.0:1787826928.007444:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826928.007475:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216064 00000100:00100000:3.0:1787826928.007484:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216064 00002000:00100000:3.0:1787826928.007559:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (264241152->268435455) req@ffff8d53492be580 x1874672134216064/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826928.007565:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be580 with x1874672134216064 ext(264241152->268435455) 00002000:00010000:3.0:1787826928.007567:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be580 00000100:00100000:3.0:1787826928.007588:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 94 00000100:00100000:3.0:1787826928.007594:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+58:2393:x1874672134216064:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826928.012870:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+60:2393:x1874672134215936:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13436us (13535us total) trans 30064771098 rc 0/0 00000100:00100000:2.0:1787826928.012883:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 93 00002000:00100000:2.0:1787826928.012893:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (260046848->264241151) req@ffff8d53492bd680 x1874672134215936/t30064771098(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:528/0 lens 488/448 e 0 to 0 dl 1787826938 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826928.012901:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bd680 with x1874672134215936 ext(260046848->264241151) 00002000:00010000:2.0:1787826928.012906:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bd680 00000100:00100000:2.0:1787826928.013571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826928.013594:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216192 00000100:00100000:2.0:1787826928.013600:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216192 00002000:00100000:2.0:1787826928.013627:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (268435456->272629759) req@ffff8d534479f0c0 x1874672134216192/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826928.013633:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479f0c0 with x1874672134216192 ext(268435456->272629759) 00002000:00010000:2.0:1787826928.013635:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479f0c0 00000100:00100000:2.0:1787826928.013654:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 95 00000100:00100000:2.0:1787826928.013668:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+60:2392:x1874672134216192:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826928.020946:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826928.020996:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216320 00000100:00100000:0.0:1787826928.021004:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216320 00002000:00100000:0.0:1787826928.021043:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (272629760->276824063) req@ffff8d546e109a40 x1874672134216320/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826928.021055:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e109a40 with x1874672134216320 ext(272629760->276824063) 00002000:00010000:0.0:1787826928.021061:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e109a40 00000100:00100000:0.0:1787826928.021095:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 96 00000100:00100000:0.0:1787826928.021104:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+64:2392:x1874672134216320:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826928.025700:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+64:2393:x1874672134216064:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18093us (18247us total) trans 30064771099 rc 0/0 00000100:00100000:2.0:1787826928.025716:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 94 00002000:00100000:2.0:1787826928.025729:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (264241152->268435455) req@ffff8d53492be580 x1874672134216064/t30064771099(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826928.025740:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be580 with x1874672134216064 ext(264241152->268435455) 00002000:00010000:2.0:1787826928.025747:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be580 00000100:00100000:3.0:1787826928.031990:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826928.032044:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216448 00000100:00100000:1.0:1787826928.032054:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216448 00002000:00100000:1.0:1787826928.032107:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (276824064->281018367) req@ffff8d53424421c0 x1874672134216448/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826928.032120:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53424421c0 with x1874672134216448 ext(276824064->281018367) 00002000:00010000:1.0:1787826928.032126:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53424421c0 00000100:00100000:1.0:1787826928.032156:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 97 00000100:00100000:1.0:1787826928.032174:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+66:2392:x1874672134216448:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826928.033198:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+66:2392:x1874672134216192:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19528us (19624us total) trans 30064771100 rc 0/0 00000100:00100000:1.0:1787826928.033234:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 95 00002000:00100000:1.0:1787826928.033243:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (268435456->272629759) req@ffff8d534479f0c0 x1874672134216192/t30064771100(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826928.033254:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479f0c0 with x1874672134216192 ext(268435456->272629759) 00002000:00010000:1.0:1787826928.033265:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479f0c0 00000100:00100000:1.0:1787826928.038399:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+66:2392:x1874672134216320:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17284us (17459us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1787826928.038412:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 96 00002000:00100000:1.0:1787826928.038424:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (272629760->276824063) req@ffff8d546e109a40 x1874672134216320/t30064771101(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826928.038434:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e109a40 with x1874672134216320 ext(272629760->276824063) 00002000:00010000:1.0:1787826928.038440:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e109a40 00000001:02000400:0.0:1787826928.039103:0:21897:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787826928.045920:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+66:2392:x1874672134216448:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13744us (14248us total) trans 30064771102 rc 0/0 00000100:00100000:2.0:1787826928.045934:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 97 00002000:00100000:2.0:1787826928.045946:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (276824064->281018367) req@ffff8d53424421c0 x1874672134216448/t30064771102(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826928.045958:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53424421c0 with x1874672134216448 ext(276824064->281018367) 00002000:00010000:2.0:1787826928.045964:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53424421c0 00000100:00100000:3.0:1787826928.240871:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826928.240909:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216576 00000100:00100000:2.0:1787826928.240919:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216576 00002000:00100000:2.0:1787826928.240962:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (281018368->285212671) req@ffff8d5342443480 x1874672134216576/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826928.240975:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342443480 with x1874672134216576 ext(281018368->285212671) 00002000:00010000:2.0:1787826928.240981:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342443480 00000100:00100000:2.0:1787826928.241011:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 98 00000100:00100000:2.0:1787826928.241023:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+66:2391:x1874672134216576:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826928.256578:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+68:2391:x1874672134216576:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15550us (15704us total) trans 30064771103 rc 0/0 00000100:00100000:2.0:1787826928.256591:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 98 00002000:00100000:2.0:1787826928.256603:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (281018368->285212671) req@ffff8d5342443480 x1874672134216576/t30064771103(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826928.256612:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342443480 with x1874672134216576 ext(281018368->285212671) 00002000:00010000:2.0:1787826928.256617:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342443480 00000020:00000004:2.0:1787826928.371434:0:21949:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826928.371648:0:21949:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787826928.501572:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826928.501694:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216704 00000100:00100000:1.0:1787826928.501705:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216704 00002000:00100000:1.0:1787826928.501788:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (285212672->289406975) req@ffff8d5342440b40 x1874672134216704/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826928.501800:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342440b40 with x1874672134216704 ext(285212672->289406975) 00002000:00010000:1.0:1787826928.501806:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342440b40 00000100:00100000:1.0:1787826928.501839:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 99 00000100:00100000:1.0:1787826928.501849:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+68:2393:x1874672134216704:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826928.515866:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+70:2393:x1874672134216704:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14002us (14295us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1787826928.515882:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 99 00002000:00100000:1.0:1787826928.515897:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (285212672->289406975) req@ffff8d5342440b40 x1874672134216704/t30064771104(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826928.515907:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342440b40 with x1874672134216704 ext(285212672->289406975) 00002000:00010000:1.0:1787826928.515914:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342440b40 00000020:00000004:1.0:1787826928.692062:0:21999:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826928.692194:0:21999:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826928.725052:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826928.725106:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216832 00000100:00100000:1.0:1787826928.725115:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216832 00002000:00100000:1.0:1787826928.725155:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (289406976->293601279) req@ffff8d534355da40 x1874672134216832/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826928.725163:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355da40 with x1874672134216832 ext(289406976->293601279) 00002000:00010000:1.0:1787826928.725167:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355da40 00000100:00100000:1.0:1787826928.725195:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 100 00000100:00100000:1.0:1787826928.725203:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+70:2392:x1874672134216832:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826928.736603:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+72:2392:x1874672134216832:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11394us (11552us total) trans 30064771105 rc 0/0 00000100:00100000:1.0:1787826928.736617:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 100 00002000:00100000:1.0:1787826928.736630:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (289406976->293601279) req@ffff8d534355da40 x1874672134216832/t30064771105(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826928.736641:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355da40 with x1874672134216832 ext(289406976->293601279) 00002000:00010000:1.0:1787826928.736646:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355da40 00010000:00010000:2.0:1787826928.849432:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826928.962274:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826928.962349:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134216960 00000100:00100000:0.0:1787826928.962360:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134216960 00002000:00100000:0.0:1787826928.962413:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (293601280->297795583) req@ffff8d546e109680 x1874672134216960/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/0 e 0 to 0 dl 1787826939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826928.962425:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e109680 with x1874672134216960 ext(293601280->297795583) 00002000:00010000:0.0:1787826928.962430:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e109680 00000100:00100000:0.0:1787826928.962466:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 101 00000100:00100000:0.0:1787826928.962475:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+72:2393:x1874672134216960:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826928.976865:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+74:2393:x1874672134216960:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14374us (14584us total) trans 30064771106 rc 0/0 00000100:00100000:0.0:1787826928.976881:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 101 00002000:00100000:0.0:1787826928.976894:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (293601280->297795583) req@ffff8d546e109680 x1874672134216960/t30064771106(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:529/0 lens 488/448 e 0 to 0 dl 1787826939 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826928.976906:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e109680 with x1874672134216960 ext(293601280->297795583) 00002000:00010000:0.0:1787826928.976912:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e109680 00000100:00100000:1.0:1787826929.203455:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826929.203510:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217088 00000100:00100000:0.0:1787826929.203519:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217088 00002000:00100000:0.0:1787826929.203581:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (297795584->301989887) req@ffff8d546e10b840 x1874672134217088/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/0 e 0 to 0 dl 1787826940 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826929.203581:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787826929.203595:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10b840 with x1874672134217088 ext(297795584->301989887) 00002000:00010000:0.0:1787826929.203601:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10b840 00000100:00100000:0.0:1787826929.203642:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 102 00000100:00100000:0.0:1787826929.203652:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+74:2392:x1874672134217088:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826929.215409:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+76:2392:x1874672134217088:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11750us (11957us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1787826929.215423:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 102 00002000:00100000:0.0:1787826929.215435:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (297795584->301989887) req@ffff8d546e10b840 x1874672134217088/t30064771107(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/448 e 0 to 0 dl 1787826940 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826929.215446:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10b840 with x1874672134217088 ext(297795584->301989887) 00002000:00010000:0.0:1787826929.215452:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10b840 00000100:00100000:1.0:1787826929.434746:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826929.434817:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217216 00000100:00100000:2.0:1787826929.434827:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217216 00002000:00100000:2.0:1787826929.434869:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (301989888->306184191) req@ffff8d53492c8f00 x1874672134217216/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/0 e 0 to 0 dl 1787826940 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826929.434877:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c8f00 with x1874672134217216 ext(301989888->306184191) 00002000:00010000:2.0:1787826929.434881:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c8f00 00000100:00100000:2.0:1787826929.434903:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 103 00000100:00100000:2.0:1787826929.434909:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+76:2393:x1874672134217216:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826929.450951:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+78:2393:x1874672134217216:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16030us (16205us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1787826929.450966:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 103 00002000:00100000:1.0:1787826929.450978:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (301989888->306184191) req@ffff8d53492c8f00 x1874672134217216/t30064771108(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/448 e 0 to 0 dl 1787826940 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826929.451003:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c8f00 with x1874672134217216 ext(301989888->306184191) 00002000:00010000:1.0:1787826929.451008:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c8f00 00000100:00100000:3.0:1787826929.688312:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826929.688379:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217344 00000100:00100000:0.0:1787826929.688388:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217344 00002000:00100000:0.0:1787826929.688431:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (306184192->310378495) req@ffff8d53424430c0 x1874672134217344/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/0 e 0 to 0 dl 1787826940 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826929.688439:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53424430c0 with x1874672134217344 ext(306184192->310378495) 00002000:00010000:0.0:1787826929.688445:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53424430c0 00000100:00100000:0.0:1787826929.688483:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 104 00000100:00100000:0.0:1787826929.688493:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+78:2392:x1874672134217344:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826929.705098:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+80:2392:x1874672134217344:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16595us (16793us total) trans 30064771109 rc 0/0 00000100:00100000:1.0:1787826929.705112:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 104 00002000:00100000:1.0:1787826929.705125:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (306184192->310378495) req@ffff8d53424430c0 x1874672134217344/t30064771109(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/448 e 0 to 0 dl 1787826940 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826929.705137:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53424430c0 with x1874672134217344 ext(306184192->310378495) 00002000:00010000:1.0:1787826929.705149:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53424430c0 00010000:00010000:2.0:1787826929.873417:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826929.952566:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826929.952649:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217472 00000100:00100000:1.0:1787826929.952657:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217472 00002000:00100000:1.0:1787826929.952710:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (310378496->314572799) req@ffff8d547f9be1c0 x1874672134217472/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/0 e 0 to 0 dl 1787826940 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826929.952722:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9be1c0 with x1874672134217472 ext(310378496->314572799) 00002000:00010000:1.0:1787826929.952730:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9be1c0 00000100:00100000:1.0:1787826929.952763:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 105 00000100:00100000:1.0:1787826929.952770:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+80:2393:x1874672134217472:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826929.968630:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+82:2393:x1874672134217472:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15850us (16063us total) trans 30064771110 rc 0/0 00000100:00100000:2.0:1787826929.968644:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 105 00002000:00100000:2.0:1787826929.968659:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (310378496->314572799) req@ffff8d547f9be1c0 x1874672134217472/t30064771110(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:530/0 lens 488/448 e 0 to 0 dl 1787826940 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826929.968685:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9be1c0 with x1874672134217472 ext(310378496->314572799) 00002000:00010000:2.0:1787826929.968692:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9be1c0 00000100:00100000:1.0:1787826930.054930:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826930.055004:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217600 00000100:00100000:2.0:1787826930.055014:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217600 00000100:00080000:1.0:1787826930.055073:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826930.055088:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 134 00000100:00100000:2.0:1787826930.055100:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d138f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:18588:x1874672134217600:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787826930.055138:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826930.055242:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d138f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:18588:x1874672134217600:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826930.055258:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 134 00000100:00100000:0.0:1787826930.056192:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826930.056242:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217728 00000100:00100000:2.0:1787826930.056248:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217728 00000100:00100000:2.0:1787826930.056310:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 135 00000100:00100000:2.0:1787826930.056319:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:18588:x1874672134217728:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787826930.056341:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826930.056392:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:18588:x1874672134217728:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826930.056399:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 135 00000100:00080000:1.0:1787826930.056439:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826930.058278:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826930.058333:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217856 00000100:00100000:2.0:1787826930.058350:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217856 00000100:00100000:2.0:1787826930.058390:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:2.0:1787826930.058400:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+82:18588:x1874672134217856:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826930.058419:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 370304448 pending 160317440 free 3625713664 avail 3394191360 00000100:00100000:2.0:1787826930.058485:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+82:18588:x1874672134217856:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826930.058506:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:3.0:1787826930.059415:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826930.059466:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134217984 00000100:00100000:2.0:1787826930.059470:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134217984 00000100:00100000:2.0:1787826930.059491:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 193 00000100:00100000:2.0:1787826930.059495:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134217984:12345-192.168.203.6@tcp:8:lfs.0 00010000:00080000:2.0:1787826930.059517:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1787826930.059539:0:8399:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a79542c7 00002000:00100000:2.0:1787826930.059548:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d53494c2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787826930.059560:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787826930.059616:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787826930.059647:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d53494c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826930.059690:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134217984:12345-192.168.203.6@tcp:8:lfs.0 Request processed in 193us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826930.059696:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 193 00000100:00100000:0.0:1787826930.060537:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826930.060585:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134218112 00000100:00100000:1.0:1787826930.060590:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134218112 00000100:00100000:1.0:1787826930.060636:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 174 00000100:00080000:0.0:1787826930.060646:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826930.060653:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:18588:x1874672134218112:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787826930.060669:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826930.060707:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:18588:x1874672134218112:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826930.060715:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 174 00000001:00100000:1.0:1787826930.060890:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:1.0:1787826930.060895:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:1.0:1787826930.060898:0:9469:0:(genops.c:885:class_export_put()) final put ffff8d5448304000/2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:0.0:1787826930.060935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5448304000/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0001 00000020:00000080:0.0:1787826930.060977:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5448301000 for lustre-OST0001 00000100:00100000:3.0:1787826930.065523:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826930.065587:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134218240 00000100:00100000:1.0:1787826930.065596:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134218240 00000100:00100000:1.0:1787826930.065637:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 495 00000100:00100000:1.0:1787826930.065647:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134218240:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826930.065713:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134218240:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826930.065720:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 495 00000100:00100000:3.0:1787826930.218391:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826930.218511:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134218368 00000100:00100000:2.0:1787826930.218522:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134218368 00002000:00100000:2.0:1787826930.218584:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (314572800->318767103) req@ffff8d5342441a40 x1874672134218368/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/0 e 0 to 0 dl 1787826941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826930.218606:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342441a40 with x1874672134218368 ext(314572800->318767103) 00002000:00010000:2.0:1787826930.218613:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342441a40 00000100:00100000:2.0:1787826930.218650:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 106 00000100:00100000:2.0:1787826930.218661:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+82:2392:x1874672134218368:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826930.234082:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+84:2392:x1874672134218368:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15415us (15696us total) trans 30064771111 rc 0/0 00000100:00100000:2.0:1787826930.234107:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 106 00002000:00100000:2.0:1787826930.234117:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (314572800->318767103) req@ffff8d5342441a40 x1874672134218368/t30064771111(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/448 e 0 to 0 dl 1787826941 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826930.234125:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342441a40 with x1874672134218368 ext(314572800->318767103) 00002000:00010000:2.0:1787826930.234130:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342441a40 00000100:00100000:1.0:1787826930.460714:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826930.460775:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134218496 00000100:00100000:0.0:1787826930.460785:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134218496 00002000:00100000:0.0:1787826930.460832:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (318767104->322961407) req@ffff8d546f6d8f00 x1874672134218496/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/0 e 0 to 0 dl 1787826941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826930.460854:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d8f00 with x1874672134218496 ext(318767104->322961407) 00002000:00010000:0.0:1787826930.460859:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d8f00 00000100:00100000:0.0:1787826930.460888:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 107 00000100:00100000:0.0:1787826930.460897:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+84:2392:x1874672134218496:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826930.475510:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+86:2392:x1874672134218496:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14601us (14793us total) trans 30064771112 rc 0/0 00000100:00100000:3.0:1787826930.475526:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 107 00002000:00100000:3.0:1787826930.475541:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (318767104->322961407) req@ffff8d546f6d8f00 x1874672134218496/t30064771112(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/448 e 0 to 0 dl 1787826941 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826930.475553:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6d8f00 with x1874672134218496 ext(318767104->322961407) 00002000:00010000:3.0:1787826930.475565:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6d8f00 00000100:00100000:1.0:1787826930.704722:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826930.704825:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134218624 00000100:00100000:3.0:1787826930.704834:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134218624 00002000:00100000:3.0:1787826930.704874:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (322961408->327155711) req@ffff8d5345ae1a40 x1874672134218624/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/0 e 0 to 0 dl 1787826941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826930.704886:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1a40 with x1874672134218624 ext(322961408->327155711) 00002000:00010000:3.0:1787826930.704892:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1a40 00000100:00100000:3.0:1787826930.704925:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 108 00000100:00100000:3.0:1787826930.704944:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+86:2391:x1874672134218624:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826930.720369:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+88:2391:x1874672134218624:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15422us (15648us total) trans 30064771113 rc 0/0 00000100:00100000:0.0:1787826930.720380:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 108 00002000:00100000:0.0:1787826930.720391:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (322961408->327155711) req@ffff8d5345ae1a40 x1874672134218624/t30064771113(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/448 e 0 to 0 dl 1787826941 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826930.720399:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1a40 with x1874672134218624 ext(322961408->327155711) 00002000:00010000:0.0:1787826930.720403:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1a40 00000100:00100000:3.0:1787826930.769392:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143737600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826930.769393:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143737728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826930.769400:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143737856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826930.769493:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826930.769525:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826930.769531:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737728 00000100:00100000:2.0:1787826930.769538:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737728 00000100:00100000:3.0:1787826930.769574:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737600 00000100:00080000:0.0:1787826930.769575:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826930.769581:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737600 00000100:00100000:0.0:1787826930.769591:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826930.769599:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787826930.769612:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143737728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826930.769631:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737856 00000100:00100000:3.0:1787826930.769632:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00002000:00000024:2.0:1787826930.769635:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826930.769638:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737856 00000100:00100000:3.0:1787826930.769645:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143737600:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826930.769671:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787826930.769680:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143737856:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:3.0:1787826930.769681:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:0.0:1787826930.769695:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826930.769771:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143737728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826930.769780:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787826930.769787:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143737600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826930.769796:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787826930.769813:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143737856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826930.769822:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787826930.769828:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143737600:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787826930.769852:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787826930.769877:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5342440f00 x1874672143737856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826930.769892:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143737856:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787826930.769914:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534355c780 x1874672143737728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826930.769924:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143737728:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826930.898308:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826930.947971:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826930.948046:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134218752 00000100:00100000:0.0:1787826930.948063:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134218752 00002000:00100000:0.0:1787826930.948128:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (327155712->331350015) req@ffff8d547f9bd2c0 x1874672134218752/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/0 e 0 to 0 dl 1787826941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826930.948142:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bd2c0 with x1874672134218752 ext(327155712->331350015) 00002000:00010000:0.0:1787826930.948148:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bd2c0 00000100:00100000:0.0:1787826930.948184:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 109 00000100:00100000:0.0:1787826930.948195:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+88:2390:x1874672134218752:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826930.966485:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+90:2390:x1874672134218752:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18283us (18513us total) trans 30064771114 rc 0/0 00000100:00100000:0.0:1787826930.966495:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 109 00002000:00100000:0.0:1787826930.966506:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (327155712->331350015) req@ffff8d547f9bd2c0 x1874672134218752/t30064771114(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:531/0 lens 488/448 e 0 to 0 dl 1787826941 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826930.966513:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bd2c0 with x1874672134218752 ext(327155712->331350015) 00002000:00010000:0.0:1787826930.966518:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bd2c0 00000100:00100000:2.0:1787826931.195407:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826931.195469:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134218880 00000100:00100000:0.0:1787826931.195478:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134218880 00000100:00080000:2.0:1787826931.195530:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787826931.195544:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (331350016->335544319) req@ffff8d547f9bcb40 x1874672134218880/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:532/0 lens 488/0 e 0 to 0 dl 1787826942 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826931.195555:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bcb40 with x1874672134218880 ext(331350016->335544319) 00002000:00010000:0.0:1787826931.195561:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bcb40 00000100:00100000:0.0:1787826931.195587:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 110 00000100:00100000:0.0:1787826931.195598:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+90:2392:x1874672134218880:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826931.209201:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+92:2392:x1874672134218880:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13595us (13791us total) trans 30064771115 rc 0/0 00000100:00100000:2.0:1787826931.209242:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 110 00002000:00100000:2.0:1787826931.209257:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (331350016->335544319) req@ffff8d547f9bcb40 x1874672134218880/t30064771115(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:532/0 lens 488/448 e 0 to 0 dl 1787826942 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826931.209286:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bcb40 with x1874672134218880 ext(331350016->335544319) 00002000:00010000:2.0:1787826931.209292:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bcb40 00000100:00100000:2.0:1787826931.281428:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143737984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.281489:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143738112:0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.281503:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826931.281555:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143738368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826931.281674:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143737984 00000100:00100000:3.0:1787826931.281683:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143737984 00000100:00100000:3.0:1787826931.281728:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1787826931.281738:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143737984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.281923:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826931.281967:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143738624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282002:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826931.282011:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143738496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282027:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143739136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.282045:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826931.282072:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826931.282087:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143739008:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282099:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826931.282105:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143738240:0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.282116:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826931.282140:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143739520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282146:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826931.282170:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826931.282174:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282202:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826931.282246:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143739264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826931.282300:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143738112 00000100:00100000:1.0:1787826931.282304:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143738112 00000100:00100000:1.0:1787826931.282331:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739008 00000100:00100000:1.0:1787826931.282334:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739008 00000100:00100000:1.0:1787826931.282359:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739520 00000100:00100000:1.0:1787826931.282362:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739520 00000100:00100000:1.0:1787826931.282378:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787826931.282385:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143738112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.282491:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143738496 00000100:00100000:2.0:1787826931.282496:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143738496 00000100:00100000:1.0:1787826931.282520:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143738112:12345-0@lo:400:kworker.0 Request processed in 135us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282528:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787826931.282529:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143738240 00000100:00100000:2.0:1787826931.282534:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143738240 00000100:00100000:1.0:1787826931.282547:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787826931.282554:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143739008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.282561:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787826931.282571:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143738496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282588:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143739008:12345-0@lo:400:kworker.0 Request processed in 34us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282594:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787826931.282609:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787826931.282616:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143738496:12345-0@lo:400:kworker.0 Request processed in 47us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282618:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143739520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.282630:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787826931.282652:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787826931.282667:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143738240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282668:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143739520:12345-0@lo:400:kworker.0 Request processed in 51us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826931.282668:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143737984:12345-0@lo:400:kworker.0 Request processed in 925us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282684:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787826931.282699:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1787826931.282717:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143738624 00000100:00100000:2.0:1787826931.282718:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143738240:12345-0@lo:400:kworker.0 Request processed in 58us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282723:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143738624 00000100:00100000:2.0:1787826931.282728:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787826931.282771:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739136 00000100:00100000:1.0:1787826931.282775:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739136 00000100:00100000:1.0:1787826931.282800:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143738752 00000100:00100000:1.0:1787826931.282803:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143738752 00000100:00100000:2.0:1787826931.282812:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739264 00000100:00100000:2.0:1787826931.282818:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739264 00000100:00100000:1.0:1787826931.282831:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787826931.282841:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143738624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826931.282856:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787826931.282873:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143738624:12345-0@lo:400:kworker.0 Request processed in 35us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282879:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787826931.282890:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787826931.282895:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143738752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.282919:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143738752:12345-0@lo:400:kworker.0 Request processed in 24us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282925:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787826931.282938:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143739136:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787826931.282940:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826931.282945:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826931.282984:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143739136:12345-0@lo:400:kworker.0 Request processed in 120us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.282986:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143738240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826931.283000:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00080000:1.0:1787826931.283008:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5345ae3c00 x1874672143738752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826931.283018:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.283034:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143738112:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.283044:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143738624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.283057:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143739136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.283105:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00010000:00080000:1.0:1787826931.283117:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5345ae2580 x1874672143739008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826931.283117:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143739264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.283132:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143739008:0@lo:400:kworker.0 00010000:00080000:1.0:1787826931.283148:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5345ae0b40 x1874672143739520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826931.283157:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143739520:0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.283165:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143739264:12345-0@lo:400:kworker.0 Request processed in 51us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.283170:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143737984:0@lo:400:kworker.0 00000100:00100000:2.0:1787826931.283176:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787826931.283187:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143738496:0@lo:400:kworker.0 00010000:00080000:1.0:1787826931.283241:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5345ae12c0 x1874672143739264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826931.283251:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143739264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826931.283476:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826931.283530:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143738880:0@lo:400:kworker.0 00000100:00100000:0.0:1787826931.283554:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826931.283614:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143739392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826931.283647:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826931.283795:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143738368 00000100:00100000:1.0:1787826931.283798:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143738368 00000100:00100000:1.0:1787826931.283824:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143738880 00000100:00100000:1.0:1787826931.283827:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143738880 00000100:00100000:1.0:1787826931.283853:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787826931.283859:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143738368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.283883:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143738368:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.283887:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787826931.283894:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787826931.283898:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143738880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.284035:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143738880:12345-0@lo:400:kworker.0 Request processed in 135us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.284048:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1787826931.284116:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826931.284575:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143738368:0@lo:400:kworker.0 00000100:00100000:0.0:1787826931.284587:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143738880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.284625:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739392 00000100:00100000:1.0:1787826931.284629:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739392 00000100:00100000:1.0:1787826931.284700:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787826931.284708:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143739392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826931.284756:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143739392:12345-0@lo:400:kworker.0 Request processed in 39us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826931.284762:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787826931.284803:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143739392:0@lo:400:kworker.0 00000100:00080000:2.0:1787826931.284847:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826931.465058:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826931.465126:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219008 00000100:00100000:2.0:1787826931.465144:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219008 00002000:00100000:2.0:1787826931.465190:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (335544320->339738623) req@ffff8d53477dda40 x1874672134219008/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:532/0 lens 488/0 e 0 to 0 dl 1787826942 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826931.465201:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dda40 with x1874672134219008 ext(335544320->339738623) 00002000:00010000:2.0:1787826931.465206:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dda40 00000100:00100000:2.0:1787826931.465262:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 111 00000100:00100000:2.0:1787826931.465284:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+92:2393:x1874672134219008:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826931.481705:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+94:2393:x1874672134219008:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16416us (16647us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1787826931.481716:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 111 00002000:00100000:2.0:1787826931.481727:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (335544320->339738623) req@ffff8d53477dda40 x1874672134219008/t30064771116(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:532/0 lens 488/448 e 0 to 0 dl 1787826942 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826931.481735:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dda40 with x1874672134219008 ext(335544320->339738623) 00002000:00010000:2.0:1787826931.481740:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dda40 00000100:00100000:1.0:1787826931.738892:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826931.738996:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219136 00000100:00100000:0.0:1787826931.739013:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219136 00002000:00100000:0.0:1787826931.739080:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (339738624->343932927) req@ffff8d53477ded00 x1874672134219136/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:532/0 lens 488/0 e 0 to 0 dl 1787826942 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826931.739093:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477ded00 with x1874672134219136 ext(339738624->343932927) 00002000:00010000:0.0:1787826931.739100:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477ded00 00000100:00100000:0.0:1787826931.739143:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 112 00000100:00100000:0.0:1787826931.739156:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+94:2392:x1874672134219136:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826931.754838:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+96:2392:x1874672134219136:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15676us (15947us total) trans 30064771117 rc 0/0 00000100:00100000:0.0:1787826931.754849:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 112 00002000:00100000:0.0:1787826931.754860:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (339738624->343932927) req@ffff8d53477ded00 x1874672134219136/t30064771117(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:532/0 lens 488/448 e 0 to 0 dl 1787826942 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826931.754868:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477ded00 with x1874672134219136 ext(339738624->343932927) 00002000:00010000:0.0:1787826931.754872:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477ded00 00000100:00100000:2.0:1787826931.793547:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826931.793581:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143739648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826931.793690:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826931.793767:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739648 00000100:00100000:3.0:1787826931.793778:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739648 00000100:00100000:3.0:1787826931.793842:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787826931.793852:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143739648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826931.793886:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826931.793968:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143739648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826931.793975:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787826931.794040:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143739648:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826931.921373:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826932.017025:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826932.017576:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219264 00000100:00100000:3.0:1787826932.017587:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219264 00002000:00100000:3.0:1787826932.017637:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (343932928->348127231) req@ffff8d53477dcf00 x1874672134219264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/0 e 0 to 0 dl 1787826943 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826932.017660:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dcf00 with x1874672134219264 ext(343932928->348127231) 00002000:00010000:3.0:1787826932.017669:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dcf00 00000100:00100000:3.0:1787826932.017703:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 113 00000100:00100000:3.0:1787826932.017715:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+96:2392:x1874672134219264:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826932.038672:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+98:2392:x1874672134219264:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20951us (21641us total) trans 30064771118 rc 0/0 00000100:00100000:2.0:1787826932.038686:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 113 00002000:00100000:2.0:1787826932.038700:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (343932928->348127231) req@ffff8d53477dcf00 x1874672134219264/t30064771118(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/448 e 0 to 0 dl 1787826943 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826932.038711:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dcf00 with x1874672134219264 ext(343932928->348127231) 00002000:00010000:2.0:1787826932.038718:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dcf00 00000001:02000400:2.0:1787826932.157397:0:22192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:0.0:1787826932.278463:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826932.278536:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219392 00000100:00100000:2.0:1787826932.278547:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219392 00002000:00100000:2.0:1787826932.278605:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (348127232->352321535) req@ffff8d534355f840 x1874672134219392/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/0 e 0 to 0 dl 1787826943 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826932.278617:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355f840 with x1874672134219392 ext(348127232->352321535) 00002000:00010000:2.0:1787826932.278622:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355f840 00000100:00100000:2.0:1787826932.278654:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 114 00000100:00100000:2.0:1787826932.278665:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+98:2393:x1874672134219392:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826932.292983:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+100:2393:x1874672134219392:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14310us (14518us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1787826932.292996:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 114 00002000:00100000:2.0:1787826932.293010:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (348127232->352321535) req@ffff8d534355f840 x1874672134219392/t30064771119(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/448 e 0 to 0 dl 1787826943 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826932.293028:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355f840 with x1874672134219392 ext(348127232->352321535) 00002000:00010000:2.0:1787826932.293034:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355f840 00000100:00100000:0.0:1787826932.547458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826932.547510:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219520 00000100:00100000:3.0:1787826932.547519:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219520 00002000:00100000:3.0:1787826932.547578:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (352321536->356515839) req@ffff8d534355d2c0 x1874672134219520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/0 e 0 to 0 dl 1787826943 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826932.547603:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355d2c0 with x1874672134219520 ext(352321536->356515839) 00002000:00010000:3.0:1787826932.547608:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355d2c0 00000100:00100000:3.0:1787826932.547640:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00100000:3.0:1787826932.547650:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+100:2393:x1874672134219520:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826932.563700:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+102:2393:x1874672134219520:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16040us (16239us total) trans 30064771120 rc 0/0 00000100:00100000:2.0:1787826932.563714:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 115 00002000:00100000:2.0:1787826932.563726:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (352321536->356515839) req@ffff8d534355d2c0 x1874672134219520/t30064771120(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/448 e 0 to 0 dl 1787826943 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826932.563745:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355d2c0 with x1874672134219520 ext(352321536->356515839) 00002000:00010000:2.0:1787826932.563753:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355d2c0 00000001:02000400:1.0:1787826932.772277:0:22240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1787826932.806309:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826932.806371:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219648 00000100:00100000:1.0:1787826932.806381:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219648 00002000:00100000:1.0:1787826932.806427:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (356515840->360710143) req@ffff8d5342442940 x1874672134219648/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/0 e 0 to 0 dl 1787826943 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826932.806438:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342442940 with x1874672134219648 ext(356515840->360710143) 00002000:00010000:1.0:1787826932.806442:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342442940 00000100:00100000:1.0:1787826932.806476:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 116 00000100:00100000:1.0:1787826932.806486:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+102:2392:x1874672134219648:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826932.820514:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+104:2392:x1874672134219648:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14019us (14202us total) trans 30064771121 rc 0/0 00000100:00100000:3.0:1787826932.820529:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 116 00002000:00100000:3.0:1787826932.820542:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (356515840->360710143) req@ffff8d5342442940 x1874672134219648/t30064771121(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:533/0 lens 488/448 e 0 to 0 dl 1787826943 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826932.820552:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342442940 with x1874672134219648 ext(356515840->360710143) 00002000:00010000:3.0:1787826932.820558:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342442940 00010000:00010000:2.0:1787826932.945371:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826933.059941:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826933.059997:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219776 00000100:00100000:3.0:1787826933.060006:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219776 00000100:00080000:2.0:1787826933.060067:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787826933.060069:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (360710144->364904447) req@ffff8d534355cb40 x1874672134219776/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/0 e 0 to 0 dl 1787826944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826933.060080:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355cb40 with x1874672134219776 ext(360710144->364904447) 00002000:00010000:3.0:1787826933.060085:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355cb40 00000100:00100000:3.0:1787826933.060112:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 117 00000100:00100000:3.0:1787826933.060123:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+104:2393:x1874672134219776:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826933.074411:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+106:2393:x1874672134219776:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14280us (14478us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1787826933.074425:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 117 00002000:00100000:2.0:1787826933.074439:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (360710144->364904447) req@ffff8d534355cb40 x1874672134219776/t30064771122(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/448 e 0 to 0 dl 1787826944 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826933.074450:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355cb40 with x1874672134219776 ext(360710144->364904447) 00002000:00010000:2.0:1787826933.074456:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355cb40 00000001:00080000:1.0:1787826933.075006:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771122 is committed 00000100:00100000:0.0:1787826933.287904:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826933.287972:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134219904 00000100:00100000:2.0:1787826933.287982:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134219904 00002000:00100000:2.0:1787826933.288022:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (364904448->369098751) req@ffff8d534355f0c0 x1874672134219904/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/0 e 0 to 0 dl 1787826944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826933.288030:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355f0c0 with x1874672134219904 ext(364904448->369098751) 00002000:00010000:2.0:1787826933.288044:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355f0c0 00000100:00100000:2.0:1787826933.288076:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 118 00000100:00100000:2.0:1787826933.288087:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134219904:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826933.301440:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134219904:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13349us (13537us total) trans 30064771123 rc 0/0 00000100:00100000:0.0:1787826933.301452:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 118 00002000:00100000:0.0:1787826933.301462:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (364904448->369098751) req@ffff8d534355f0c0 x1874672134219904/t30064771123(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/448 e 0 to 0 dl 1787826944 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826933.301470:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355f0c0 with x1874672134219904 ext(364904448->369098751) 00002000:00010000:0.0:1787826933.301475:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355f0c0 00000100:00100000:3.0:1787826933.329379:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143739904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826933.329381:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143739776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826933.329461:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826933.329518:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739776 00000100:00100000:3.0:1787826933.329521:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826933.329527:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739776 00000100:00100000:0.0:1787826933.329574:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143739904 00000100:00100000:0.0:1787826933.329580:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143739904 00000100:00080000:1.0:1787826933.329592:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826933.329612:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787826933.329623:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787826933.329625:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143739776:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826933.329639:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143739904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826933.329648:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 269051328 pending 4218880 free 3558604800 avail 3327082496 00002000:00000024:0.0:1787826933.329655:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 269051328 pending 4218880 free 3558604800 avail 3327082496 00000100:00100000:0.0:1787826933.329693:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143739904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826933.329700:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787826933.329721:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143739776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826933.329743:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787826933.329743:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143739904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826933.329760:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143739776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826933.499910:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826933.499988:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220032 00000100:00100000:2.0:1787826933.500001:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220032 00002000:00100000:2.0:1787826933.500054:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (369098752->373293055) req@ffff8d53477dc780 x1874672134220032/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/0 e 0 to 0 dl 1787826944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826933.500067:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc780 with x1874672134220032 ext(369098752->373293055) 00002000:00010000:2.0:1787826933.500073:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc780 00000100:00100000:2.0:1787826933.500114:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:2.0:1787826933.500130:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134220032:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826933.511881:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134220032:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11750us (11980us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1787826933.511893:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 119 00002000:00100000:2.0:1787826933.511902:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (369098752->373293055) req@ffff8d53477dc780 x1874672134220032/t30064771124(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/448 e 0 to 0 dl 1787826944 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826933.511920:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc780 with x1874672134220032 ext(369098752->373293055) 00002000:00010000:2.0:1787826933.511925:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc780 00000100:00100000:1.0:1787826933.739403:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826933.739490:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220160 00000100:00100000:2.0:1787826933.739500:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220160 00002000:00100000:2.0:1787826933.739546:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (373293056->377487359) req@ffff8d53477dc3c0 x1874672134220160/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/0 e 0 to 0 dl 1787826944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826933.739557:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc3c0 with x1874672134220160 ext(373293056->377487359) 00002000:00010000:2.0:1787826933.739563:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc3c0 00000100:00100000:2.0:1787826933.739597:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:2.0:1787826933.739607:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134220160:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826933.756256:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134220160:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16641us (16850us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1787826933.756270:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 120 00002000:00100000:2.0:1787826933.756283:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (373293056->377487359) req@ffff8d53477dc3c0 x1874672134220160/t30064771125(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/448 e 0 to 0 dl 1787826944 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826933.756293:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc3c0 with x1874672134220160 ext(373293056->377487359) 00002000:00010000:2.0:1787826933.756300:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc3c0 00010000:00010000:2.0:1787826933.969812:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826933.985659:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826933.985741:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220288 00000100:00100000:2.0:1787826933.985750:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220288 00002000:00100000:2.0:1787826933.985802:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (377487360->381681663) req@ffff8d534355f480 x1874672134220288/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/0 e 0 to 0 dl 1787826944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826933.985813:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355f480 with x1874672134220288 ext(377487360->381681663) 00002000:00010000:2.0:1787826933.985829:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355f480 00000100:00100000:2.0:1787826933.985863:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 121 00000100:00100000:2.0:1787826933.985875:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134220288:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826934.001889:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134220288:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16007us (16229us total) trans 30064771126 rc 0/0 00000100:00100000:3.0:1787826934.001902:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 121 00002000:00100000:3.0:1787826934.001916:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (377487360->381681663) req@ffff8d534355f480 x1874672134220288/t30064771126(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:534/0 lens 488/448 e 0 to 0 dl 1787826944 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826934.001928:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355f480 with x1874672134220288 ext(377487360->381681663) 00002000:00010000:3.0:1787826934.001934:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355f480 00000100:00100000:2.0:1787826934.146886:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826934.146945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220416 00000100:00100000:3.0:1787826934.146957:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220416 00000100:00080000:1.0:1787826934.147034:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826934.147034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 136 00000100:00100000:3.0:1787826934.147047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:19055:x1874672134220416:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787826934.147096:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826934.147181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:19055:x1874672134220416:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 139us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826934.147187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 136 00000100:00100000:1.0:1787826934.148508:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826934.148559:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220544 00000100:00100000:2.0:1787826934.148564:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220544 00000100:00080000:1.0:1787826934.148615:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826934.148617:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 137 00000100:00100000:2.0:1787826934.148628:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:19055:x1874672134220544:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787826934.148658:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826934.148707:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:19055:x1874672134220544:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826934.148715:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 137 00000100:00100000:0.0:1787826934.151200:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826934.151292:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220672 00000100:00100000:3.0:1787826934.151304:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220672 00000100:00100000:3.0:1787826934.151367:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 179 00000100:00100000:3.0:1787826934.151377:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+14:19055:x1874672134220672:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787826934.151406:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 32768 granted 294364608 pending 16875520 free 3558604800 avail 3327082496 00000100:00100000:3.0:1787826934.151487:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+14:19055:x1874672134220672:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826934.151495:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 179 00000100:00100000:1.0:1787826934.152610:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826934.152689:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220800 00000100:00100000:2.0:1787826934.152696:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220800 00000100:00080000:1.0:1787826934.152763:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826934.152775:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 180 00000100:00100000:2.0:1787826934.152787:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:19055:x1874672134220800:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787826934.152810:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826934.152865:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:19055:x1874672134220800:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826934.152871:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 180 00000100:00100000:1.0:1787826934.251199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826934.251261:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134220928 00000100:00100000:0.0:1787826934.251271:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134220928 00002000:00100000:0.0:1787826934.251318:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (381681664->385875967) req@ffff8d53477dde00 x1874672134220928/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/0 e 0 to 0 dl 1787826945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826934.251327:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dde00 with x1874672134220928 ext(381681664->385875967) 00002000:00010000:0.0:1787826934.251331:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dde00 00000100:00100000:0.0:1787826934.251364:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:0.0:1787826934.251374:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2391:x1874672134220928:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826934.263806:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2391:x1874672134220928:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12424us (12607us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1787826934.263821:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 122 00002000:00100000:2.0:1787826934.263833:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (381681664->385875967) req@ffff8d53477dde00 x1874672134220928/t30064771127(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/448 e 0 to 0 dl 1787826945 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826934.263853:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dde00 with x1874672134220928 ext(381681664->385875967) 00002000:00010000:2.0:1787826934.263858:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dde00 00000100:00100000:1.0:1787826934.492886:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826934.493051:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221056 00000100:00100000:0.0:1787826934.493061:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221056 00002000:00100000:0.0:1787826934.493106:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (385875968->390070271) req@ffff8d53477dfc00 x1874672134221056/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/0 e 0 to 0 dl 1787826945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826934.493116:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dfc00 with x1874672134221056 ext(385875968->390070271) 00002000:00010000:0.0:1787826934.493122:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dfc00 00000100:00100000:0.0:1787826934.493255:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 123 00000100:00100000:0.0:1787826934.493275:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134221056:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826934.507039:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134221056:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13764us (14151us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1787826934.507052:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 123 00002000:00100000:2.0:1787826934.507063:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (385875968->390070271) req@ffff8d53477dfc00 x1874672134221056/t30064771128(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/448 e 0 to 0 dl 1787826945 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826934.507071:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dfc00 with x1874672134221056 ext(385875968->390070271) 00002000:00010000:2.0:1787826934.507076:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dfc00 00000100:00100000:1.0:1787826934.719382:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826934.719447:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221184 00000100:00100000:3.0:1787826934.719480:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221184 00002000:00100000:3.0:1787826934.719521:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (390070272->394264575) req@ffff8d53477df840 x1874672134221184/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/0 e 0 to 0 dl 1787826945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826934.719529:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df840 with x1874672134221184 ext(390070272->394264575) 00002000:00010000:3.0:1787826934.719533:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df840 00000100:00100000:3.0:1787826934.719564:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 124 00000100:00100000:3.0:1787826934.719572:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134221184:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826934.733303:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134221184:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13719us (13918us total) trans 30064771129 rc 0/0 00000100:00100000:2.0:1787826934.733317:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 124 00002000:00100000:2.0:1787826934.733328:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (390070272->394264575) req@ffff8d53477df840 x1874672134221184/t30064771129(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/448 e 0 to 0 dl 1787826945 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826934.733339:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df840 with x1874672134221184 ext(390070272->394264575) 00002000:00010000:2.0:1787826934.733345:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df840 00000100:00100000:1.0:1787826934.992797:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826934.992858:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221312 00000100:00100000:0.0:1787826934.992866:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221312 00002000:00100000:0.0:1787826934.992919:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (394264576->398458879) req@ffff8d53477de580 x1874672134221312/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/0 e 0 to 0 dl 1787826945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826934.992931:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477de580 with x1874672134221312 ext(394264576->398458879) 00002000:00010000:0.0:1787826934.992936:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477de580 00000100:00100000:0.0:1787826934.992965:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 125 00000100:00100000:0.0:1787826934.992976:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134221312:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787826934.993418:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826935.009890:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134221312:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16905us (17091us total) trans 30064771130 rc 0/0 00000100:00100000:0.0:1787826935.009905:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 125 00002000:00100000:0.0:1787826935.009917:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (394264576->398458879) req@ffff8d53477de580 x1874672134221312/t30064771130(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:535/0 lens 488/448 e 0 to 0 dl 1787826945 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826935.009927:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477de580 with x1874672134221312 ext(394264576->398458879) 00002000:00010000:0.0:1787826935.009942:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477de580 00000100:00100000:2.0:1787826935.188963:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826935.189015:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826935.189039:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221440 00000100:00100000:2.0:1787826935.189048:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826935.189049:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221440 00000100:00100000:3.0:1787826935.189075:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221568 00000100:00100000:3.0:1787826935.189081:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221568 00000100:00100000:2.0:1787826935.189085:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00002000:00100000:0.0:1787826935.189112:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (398458880->401903615) req@ffff8d547f9bc3c0 x1874672134221440/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/0 e 0 to 0 dl 1787826946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787826935.189116:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221824 00000100:00100000:1.0:1787826935.189123:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221824 00000100:00100000:2.0:1787826935.189126:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221696 00002000:00100000:0.0:1787826935.189129:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bc3c0 with x1874672134221440 ext(398458880->401903615) 00000100:00100000:3.0:1787826935.189130:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 497 00000100:00100000:2.0:1787826935.189133:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221696 00002000:00010000:0.0:1787826935.189139:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bc3c0 00000100:00100000:0.0:1787826935.189165:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:1.0:1787826935.189171:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 296 00000100:00100000:0.0:1787826935.189180:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2390:x1874672134221440:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826935.189180:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 297 00000100:00100000:1.0:1787826935.189184:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134221824:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826935.189200:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134221568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826935.189208:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134221696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826935.189281:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134221824:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826935.189282:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134221568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826935.189297:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 296 00000100:00100000:3.0:1787826935.189299:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 497 00000100:00080000:1.0:1787826935.189326:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826935.189342:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134221696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826935.189351:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 297 00000100:00100000:1.0:1787826935.189471:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826935.189547:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826935.189576:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134221952 00000100:00100000:2.0:1787826935.189581:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134221952 00000100:00100000:2.0:1787826935.189616:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 163 00000100:00100000:2.0:1787826935.189626:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134221952:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826935.189633:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222080 00000100:00100000:3.0:1787826935.189642:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222080 00002000:00100000:3.0:1787826935.189664:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (401903616->401948671) req@ffff8d53477dd2c0 x1874672134222080/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/0 e 0 to 0 dl 1787826946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787826935.189674:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134221952:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 49us (203us total) trans 0 rc 0/0 00002000:00100000:3.0:1787826935.189676:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dd2c0 with x1874672134222080 ext(401903616->401948671) 00000100:00100000:2.0:1787826935.189683:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 163 00002000:00010000:3.0:1787826935.189754:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dd2c0 00000100:00100000:3.0:1787826935.189774:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 127 00000100:00100000:3.0:1787826935.189782:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2390:x1874672134222080:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826935.197807:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2390:x1874672134222080:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 8020us (8256us total) trans 30064771131 rc 0/0 00000100:00100000:3.0:1787826935.197905:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 127 00002000:00100000:3.0:1787826935.197957:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (401903616->401948671) req@ffff8d53477dd2c0 x1874672134222080/t30064771131(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/448 e 0 to 0 dl 1787826946 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826935.197966:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dd2c0 with x1874672134222080 ext(401903616->401948671) 00002000:00010000:3.0:1787826935.197972:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dd2c0 00000100:00100000:2.0:1787826935.201652:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2390:x1874672134221440:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12469us (12690us total) trans 30064771132 rc 0/0 00000100:00100000:2.0:1787826935.201666:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 126 00002000:00100000:2.0:1787826935.201677:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (398458880->401903615) req@ffff8d547f9bc3c0 x1874672134221440/t30064771132(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/448 e 0 to 0 dl 1787826946 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826935.201686:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bc3c0 with x1874672134221440 ext(398458880->401903615) 00002000:00010000:2.0:1787826935.201691:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bc3c0 00000100:00100000:0.0:1787826935.452570:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826935.452645:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222208 00000100:00100000:2.0:1787826935.452654:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222208 00002000:00100000:2.0:1787826935.452703:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (402653184->406847487) req@ffff8d534355fc00 x1874672134222208/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/0 e 0 to 0 dl 1787826946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826935.452727:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355fc00 with x1874672134222208 ext(402653184->406847487) 00002000:00010000:2.0:1787826935.452734:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355fc00 00000100:00100000:2.0:1787826935.452783:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:2.0:1787826935.452795:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134222208:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826935.467341:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134222208:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14538us (14776us total) trans 30064771133 rc 0/0 00000100:00100000:2.0:1787826935.467355:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 128 00002000:00100000:2.0:1787826935.467370:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (402653184->406847487) req@ffff8d534355fc00 x1874672134222208/t30064771133(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/448 e 0 to 0 dl 1787826946 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826935.467380:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355fc00 with x1874672134222208 ext(402653184->406847487) 00002000:00010000:2.0:1787826935.467386:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355fc00 00000100:00100000:3.0:1787826935.691537:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826935.691640:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222336 00000100:00100000:2.0:1787826935.691648:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222336 00002000:00100000:2.0:1787826935.691688:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (406847488->411041791) req@ffff8d5342441680 x1874672134222336/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/0 e 0 to 0 dl 1787826946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826935.691696:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342441680 with x1874672134222336 ext(406847488->411041791) 00002000:00010000:2.0:1787826935.691699:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342441680 00000100:00100000:2.0:1787826935.691739:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:2.0:1787826935.691747:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134222336:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826935.704457:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134222336:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12701us (12920us total) trans 30064771134 rc 0/0 00000100:00100000:2.0:1787826935.704473:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 129 00002000:00100000:2.0:1787826935.704486:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (406847488->411041791) req@ffff8d5342441680 x1874672134222336/t30064771134(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/448 e 0 to 0 dl 1787826946 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826935.704498:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342441680 with x1874672134222336 ext(406847488->411041791) 00002000:00010000:2.0:1787826935.704514:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342441680 00000100:00100000:2.0:1787826935.889549:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143740032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826935.889617:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826935.889730:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143740160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826935.889759:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826935.889807:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740160 00000100:00100000:2.0:1787826935.889815:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740160 00000100:00100000:2.0:1787826935.889884:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787826935.889893:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143740160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826935.889926:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787826935.889981:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143740160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826935.889988:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787826935.890030:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143740160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826935.890347:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740032 00000100:00100000:3.0:1787826935.890351:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740032 00000100:00100000:0.0:1787826935.890383:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826935.890390:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787826935.890392:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143740288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826935.890398:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143740032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826935.890412:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826935.890442:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826935.890443:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143740032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826935.890462:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787826935.890472:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740288 00000100:00100000:0.0:1787826935.890475:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740288 00010000:00080000:3.0:1787826935.890491:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534355c000 x1874672143740032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826935.890499:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787826935.890504:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143740032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826935.890505:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143740288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826935.890515:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826935.890545:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143740288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826935.890551:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00080000:0.0:1787826935.890578:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5342440f00 x1874672143740288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826935.890591:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143740288:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826935.890662:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826935.920325:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826935.920491:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222464 00000100:00100000:2.0:1787826935.920501:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222464 00002000:00100000:2.0:1787826935.920572:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (411041792->415236095) req@ffff8d5342442d00 x1874672134222464/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/0 e 0 to 0 dl 1787826946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826935.920583:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342442d00 with x1874672134222464 ext(411041792->415236095) 00002000:00010000:2.0:1787826935.920590:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342442d00 00000100:00100000:2.0:1787826935.920621:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 130 00000100:00100000:2.0:1787826935.920638:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2390:x1874672134222464:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826935.939535:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134222464:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18896us (19211us total) trans 30064771135 rc 0/0 00000100:00100000:2.0:1787826935.939561:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 130 00002000:00100000:2.0:1787826935.939579:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (411041792->415236095) req@ffff8d5342442d00 x1874672134222464/t30064771135(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:536/0 lens 488/448 e 0 to 0 dl 1787826946 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826935.939590:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342442d00 with x1874672134222464 ext(411041792->415236095) 00002000:00010000:2.0:1787826935.939596:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342442d00 00010000:00010000:2.0:1787826936.017496:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826936.180342:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826936.180580:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222592 00000100:00100000:0.0:1787826936.180589:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222592 00002000:00100000:0.0:1787826936.180635:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (415236096->419430399) req@ffff8d53424412c0 x1874672134222592/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/0 e 0 to 0 dl 1787826947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826936.180646:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53424412c0 with x1874672134222592 ext(415236096->419430399) 00002000:00010000:0.0:1787826936.180652:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53424412c0 00000100:00100000:0.0:1787826936.180681:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 131 00000100:00100000:0.0:1787826936.180691:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134222592:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826936.197687:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134222592:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16988us (17344us total) trans 30064771136 rc 0/0 00000100:00100000:0.0:1787826936.197700:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 131 00002000:00100000:0.0:1787826936.197725:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (415236096->419430399) req@ffff8d53424412c0 x1874672134222592/t30064771136(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/448 e 0 to 0 dl 1787826947 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826936.197752:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53424412c0 with x1874672134222592 ext(415236096->419430399) 00002000:00010000:0.0:1787826936.197758:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53424412c0 00000100:00100000:1.0:1787826936.401419:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143740416:0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.401435:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143740544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.401453:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143740672:0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.401490:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826936.401495:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826936.401509:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826936.401548:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143740800:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.401558:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143741184:0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.401560:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143740928:0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.401560:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143741056:0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.401588:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826936.401604:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826936.401609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826936.401622:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740544 00000100:00100000:0.0:1787826936.401626:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143741312:0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.401637:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740544 00000100:00100000:3.0:1787826936.401656:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143741696:0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.401660:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143741440:0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.401667:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826936.401682:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740800 00000100:00100000:2.0:1787826936.401687:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740800 00000100:00100000:0.0:1787826936.401699:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143741824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.401721:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826936.401723:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826936.401726:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741312 00000100:00100000:2.0:1787826936.401731:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741312 00000100:00100000:0.0:1787826936.401746:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826936.401746:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143741952:0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.401769:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741440 00000100:00100000:2.0:1787826936.401774:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741440 00000100:00100000:3.0:1787826936.401775:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740672 00000100:00100000:0.0:1787826936.401781:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740928 00000100:00100000:3.0:1787826936.401781:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740672 00000100:00100000:0.0:1787826936.401786:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740928 00000100:00100000:1.0:1787826936.401791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826936.401805:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741824 00000100:00100000:2.0:1787826936.401809:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741824 00000100:00100000:3.0:1787826936.401827:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787826936.401834:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143740416 00000100:00100000:0.0:1787826936.401835:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787826936.401836:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741952 00000100:00100000:1.0:1787826936.401841:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143740416 00000100:00100000:3.0:1787826936.401842:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143740672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.401843:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741952 00000100:00100000:0.0:1787826936.401848:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143740928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.401875:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787826936.401882:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1787826936.401888:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143740544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.401896:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143740416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.401903:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143740928:12345-0@lo:400:kworker.0 Request processed in 57us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826936.401910:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787826936.401914:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143740672:12345-0@lo:400:kworker.0 Request processed in 74us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826936.401922:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787826936.401946:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787826936.401946:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143740544:12345-0@lo:400:kworker.0 Request processed in 60us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826936.401951:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741184 00000100:00100000:1.0:1787826936.401953:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143740416:12345-0@lo:400:kworker.0 Request processed in 58us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826936.401959:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741184 00000100:00100000:0.0:1787826936.401964:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143740800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.401964:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787826936.401965:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1787826936.401993:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787826936.401994:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741696 00000100:00100000:3.0:1787826936.401998:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741696 00000100:00100000:2.0:1787826936.402003:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143741312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.402012:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787826936.402019:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143740800:12345-0@lo:400:kworker.0 Request processed in 61us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826936.402025:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143741440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.402028:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787826936.402031:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787826936.402042:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143741312:12345-0@lo:400:kworker.0 Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826936.402047:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143741184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.402051:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787826936.402064:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143741824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.402065:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787826936.402084:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143741440:12345-0@lo:400:kworker.0 Request processed in 63us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826936.402086:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787826936.402098:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787826936.402101:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143741952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.402108:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143741184:12345-0@lo:400:kworker.0 Request processed in 64us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826936.402109:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143741824:12345-0@lo:400:kworker.0 Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826936.402119:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787826936.402130:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787826936.402134:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787826936.402139:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143741952:12345-0@lo:400:kworker.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826936.402149:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349265a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143741696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.402149:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00080000:3.0:1787826936.402179:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e0f00 x1874672143741184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826936.402189:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143740800:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.402191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143741184:0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.402199:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349265a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143741696:12345-0@lo:400:kworker.0 Request processed in 53us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826936.402209:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826936.402230:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e1680 x1874672143741696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826936.402235:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787826936.402245:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143741696:0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.402256:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143741312:0@lo:400:kworker.0 00000100:00080000:1.0:1787826936.402261:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826936.402267:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826936.402277:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143741824:0@lo:400:kworker.0 00000100:00100000:2.0:1787826936.402284:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143741568:0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.402301:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143740928:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.402316:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143740672:0@lo:400:kworker.0 00010000:00080000:1.0:1787826936.402319:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e03c0 x1874672143741440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826936.402320:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826936.402324:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741056 00000100:00100000:0.0:1787826936.402331:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741056 00000100:00100000:1.0:1787826936.402338:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143741440:0@lo:400:kworker.0 00010000:00080000:1.0:1787826936.402357:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e3c00 x1874672143741952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826936.402366:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143740544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.402370:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143741568 00000100:00100000:0.0:1787826936.402376:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787826936.402382:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143741568 00000100:00100000:1.0:1787826936.402385:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143741952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.402392:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143741056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826936.402407:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143740416:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.402423:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787826936.402434:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143741568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826936.402444:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143741056:12345-0@lo:400:kworker.0 Request processed in 56us (239us total) trans 0 rc 0/0 00000100:00080000:1.0:1787826936.402452:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826936.402457:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787826936.402459:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143741056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.402481:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143741568:12345-0@lo:400:kworker.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826936.402482:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143741568:0@lo:400:kworker.0 00000100:00100000:3.0:1787826936.402494:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787826936.424281:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826936.424355:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222720 00000100:00100000:1.0:1787826936.424365:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222720 00002000:00100000:1.0:1787826936.424414:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (419430400->423624703) req@ffff8d547f7f0780 x1874672134222720/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/0 e 0 to 0 dl 1787826947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826936.424423:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f0780 with x1874672134222720 ext(419430400->423624703) 00002000:00010000:1.0:1787826936.424434:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f0780 00000100:00100000:1.0:1787826936.424464:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 132 00000100:00100000:1.0:1787826936.424474:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134222720:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826936.438531:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134222720:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14049us (14250us total) trans 30064771137 rc 0/0 00000100:00100000:2.0:1787826936.438541:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 132 00002000:00100000:2.0:1787826936.438551:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (419430400->423624703) req@ffff8d547f7f0780 x1874672134222720/t30064771137(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/448 e 0 to 0 dl 1787826947 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826936.438558:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f0780 with x1874672134222720 ext(419430400->423624703) 00002000:00010000:2.0:1787826936.438563:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f0780 00000100:00100000:0.0:1787826936.642469:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826936.642531:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222848 00000100:00100000:2.0:1787826936.642553:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222848 00002000:00100000:2.0:1787826936.642600:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (423624704->427819007) req@ffff8d547f9e1e00 x1874672134222848/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/0 e 0 to 0 dl 1787826947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826936.642611:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1e00 with x1874672134222848 ext(423624704->427819007) 00002000:00010000:2.0:1787826936.642616:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1e00 00000100:00100000:2.0:1787826936.642650:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 133 00000100:00100000:2.0:1787826936.642660:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2391:x1874672134222848:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826936.654157:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2391:x1874672134222848:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11491us (11687us total) trans 30064771138 rc 0/0 00000100:00100000:2.0:1787826936.654172:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 133 00002000:00100000:2.0:1787826936.654184:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (423624704->427819007) req@ffff8d547f9e1e00 x1874672134222848/t30064771138(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/448 e 0 to 0 dl 1787826947 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826936.654194:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1e00 with x1874672134222848 ext(423624704->427819007) 00002000:00010000:2.0:1787826936.654200:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1e00 00000100:00100000:1.0:1787826936.854392:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826936.854550:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134222976 00000100:00100000:0.0:1787826936.854560:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134222976 00002000:00100000:0.0:1787826936.854608:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (427819008->432013311) req@ffff8d5345ae2940 x1874672134222976/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/0 e 0 to 0 dl 1787826947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826936.854620:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae2940 with x1874672134222976 ext(427819008->432013311) 00002000:00010000:0.0:1787826936.854625:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae2940 00000100:00100000:0.0:1787826936.854661:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 134 00000100:00100000:0.0:1787826936.854670:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134222976:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826936.869860:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134222976:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15176us (15463us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1787826936.869872:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 134 00002000:00100000:0.0:1787826936.869891:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (427819008->432013311) req@ffff8d5345ae2940 x1874672134222976/t30064771139(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:537/0 lens 488/448 e 0 to 0 dl 1787826947 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826936.869898:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae2940 with x1874672134222976 ext(427819008->432013311) 00002000:00010000:0.0:1787826936.869903:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae2940 00000100:00100000:2.0:1787826936.913474:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143742080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826936.913557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826936.913610:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742080 00000100:00100000:0.0:1787826936.913619:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742080 00000100:00100000:0.0:1787826936.913682:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787826936.913692:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143742080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826936.913737:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826936.913789:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143742080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826936.913797:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787826936.913836:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143742080:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826937.041324:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826937.092882:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826937.092958:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134223104 00000100:00100000:0.0:1787826937.092967:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134223104 00002000:00100000:0.0:1787826937.093025:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (432013312->436207615) req@ffff8d547f9d03c0 x1874672134223104/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/0 e 0 to 0 dl 1787826948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826937.093031:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787826937.093038:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d03c0 with x1874672134223104 ext(432013312->436207615) 00002000:00010000:0.0:1787826937.093044:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d03c0 00000100:00100000:0.0:1787826937.093069:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 135 00000100:00100000:0.0:1787826937.093079:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134223104:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826937.105241:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134223104:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12138us (12341us total) trans 30064771140 rc 0/0 00000100:00100000:0.0:1787826937.105253:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 135 00002000:00100000:0.0:1787826937.105263:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (432013312->436207615) req@ffff8d547f9d03c0 x1874672134223104/t30064771140(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/448 e 0 to 0 dl 1787826948 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826937.105283:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d03c0 with x1874672134223104 ext(432013312->436207615) 00002000:00010000:0.0:1787826937.105289:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d03c0 00000100:00100000:1.0:1787826937.309737:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826937.309797:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134223232 00000100:00100000:2.0:1787826937.309807:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134223232 00002000:00100000:2.0:1787826937.309846:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (436207616->440401919) req@ffff8d5345ae12c0 x1874672134223232/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/0 e 0 to 0 dl 1787826948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826937.309855:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae12c0 with x1874672134223232 ext(436207616->440401919) 00002000:00010000:2.0:1787826937.309867:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae12c0 00000100:00100000:2.0:1787826937.309892:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 136 00000100:00100000:2.0:1787826937.309899:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134223232:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826937.323011:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134223232:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13104us (13276us total) trans 30064771141 rc 0/0 00000100:00100000:2.0:1787826937.323023:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 136 00002000:00100000:2.0:1787826937.323032:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (436207616->440401919) req@ffff8d5345ae12c0 x1874672134223232/t30064771141(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/448 e 0 to 0 dl 1787826948 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826937.323039:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae12c0 with x1874672134223232 ext(436207616->440401919) 00002000:00010000:2.0:1787826937.323044:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae12c0 00000100:00100000:0.0:1787826937.517823:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826937.517883:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134223360 00000100:00100000:3.0:1787826937.517892:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134223360 00002000:00100000:3.0:1787826937.517940:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (440401920->444596223) req@ffff8d547f9e0000 x1874672134223360/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/0 e 0 to 0 dl 1787826948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826937.517952:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0000 with x1874672134223360 ext(440401920->444596223) 00002000:00010000:3.0:1787826937.517958:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0000 00000100:00100000:3.0:1787826937.517987:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 137 00000100:00100000:3.0:1787826937.517997:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134223360:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826937.530010:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134223360:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12005us (12184us total) trans 30064771142 rc 0/0 00000100:00100000:3.0:1787826937.530023:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 137 00002000:00100000:3.0:1787826937.530036:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (440401920->444596223) req@ffff8d547f9e0000 x1874672134223360/t30064771142(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/448 e 0 to 0 dl 1787826948 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826937.530047:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0000 with x1874672134223360 ext(440401920->444596223) 00002000:00010000:3.0:1787826937.530054:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0000 00000100:00100000:1.0:1787826937.737865:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826937.737914:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134223488 00000100:00100000:2.0:1787826937.737930:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134223488 00002000:00100000:2.0:1787826937.737969:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (444596224->448790527) req@ffff8d5345ae1680 x1874672134223488/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/0 e 0 to 0 dl 1787826948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826937.737976:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1680 with x1874672134223488 ext(444596224->448790527) 00002000:00010000:2.0:1787826937.737980:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1680 00000100:00100000:2.0:1787826937.738007:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 138 00000100:00100000:2.0:1787826937.738013:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134223488:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826937.751795:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134223488:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13774us (13928us total) trans 30064771143 rc 0/0 00000100:00100000:3.0:1787826937.751806:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 138 00002000:00100000:3.0:1787826937.751825:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (444596224->448790527) req@ffff8d5345ae1680 x1874672134223488/t30064771143(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/448 e 0 to 0 dl 1787826948 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826937.751832:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1680 with x1874672134223488 ext(444596224->448790527) 00002000:00010000:3.0:1787826937.751837:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1680 00000100:00100000:1.0:1787826937.984395:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826937.984454:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134223616 00000100:00100000:3.0:1787826937.984463:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134223616 00002000:00100000:3.0:1787826937.984507:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (448790528->452984831) req@ffff8d5345ae0f00 x1874672134223616/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/0 e 0 to 0 dl 1787826948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826937.984526:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae0f00 with x1874672134223616 ext(448790528->452984831) 00002000:00010000:3.0:1787826937.984534:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae0f00 00000100:00100000:3.0:1787826937.984567:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 139 00000100:00100000:3.0:1787826937.984577:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134223616:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826938.002195:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134223616:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17611us (17799us total) trans 30064771144 rc 0/0 00000100:00100000:2.0:1787826938.002211:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 139 00002000:00100000:2.0:1787826938.002248:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (448790528->452984831) req@ffff8d5345ae0f00 x1874672134223616/t30064771144(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:538/0 lens 488/448 e 0 to 0 dl 1787826948 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826938.002276:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae0f00 with x1874672134223616 ext(448790528->452984831) 00002000:00010000:2.0:1787826938.002282:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae0f00 00010000:00010000:2.0:1787826938.065460:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826938.229376:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826938.229436:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134223744 00000100:00100000:1.0:1787826938.229444:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134223744 00002000:00100000:1.0:1787826938.229491:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (452984832->457179135) req@ffff8d547f9e0780 x1874672134223744/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/0 e 0 to 0 dl 1787826949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826938.229500:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0780 with x1874672134223744 ext(452984832->457179135) 00002000:00010000:1.0:1787826938.229504:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0780 00000100:00100000:1.0:1787826938.229532:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 140 00000100:00100000:1.0:1787826938.229542:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134223744:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826938.243920:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134223744:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14366us (14538us total) trans 30064771145 rc 0/0 00000100:00100000:3.0:1787826938.243938:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 140 00002000:00100000:3.0:1787826938.243956:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (452984832->457179135) req@ffff8d547f9e0780 x1874672134223744/t30064771145(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/448 e 0 to 0 dl 1787826949 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826938.243968:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0780 with x1874672134223744 ext(452984832->457179135) 00002000:00010000:3.0:1787826938.243975:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0780 00000100:00100000:0.0:1787826938.449483:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143742208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826938.449511:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143742336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826938.449593:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826938.449645:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826938.449665:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742336 00000100:00100000:3.0:1787826938.449677:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742336 00000100:00100000:1.0:1787826938.449713:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742208 00000100:00100000:1.0:1787826938.449721:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742208 00000100:00100000:3.0:1787826938.449773:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787826938.449791:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787826938.449792:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143742336:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826938.449811:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143742208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826938.449817:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 757760 granted 454682048 pending 92135424 free 3488006144 avail 3256483840 00000100:00080000:2.0:1787826938.449824:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787826938.449837:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 757760 granted 454682048 pending 92135424 free 3488006144 avail 3256483840 00000100:00100000:1.0:1787826938.449910:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143742208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826938.449919:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787826938.449957:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143742336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826938.449967:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787826938.449991:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143742208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826938.449991:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143742336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826938.452808:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826938.452877:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134223872 00000100:00100000:2.0:1787826938.452894:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134223872 00002000:00100000:2.0:1787826938.452943:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (457179136->461373439) req@ffff8d5345ae0b40 x1874672134223872/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/0 e 0 to 0 dl 1787826949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826938.452952:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae0b40 with x1874672134223872 ext(457179136->461373439) 00002000:00010000:2.0:1787826938.452959:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae0b40 00000100:00100000:2.0:1787826938.452990:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 141 00000100:00100000:2.0:1787826938.453001:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134223872:12345-192.168.203.6@tcp:4:iozone.0 00000001:00080000:1.0:1787826938.463538:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771145 is committed 00000100:00100000:2.0:1787826938.467348:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134223872:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14340us (14537us total) trans 30064771146 rc 0/0 00000100:00100000:2.0:1787826938.467375:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 141 00002000:00100000:2.0:1787826938.467389:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (457179136->461373439) req@ffff8d5345ae0b40 x1874672134223872/t30064771146(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/448 e 0 to 0 dl 1787826949 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826938.467400:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae0b40 with x1874672134223872 ext(457179136->461373439) 00002000:00010000:2.0:1787826938.467407:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae0b40 00000100:00100000:0.0:1787826938.691414:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826938.691516:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224000 00000100:00100000:2.0:1787826938.691527:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224000 00002000:00100000:2.0:1787826938.691575:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (461373440->465567743) req@ffff8d547f9e2d00 x1874672134224000/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/0 e 0 to 0 dl 1787826949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826938.691583:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e2d00 with x1874672134224000 ext(461373440->465567743) 00002000:00010000:2.0:1787826938.691587:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e2d00 00000100:00100000:2.0:1787826938.691610:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 142 00000100:00100000:2.0:1787826938.691619:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134224000:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826938.707987:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134224000:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16359us (16571us total) trans 30064771147 rc 0/0 00000100:00100000:2.0:1787826938.708001:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 142 00002000:00100000:2.0:1787826938.708015:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (461373440->465567743) req@ffff8d547f9e2d00 x1874672134224000/t30064771147(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/448 e 0 to 0 dl 1787826949 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826938.708025:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e2d00 with x1874672134224000 ext(461373440->465567743) 00002000:00010000:2.0:1787826938.708031:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e2d00 00000100:00100000:0.0:1787826938.912709:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826938.912780:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224128 00000100:00100000:2.0:1787826938.912791:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224128 00002000:00100000:2.0:1787826938.912841:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (465567744->469762047) req@ffff8d547f9e3480 x1874672134224128/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/0 e 0 to 0 dl 1787826949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826938.912853:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e3480 with x1874672134224128 ext(465567744->469762047) 00002000:00010000:2.0:1787826938.912858:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e3480 00000100:00100000:2.0:1787826938.912888:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00100000:2.0:1787826938.912900:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134224128:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826938.929951:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2391:x1874672134224128:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17045us (17252us total) trans 30064771148 rc 0/0 00000100:00100000:2.0:1787826938.929975:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 143 00002000:00100000:2.0:1787826938.929989:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (465567744->469762047) req@ffff8d547f9e3480 x1874672134224128/t30064771148(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:539/0 lens 488/448 e 0 to 0 dl 1787826949 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826938.929999:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e3480 with x1874672134224128 ext(465567744->469762047) 00002000:00010000:2.0:1787826938.930005:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e3480 00010000:00010000:2.0:1787826939.089478:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826939.157790:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826939.157847:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224256 00000100:00100000:2.0:1787826939.157855:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224256 00002000:00100000:2.0:1787826939.157908:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (469762048->473956351) req@ffff8d547f9df480 x1874672134224256/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/0 e 0 to 0 dl 1787826950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826939.157912:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826939.157919:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9df480 with x1874672134224256 ext(469762048->473956351) 00002000:00010000:2.0:1787826939.157923:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9df480 00000100:00100000:2.0:1787826939.157945:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 144 00000100:00100000:2.0:1787826939.157951:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134224256:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826939.171250:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134224256:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13249us (13417us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1787826939.171266:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 144 00002000:00100000:2.0:1787826939.171279:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (469762048->473956351) req@ffff8d547f9df480 x1874672134224256/t30064771149(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/448 e 0 to 0 dl 1787826950 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826939.171290:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9df480 with x1874672134224256 ext(469762048->473956351) 00002000:00010000:2.0:1787826939.171296:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9df480 00000100:00100000:1.0:1787826939.398080:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826939.398139:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224384 00000100:00100000:3.0:1787826939.398149:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224384 00002000:00100000:3.0:1787826939.398195:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (473956352->478150655) req@ffff8d5345ae2580 x1874672134224384/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/0 e 0 to 0 dl 1787826950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826939.398203:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae2580 with x1874672134224384 ext(473956352->478150655) 00002000:00010000:3.0:1787826939.398207:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae2580 00000100:00100000:3.0:1787826939.398253:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 145 00000100:00100000:3.0:1787826939.398263:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134224384:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826939.416006:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134224384:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17734us (17922us total) trans 30064771150 rc 0/0 00000100:00100000:2.0:1787826939.416038:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 145 00002000:00100000:2.0:1787826939.416051:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (473956352->478150655) req@ffff8d5345ae2580 x1874672134224384/t30064771150(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/448 e 0 to 0 dl 1787826950 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826939.416062:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae2580 with x1874672134224384 ext(473956352->478150655) 00002000:00010000:2.0:1787826939.416068:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae2580 00000100:00100000:0.0:1787826939.651640:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826939.651700:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224512 00000100:00100000:3.0:1787826939.651709:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224512 00002000:00100000:3.0:1787826939.651753:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (478150656->482344959) req@ffff8d547f9e3c00 x1874672134224512/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/0 e 0 to 0 dl 1787826950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826939.651764:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e3c00 with x1874672134224512 ext(478150656->482344959) 00002000:00010000:3.0:1787826939.651768:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e3c00 00000100:00100000:3.0:1787826939.651801:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 146 00000100:00100000:3.0:1787826939.651809:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134224512:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826939.667698:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134224512:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15868us (16062us total) trans 30064771151 rc 0/0 00000100:00100000:2.0:1787826939.667712:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 146 00002000:00100000:2.0:1787826939.667726:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (478150656->482344959) req@ffff8d547f9e3c00 x1874672134224512/t30064771151(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/448 e 0 to 0 dl 1787826950 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826939.667737:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e3c00 with x1874672134224512 ext(478150656->482344959) 00002000:00010000:2.0:1787826939.667742:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e3c00 00000100:00100000:1.0:1787826939.898359:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826939.898580:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224640 00000100:00100000:0.0:1787826939.898588:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224640 00002000:00100000:0.0:1787826939.898633:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (482344960->486539263) req@ffff8d5345ae21c0 x1874672134224640/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/0 e 0 to 0 dl 1787826950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826939.898644:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae21c0 with x1874672134224640 ext(482344960->486539263) 00002000:00010000:0.0:1787826939.898649:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae21c0 00000100:00100000:0.0:1787826939.898681:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:0.0:1787826939.898702:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134224640:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826939.918544:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134224640:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19836us (20186us total) trans 30064771152 rc 0/0 00000100:00100000:0.0:1787826939.918559:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 147 00002000:00100000:0.0:1787826939.918573:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (482344960->486539263) req@ffff8d5345ae21c0 x1874672134224640/t30064771152(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:540/0 lens 488/448 e 0 to 0 dl 1787826950 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826939.918600:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae21c0 with x1874672134224640 ext(482344960->486539263) 00002000:00010000:0.0:1787826939.918605:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae21c0 00010000:00010000:2.0:1787826940.113400:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826940.150516:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826940.150586:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224768 00000100:00100000:3.0:1787826940.150596:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224768 00002000:00100000:3.0:1787826940.150638:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (486539264->490733567) req@ffff8d547f9d1680 x1874672134224768/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/0 e 0 to 0 dl 1787826951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826940.150655:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d1680 with x1874672134224768 ext(486539264->490733567) 00002000:00010000:3.0:1787826940.150672:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d1680 00000100:00100000:3.0:1787826940.150715:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:3.0:1787826940.150723:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134224768:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826940.164674:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134224768:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13941us (14167us total) trans 30064771153 rc 0/0 00000100:00100000:3.0:1787826940.164698:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 148 00002000:00100000:3.0:1787826940.164711:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (486539264->490733567) req@ffff8d547f9d1680 x1874672134224768/t30064771153(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/448 e 0 to 0 dl 1787826951 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826940.164721:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d1680 with x1874672134224768 ext(486539264->490733567) 00002000:00010000:3.0:1787826940.164726:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d1680 00000100:00100000:0.0:1787826940.305934:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826940.305972:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826940.305984:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134224896 00000100:00100000:3.0:1787826940.305994:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134224896 00000100:00100000:0.0:1787826940.306009:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826940.306050:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 499 00000100:00100000:0.0:1787826940.306055:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826940.306066:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134224896:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826940.306086:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225280 00000100:00100000:0.0:1787826940.306090:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225280 00000100:00100000:0.0:1787826940.306130:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 168 00000100:00100000:0.0:1787826940.306138:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134225280:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826940.306198:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134225280:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826940.306205:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 168 00000100:00080000:0.0:1787826940.306254:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826940.306292:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134224896:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 230us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826940.306300:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 499 00000100:00100000:1.0:1787826940.306416:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225152 00000100:00100000:1.0:1787826940.306421:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225152 00000100:00100000:1.0:1787826940.306463:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225024 00000100:00100000:1.0:1787826940.306466:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225024 00000100:00100000:1.0:1787826940.306487:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 304 00000100:00100000:1.0:1787826940.306495:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134225152:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826940.306531:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134225152:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826940.306538:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 304 00000100:00100000:1.0:1787826940.306553:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 305 00000100:00100000:1.0:1787826940.306560:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134225024:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826940.306582:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134225024:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 23us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826940.306603:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 305 00000100:00080000:0.0:1787826940.306888:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826940.306891:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826940.414038:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826940.414107:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225408 00000100:00100000:2.0:1787826940.414116:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225408 00002000:00100000:2.0:1787826940.414162:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (490733568->494927871) req@ffff8d547f9e30c0 x1874672134225408/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/0 e 0 to 0 dl 1787826951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826940.414173:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e30c0 with x1874672134225408 ext(490733568->494927871) 00002000:00010000:2.0:1787826940.414180:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e30c0 00000100:00100000:2.0:1787826940.414284:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 149 00000100:00100000:2.0:1787826940.414294:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134225408:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826940.443828:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134225408:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 29519us (29793us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1787826940.443873:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 149 00002000:00100000:2.0:1787826940.443890:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (490733568->494927871) req@ffff8d547f9e30c0 x1874672134225408/t30064771154(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/448 e 0 to 0 dl 1787826951 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826940.443910:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e30c0 with x1874672134225408 ext(490733568->494927871) 00002000:00010000:2.0:1787826940.443918:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e30c0 00000100:00100000:1.0:1787826940.660316:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826940.660425:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225536 00000100:00100000:2.0:1787826940.660440:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225536 00002000:00100000:2.0:1787826940.660495:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (494927872->499122175) req@ffff8d5345ae1e00 x1874672134225536/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/0 e 0 to 0 dl 1787826951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826940.660507:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1e00 with x1874672134225536 ext(494927872->499122175) 00002000:00010000:2.0:1787826940.660513:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1e00 00000100:00100000:2.0:1787826940.660548:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:2.0:1787826940.660559:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134225536:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826940.680796:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134225536:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20229us (20496us total) trans 30064771155 rc 0/0 00000100:00100000:3.0:1787826940.680811:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 150 00002000:00100000:3.0:1787826940.680823:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (494927872->499122175) req@ffff8d5345ae1e00 x1874672134225536/t30064771155(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/448 e 0 to 0 dl 1787826951 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826940.680834:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1e00 with x1874672134225536 ext(494927872->499122175) 00002000:00010000:3.0:1787826940.680839:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1e00 00000100:00100000:0.0:1787826940.900364:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826940.900502:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225664 00000100:00100000:2.0:1787826940.900513:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225664 00002000:00100000:2.0:1787826940.900566:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (499122176->503316479) req@ffff8d547f9e1680 x1874672134225664/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/0 e 0 to 0 dl 1787826951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826940.900578:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1680 with x1874672134225664 ext(499122176->503316479) 00002000:00010000:2.0:1787826940.900583:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1680 00000100:00100000:2.0:1787826940.900646:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:2.0:1787826940.900655:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2391:x1874672134225664:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826940.920674:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134225664:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20009us (20309us total) trans 30064771156 rc 0/0 00000100:00100000:0.0:1787826940.920699:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 151 00002000:00100000:0.0:1787826940.920713:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (499122176->503316479) req@ffff8d547f9e1680 x1874672134225664/t30064771156(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:541/0 lens 488/448 e 0 to 0 dl 1787826951 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826940.920725:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1680 with x1874672134225664 ext(499122176->503316479) 00002000:00010000:0.0:1787826940.920732:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1680 00000100:00100000:2.0:1787826941.009415:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826941.009437:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143742592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826941.009530:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826941.009568:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143742720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826941.009571:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742592 00000100:00100000:3.0:1787826941.009583:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742592 00000100:00100000:2.0:1787826941.009594:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143742464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826941.009614:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826941.009622:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826941.009664:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742720 00000100:00100000:2.0:1787826941.009664:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742464 00000100:00080000:0.0:1787826941.009669:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826941.009672:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742464 00000100:00100000:1.0:1787826941.009673:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742720 00000100:00100000:3.0:1787826941.009690:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787826941.009705:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143742592:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826941.009731:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00002000:00000024:3.0:1787826941.009745:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826941.009756:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143742464:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826941.009762:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1787826941.009767:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826941.009776:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143742720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826941.009800:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1787826941.009807:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826941.009851:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143742592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826941.009861:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787826941.009900:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143742464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (273us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826941.009903:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e0f00 x1874672143742592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826941.009912:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787826941.009918:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143742720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826941.009928:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143742592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826941.009930:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00080000:3.0:1787826941.009943:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9dcb40 x1874672143742720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826941.009956:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143742464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826941.009970:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143742720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787826941.137484:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826941.142802:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826941.142885:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225792 00000100:00100000:0.0:1787826941.142902:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225792 00000100:00080000:2.0:1787826941.142957:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787826941.142966:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (503316480->507510783) req@ffff8d547f9d21c0 x1874672134225792/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/0 e 0 to 0 dl 1787826952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826941.142978:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d21c0 with x1874672134225792 ext(503316480->507510783) 00002000:00010000:0.0:1787826941.142983:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d21c0 00000100:00100000:0.0:1787826941.143019:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 152 00000100:00100000:0.0:1787826941.143026:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134225792:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826941.161930:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134225792:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18894us (19128us total) trans 30064771157 rc 0/0 00000100:00100000:2.0:1787826941.161944:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 152 00002000:00100000:2.0:1787826941.161958:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (503316480->507510783) req@ffff8d547f9d21c0 x1874672134225792/t30064771157(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/448 e 0 to 0 dl 1787826952 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826941.161969:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d21c0 with x1874672134225792 ext(503316480->507510783) 00002000:00010000:2.0:1787826941.161974:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d21c0 00000100:00100000:0.0:1787826941.392539:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826941.392651:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134225920 00000100:00100000:3.0:1787826941.392660:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134225920 00002000:00100000:3.0:1787826941.392720:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (507510784->511705087) req@ffff8d547fa6b0c0 x1874672134225920/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/0 e 0 to 0 dl 1787826952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826941.392731:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6b0c0 with x1874672134225920 ext(507510784->511705087) 00002000:00010000:3.0:1787826941.392737:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6b0c0 00000100:00100000:3.0:1787826941.392771:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 153 00000100:00100000:3.0:1787826941.392782:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134225920:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826941.411736:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134225920:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18945us (19195us total) trans 30064771158 rc 0/0 00000100:00100000:3.0:1787826941.411749:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 153 00002000:00100000:3.0:1787826941.411762:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (507510784->511705087) req@ffff8d547fa6b0c0 x1874672134225920/t30064771158(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/448 e 0 to 0 dl 1787826952 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826941.411785:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6b0c0 with x1874672134225920 ext(507510784->511705087) 00002000:00010000:3.0:1787826941.411789:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6b0c0 00000100:00100000:1.0:1787826941.521770:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143742848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.521851:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826941.521879:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143742976:0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.521901:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742848 00000100:00100000:2.0:1787826941.521910:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742848 00000100:00100000:3.0:1787826941.521923:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826941.521957:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143742976 00000100:00100000:1.0:1787826941.521963:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143742976 00000100:00100000:2.0:1787826941.521968:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1787826941.521982:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143742848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.522003:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787826941.522013:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143742976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.522044:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143742848:12345-0@lo:400:kworker.0 Request processed in 66us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826941.522065:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1787826941.522261:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143742848:0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.522297:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143743104:0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.522344:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826941.522387:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143743104 00000100:00100000:2.0:1787826941.522391:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143743104 00000100:00100000:2.0:1787826941.522418:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787826941.522425:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143743104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.522472:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143743104:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826941.522479:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787826941.522519:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143743104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.522985:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143742976:12345-0@lo:400:kworker.0 Request processed in 972us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826941.522993:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787826941.523046:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143743360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.523083:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143742976:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.523105:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143743488:0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.523157:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826941.523160:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826941.523195:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826941.523203:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143743232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.523204:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143743360 00000100:00100000:3.0:1787826941.523209:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143743616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.523239:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143743360 00000100:00100000:1.0:1787826941.523277:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787826941.523285:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826941.523288:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143743360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.523325:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826941.523340:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143743488 00000100:00100000:3.0:1787826941.523347:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143743488 00000100:00100000:3.0:1787826941.523394:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143743616 00000100:00100000:3.0:1787826941.523398:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143743616 00000100:00100000:3.0:1787826941.523430:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787826941.523446:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143743488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.523753:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143743744:0@lo:400:kworker.0 00000100:00100000:0.0:1787826941.523820:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787826941.523836:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143743616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.525454:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143743488:12345-0@lo:400:kworker.0 Request processed in 2009us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826941.525467:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787826941.525517:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143744000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.525551:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826941.525601:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6a940 x1874672143743616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826941.525614:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143743616:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.525639:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143743488:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.525659:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826941.525666:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143744128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.525702:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826941.525745:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744000 00000100:00100000:3.0:1787826941.525751:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744000 00000100:00100000:3.0:1787826941.525784:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744128 00000100:00100000:3.0:1787826941.525787:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744128 00000100:00100000:3.0:1787826941.525808:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787826941.525828:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143744000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.525874:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143744000:12345-0@lo:400:kworker.0 Request processed in 47us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826941.525880:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787826941.525891:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787826941.525898:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143744128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.525924:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143744128:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826941.525930:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00080000:3.0:1787826941.525975:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6b840 x1874672143744128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826941.525997:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143744128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.526008:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143744000:0@lo:400:kworker.0 00000100:00080000:3.0:1787826941.526037:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826941.526062:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143743232 00000100:00100000:3.0:1787826941.526066:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143743232 00000100:00100000:3.0:1787826941.526100:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787826941.526106:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143743232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.526140:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143743232:12345-0@lo:400:kworker.0 Request processed in 34us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826941.526145:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787826941.526200:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143743872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.526281:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143743360:12345-0@lo:400:kworker.0 Request processed in 2989us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826941.526411:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787826941.526803:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826941.526851:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143744384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.526878:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826941.526906:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143743360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.527198:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143743872 00000100:00100000:3.0:1787826941.527202:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143743872 00000100:00100000:3.0:1787826941.527256:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744384 00000100:00100000:3.0:1787826941.527259:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744384 00000100:00100000:3.0:1787826941.527285:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787826941.527342:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787826941.527352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143744384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.527394:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143744384:12345-0@lo:400:kworker.0 Request processed in 45us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826941.527401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00080000:1.0:1787826941.527430:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6a1c0 x1874672143744384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826941.527440:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143744384:0@lo:400:kworker.0 00000100:00080000:1.0:1787826941.527464:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826941.527517:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143743872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.527557:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143743872:12345-0@lo:400:kworker.0 Request processed in 44us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826941.527596:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00080000:1.0:1787826941.527651:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa69e00 x1874672143743872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826941.527661:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143743872:0@lo:400:kworker.0 00000100:00100000:2.0:1787826941.527857:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826941.527923:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143744256:0@lo:400:kworker.0 00000100:00100000:0.0:1787826941.527935:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143743616:12345-0@lo:400:kworker.0 Request processed in 4034us (4581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826941.527950:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787826941.527969:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826941.528162:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143743232:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.528203:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143743744 00000100:00100000:3.0:1787826941.528207:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143743744 00000100:00080000:2.0:1787826941.528276:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826941.528327:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744256 00000100:00100000:1.0:1787826941.528331:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744256 00000100:00100000:1.0:1787826941.528438:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787826941.528445:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143743744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.528480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143743744:12345-0@lo:400:kworker.0 Request processed in 36us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826941.528487:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787826941.528500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787826941.528506:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826941.528550:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143744256:12345-0@lo:400:kworker.0 Request processed in 44us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826941.528557:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787826941.528695:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143743744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826941.528710:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143744256:0@lo:400:kworker.0 00000100:00080000:2.0:1787826941.528927:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826941.647117:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826941.647177:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226048 00000100:00100000:3.0:1787826941.647187:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226048 00002000:00100000:3.0:1787826941.647262:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (511705088->515899391) req@ffff8d5345ae3c00 x1874672134226048/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/0 e 0 to 0 dl 1787826952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826941.647288:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae3c00 with x1874672134226048 ext(511705088->515899391) 00002000:00010000:3.0:1787826941.647294:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae3c00 00000100:00100000:2.0:1787826941.648208:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:2.0:1787826941.648244:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134226048:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826941.664828:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134226048:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16573us (17703us total) trans 30064771159 rc 0/0 00000100:00100000:2.0:1787826941.664847:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 154 00002000:00100000:2.0:1787826941.664864:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (511705088->515899391) req@ffff8d5345ae3c00 x1874672134226048/t30064771159(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/448 e 0 to 0 dl 1787826952 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826941.664877:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae3c00 with x1874672134226048 ext(511705088->515899391) 00002000:00010000:2.0:1787826941.664884:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae3c00 00000100:00100000:0.0:1787826941.901636:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826941.901710:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226176 00000100:00100000:2.0:1787826941.901720:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226176 00002000:00100000:2.0:1787826941.901768:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (515899392->520093695) req@ffff8d547fa692c0 x1874672134226176/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/0 e 0 to 0 dl 1787826952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826941.901778:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa692c0 with x1874672134226176 ext(515899392->520093695) 00002000:00010000:2.0:1787826941.901783:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa692c0 00000100:00100000:2.0:1787826941.901810:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 155 00000100:00100000:2.0:1787826941.901820:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134226176:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826941.917050:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134226176:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15215us (15404us total) trans 30064771160 rc 0/0 00000100:00100000:2.0:1787826941.917069:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 155 00002000:00100000:2.0:1787826941.917088:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (515899392->520093695) req@ffff8d547fa692c0 x1874672134226176/t30064771160(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:542/0 lens 488/448 e 0 to 0 dl 1787826952 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826941.917101:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa692c0 with x1874672134226176 ext(515899392->520093695) 00002000:00010000:2.0:1787826941.917110:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa692c0 00000100:00100000:3.0:1787826942.033514:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143744512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826942.033613:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826942.033660:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744512 00000100:00100000:2.0:1787826942.033697:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744512 00000100:00100000:2.0:1787826942.033762:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787826942.033773:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143744512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826942.033814:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826942.033878:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143744512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826942.033885:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787826942.033978:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143744512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826942.140055:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826942.140129:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226304 00000100:00100000:3.0:1787826942.140139:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226304 00002000:00100000:3.0:1787826942.140183:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (520093696->524287999) req@ffff8d547fa6b480 x1874672134226304/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/0 e 0 to 0 dl 1787826953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826942.140194:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6b480 with x1874672134226304 ext(520093696->524287999) 00002000:00010000:3.0:1787826942.140200:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6b480 00000100:00100000:3.0:1787826942.140263:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 156 00000100:00100000:3.0:1787826942.140273:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134226304:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826942.154274:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134226304:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13991us (14218us total) trans 30064771161 rc 0/0 00000100:00100000:3.0:1787826942.154292:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 156 00002000:00100000:3.0:1787826942.154306:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (520093696->524287999) req@ffff8d547fa6b480 x1874672134226304/t30064771161(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/448 e 0 to 0 dl 1787826953 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826942.154317:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6b480 with x1874672134226304 ext(520093696->524287999) 00002000:00010000:3.0:1787826942.154323:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6b480 00010000:00010000:2.0:1787826942.161390:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826942.403153:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826942.403265:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226432 00000100:00100000:2.0:1787826942.403277:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226432 00002000:00100000:2.0:1787826942.403325:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (524288000->528482303) req@ffff8d547fa6a580 x1874672134226432/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/0 e 0 to 0 dl 1787826953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826942.403336:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6a580 with x1874672134226432 ext(524288000->528482303) 00002000:00010000:2.0:1787826942.403342:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6a580 00000100:00100000:2.0:1787826942.403382:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 157 00000100:00100000:2.0:1787826942.403393:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134226432:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826942.417927:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134226432:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14527us (14779us total) trans 30064771162 rc 0/0 00000100:00100000:3.0:1787826942.417953:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 157 00002000:00100000:3.0:1787826942.417966:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (524288000->528482303) req@ffff8d547fa6a580 x1874672134226432/t30064771162(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/448 e 0 to 0 dl 1787826953 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826942.417977:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6a580 with x1874672134226432 ext(524288000->528482303) 00002000:00010000:3.0:1787826942.417984:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6a580 00000100:00100000:2.0:1787826942.653333:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826942.653389:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226560 00000100:00100000:3.0:1787826942.653398:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226560 00002000:00100000:3.0:1787826942.653446:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (528482304->532676607) req@ffff8d547f9d0000 x1874672134226560/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/0 e 0 to 0 dl 1787826953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826942.653458:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d0000 with x1874672134226560 ext(528482304->532676607) 00002000:00010000:3.0:1787826942.653463:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d0000 00000100:00100000:3.0:1787826942.653489:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 158 00000100:00100000:3.0:1787826942.653498:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134226560:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826942.668920:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134226560:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15404us (15573us total) trans 30064771163 rc 0/0 00000100:00100000:3.0:1787826942.668934:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 158 00002000:00100000:3.0:1787826942.668946:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (528482304->532676607) req@ffff8d547f9d0000 x1874672134226560/t30064771163(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/448 e 0 to 0 dl 1787826953 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826942.668957:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d0000 with x1874672134226560 ext(528482304->532676607) 00002000:00010000:3.0:1787826942.668963:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d0000 00000100:00100000:2.0:1787826942.887951:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826942.888017:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226688 00000100:00100000:0.0:1787826942.888026:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226688 00002000:00100000:0.0:1787826942.888070:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (532676608->536870911) req@ffff8d547f9d1a40 x1874672134226688/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/0 e 0 to 0 dl 1787826953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826942.888081:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d1a40 with x1874672134226688 ext(532676608->536870911) 00002000:00010000:0.0:1787826942.888086:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d1a40 00000100:00100000:0.0:1787826942.888121:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 159 00000100:00100000:0.0:1787826942.888131:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2390:x1874672134226688:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826942.905813:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2390:x1874672134226688:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17673us (17861us total) trans 30064771164 rc 0/0 00000100:00100000:0.0:1787826942.905825:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 159 00002000:00100000:0.0:1787826942.905839:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (532676608->536870911) req@ffff8d547f9d1a40 x1874672134226688/t30064771164(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:543/0 lens 488/448 e 0 to 0 dl 1787826953 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826942.905849:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d1a40 with x1874672134226688 ext(532676608->536870911) 00002000:00010000:0.0:1787826942.905854:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d1a40 00000100:00100000:1.0:1787826943.141533:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826943.141602:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226816 00000100:00100000:2.0:1787826943.141612:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226816 00000100:00080000:1.0:1787826943.141672:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826943.141680:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (536870912->541065215) req@ffff8d5345ae03c0 x1874672134226816/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/0 e 0 to 0 dl 1787826954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826943.141691:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae03c0 with x1874672134226816 ext(536870912->541065215) 00002000:00010000:2.0:1787826943.141696:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae03c0 00000100:00100000:2.0:1787826943.141724:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 160 00000100:00100000:2.0:1787826943.141735:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2391:x1874672134226816:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826943.160095:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2391:x1874672134226816:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18354us (18562us total) trans 30064771165 rc 0/0 00000100:00100000:2.0:1787826943.160108:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 160 00002000:00100000:2.0:1787826943.160121:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (536870912->541065215) req@ffff8d5345ae03c0 x1874672134226816/t30064771165(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/448 e 0 to 0 dl 1787826954 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826943.160131:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae03c0 with x1874672134226816 ext(536870912->541065215) 00002000:00010000:2.0:1787826943.160136:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae03c0 00010000:00010000:2.0:1787826943.185509:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826943.392236:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826943.392324:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134226944 00000100:00100000:3.0:1787826943.392333:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134226944 00002000:00100000:3.0:1787826943.392387:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (541065216->545259519) req@ffff8d547f9d2d00 x1874672134226944/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/0 e 0 to 0 dl 1787826954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826943.392407:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d2d00 with x1874672134226944 ext(541065216->545259519) 00002000:00010000:3.0:1787826943.392413:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d2d00 00000100:00100000:3.0:1787826943.392453:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 161 00000100:00100000:3.0:1787826943.392463:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134226944:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826943.408467:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134226944:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15997us (16249us total) trans 30064771166 rc 0/0 00000100:00100000:2.0:1787826943.408479:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 161 00002000:00100000:2.0:1787826943.408489:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (541065216->545259519) req@ffff8d547f9d2d00 x1874672134226944/t30064771166(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/448 e 0 to 0 dl 1787826954 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826943.408496:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d2d00 with x1874672134226944 ext(541065216->545259519) 00002000:00010000:2.0:1787826943.408501:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d2d00 00000100:00100000:1.0:1787826943.569541:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826943.569577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143744768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826943.569619:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143744640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826943.569746:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826943.569823:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744768 00000100:00100000:0.0:1787826943.569833:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744768 00000100:00080000:2.0:1787826943.569910:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826943.569916:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826943.569941:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744640 00000100:00100000:0.0:1787826943.569947:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744640 00000100:00100000:2.0:1787826943.569963:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787826943.569995:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143744768:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826943.570001:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787826943.570020:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143744640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826943.570025:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 729088 granted 539739584 pending 88596480 free 3387342848 avail 3155820544 00002000:00000024:0.0:1787826943.570044:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 729088 granted 539739584 pending 88596480 free 3387342848 avail 3155820544 00000100:00100000:2.0:1787826943.570105:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143744768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826943.570117:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143744640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826943.570117:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787826943.570144:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1787826943.570194:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826943.570246:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143744640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826943.570252:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143744768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826943.642770:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826943.642926:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227072 00000100:00100000:2.0:1787826943.642942:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227072 00002000:00100000:2.0:1787826943.643011:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (545259520->549453823) req@ffff8d547fa69e00 x1874672134227072/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/0 e 0 to 0 dl 1787826954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826943.643024:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa69e00 with x1874672134227072 ext(545259520->549453823) 00002000:00010000:2.0:1787826943.643030:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa69e00 00000100:00100000:2.0:1787826943.643089:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 162 00000100:00100000:2.0:1787826943.643100:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134227072:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826943.663295:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134227072:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20181us (20522us total) trans 30064771167 rc 0/0 00000100:00100000:0.0:1787826943.663381:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 162 00002000:00100000:0.0:1787826943.663399:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (545259520->549453823) req@ffff8d547fa69e00 x1874672134227072/t30064771167(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/448 e 0 to 0 dl 1787826954 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826943.663419:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa69e00 with x1874672134227072 ext(545259520->549453823) 00002000:00010000:0.0:1787826943.663427:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa69e00 00000001:00080000:1.0:1787826943.664154:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771167 is committed 00000100:00100000:2.0:1787826943.893435:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826943.893500:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227200 00000100:00100000:0.0:1787826943.893509:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227200 00002000:00100000:0.0:1787826943.893557:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (549453824->553648127) req@ffff8d547f9d0f00 x1874672134227200/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/0 e 0 to 0 dl 1787826954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826943.893568:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d0f00 with x1874672134227200 ext(549453824->553648127) 00002000:00010000:0.0:1787826943.893573:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d0f00 00000100:00100000:0.0:1787826943.893603:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 163 00000100:00100000:0.0:1787826943.893612:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134227200:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826943.908846:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134227200:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15175us (15358us total) trans 30064771168 rc 0/0 00000100:00100000:1.0:1787826943.908862:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 163 00002000:00100000:1.0:1787826943.908874:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (549453824->553648127) req@ffff8d547f9d0f00 x1874672134227200/t30064771168(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:544/0 lens 488/448 e 0 to 0 dl 1787826954 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826943.908884:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d0f00 with x1874672134227200 ext(549453824->553648127) 00002000:00010000:1.0:1787826943.908890:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d0f00 00000100:00100000:2.0:1787826944.138028:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826944.138163:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227328 00000100:00100000:1.0:1787826944.138176:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227328 00002000:00100000:1.0:1787826944.138280:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (553648128->557842431) req@ffff8d547f9d0780 x1874672134227328/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/0 e 0 to 0 dl 1787826955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826944.138293:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d0780 with x1874672134227328 ext(553648128->557842431) 00002000:00010000:1.0:1787826944.138300:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d0780 00000100:00100000:1.0:1787826944.138336:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 164 00000100:00100000:1.0:1787826944.138348:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134227328:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826944.174375:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134227328:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 36011us (36344us total) trans 30064771169 rc 0/0 00000100:00100000:2.0:1787826944.174449:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 164 00002000:00100000:2.0:1787826944.174466:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (553648128->557842431) req@ffff8d547f9d0780 x1874672134227328/t30064771169(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/448 e 0 to 0 dl 1787826955 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826944.174478:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d0780 with x1874672134227328 ext(553648128->557842431) 00002000:00010000:2.0:1787826944.174486:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d0780 00010000:00010000:2.0:1787826944.210121:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826944.415410:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826944.415516:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227456 00000100:00100000:2.0:1787826944.415533:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227456 00002000:00100000:2.0:1787826944.415605:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (557842432->562036735) req@ffff8d547fac9a40 x1874672134227456/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/0 e 0 to 0 dl 1787826955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826944.415619:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac9a40 with x1874672134227456 ext(557842432->562036735) 00002000:00010000:2.0:1787826944.415626:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac9a40 00000100:00100000:2.0:1787826944.415701:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 165 00000100:00100000:2.0:1787826944.415712:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134227456:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826944.432401:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2391:x1874672134227456:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16675us (16983us total) trans 30064771170 rc 0/0 00000100:00100000:2.0:1787826944.432419:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 165 00002000:00100000:2.0:1787826944.432437:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (557842432->562036735) req@ffff8d547fac9a40 x1874672134227456/t30064771170(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/448 e 0 to 0 dl 1787826955 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826944.432449:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac9a40 with x1874672134227456 ext(557842432->562036735) 00002000:00010000:2.0:1787826944.432457:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac9a40 00000100:00100000:2.0:1787826944.665382:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826944.665602:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227584 00000100:00100000:3.0:1787826944.665617:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227584 00002000:00100000:3.0:1787826944.665685:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (562036736->566231039) req@ffff8d547f9d3c00 x1874672134227584/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/0 e 0 to 0 dl 1787826955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826944.665697:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d3c00 with x1874672134227584 ext(562036736->566231039) 00002000:00010000:3.0:1787826944.665703:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d3c00 00000100:00100000:3.0:1787826944.665735:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:3.0:1787826944.665745:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134227584:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826944.692523:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134227584:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 26761us (27152us total) trans 30064771171 rc 0/0 00000100:00100000:3.0:1787826944.692542:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 166 00002000:00100000:3.0:1787826944.692561:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (562036736->566231039) req@ffff8d547f9d3c00 x1874672134227584/t30064771171(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/448 e 0 to 0 dl 1787826955 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826944.692574:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d3c00 with x1874672134227584 ext(562036736->566231039) 00002000:00010000:3.0:1787826944.692582:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d3c00 00000100:00100000:1.0:1787826944.928035:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826944.929280:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227712 00000100:00100000:2.0:1787826944.929291:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227712 00002000:00100000:2.0:1787826944.929342:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (566231040->570425343) req@ffff8d547facad00 x1874672134227712/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/0 e 0 to 0 dl 1787826955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826944.929353:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facad00 with x1874672134227712 ext(566231040->570425343) 00002000:00010000:2.0:1787826944.929358:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facad00 00000100:00100000:2.0:1787826944.929392:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 167 00000100:00100000:2.0:1787826944.929401:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134227712:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826944.959470:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134227712:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 30061us (31434us total) trans 30064771172 rc 0/0 00000100:00100000:2.0:1787826944.959491:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 167 00002000:00100000:2.0:1787826944.959504:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (566231040->570425343) req@ffff8d547facad00 x1874672134227712/t30064771172(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:545/0 lens 488/448 e 0 to 0 dl 1787826955 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826944.959529:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facad00 with x1874672134227712 ext(566231040->570425343) 00002000:00010000:2.0:1787826944.959535:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facad00 00000100:00100000:1.0:1787826945.194120:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826945.194206:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227840 00000100:00100000:2.0:1787826945.194242:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227840 00002000:00100000:2.0:1787826945.194315:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (570425344->574619647) req@ffff8d547fac8f00 x1874672134227840/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/0 e 0 to 0 dl 1787826956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826945.194319:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826945.194341:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac8f00 with x1874672134227840 ext(570425344->574619647) 00002000:00010000:2.0:1787826945.194347:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac8f00 00000100:00100000:2.0:1787826945.194376:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 168 00000100:00100000:2.0:1787826945.194388:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134227840:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826945.216601:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134227840:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22202us (22476us total) trans 30064771173 rc 0/0 00000100:00100000:2.0:1787826945.216618:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 168 00002000:00100000:2.0:1787826945.216634:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (570425344->574619647) req@ffff8d547fac8f00 x1874672134227840/t30064771173(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/448 e 0 to 0 dl 1787826956 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826945.216653:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac8f00 with x1874672134227840 ext(570425344->574619647) 00002000:00010000:2.0:1787826945.216662:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac8f00 00010000:00010000:2.0:1787826945.233895:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826945.428915:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826945.428967:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826945.429001:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826945.429025:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826945.429048:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826945.429125:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228352 00000100:00100000:3.0:1787826945.429126:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228480 00000100:00100000:3.0:1787826945.429138:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228480 00000100:00100000:0.0:1787826945.429143:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228352 00000100:00100000:0.0:1787826945.429211:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:2.0:1787826945.429249:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134227968 00000100:00100000:0.0:1787826945.429256:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134228352:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826945.429257:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134227968 00000100:00100000:2.0:1787826945.429298:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 501 00000100:00100000:2.0:1787826945.429307:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134227968:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826945.429350:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134227968:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 41us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826945.429351:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134228352:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826945.429363:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:2.0:1787826945.429370:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 501 00000100:00100000:1.0:1787826945.429477:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228096 00000100:00100000:1.0:1787826945.429492:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228096 00000100:00100000:1.0:1787826945.429570:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228224 00000100:00100000:1.0:1787826945.429574:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228224 00000100:00100000:1.0:1787826945.429607:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 312 00000100:00100000:1.0:1787826945.429616:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134228096:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826945.429703:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134228096:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 87us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826945.429711:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 312 00000100:00100000:1.0:1787826945.429729:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 313 00000100:00100000:1.0:1787826945.429735:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134228224:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826945.429758:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134228224:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 23us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826945.429764:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 313 00000100:00080000:1.0:1787826945.429786:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826945.429790:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826945.429792:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826945.429859:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 174 00000100:00100000:0.0:1787826945.429871:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134228480:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826945.429908:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134228480:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 40us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826945.429915:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 174 00000100:00100000:0.0:1787826945.441900:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826945.441978:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228608 00000100:00100000:2.0:1787826945.441989:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228608 00002000:00100000:2.0:1787826945.442041:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (574619648->578813951) req@ffff8d547fa683c0 x1874672134228608/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/0 e 0 to 0 dl 1787826956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826945.442053:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa683c0 with x1874672134228608 ext(574619648->578813951) 00002000:00010000:2.0:1787826945.442059:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa683c0 00000100:00100000:2.0:1787826945.442097:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 169 00000100:00100000:2.0:1787826945.442107:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134228608:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826945.466663:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134228608:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24534us (24749us total) trans 30064771174 rc 0/0 00000100:00100000:1.0:1787826945.466679:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 169 00002000:00100000:1.0:1787826945.466692:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (574619648->578813951) req@ffff8d547fa683c0 x1874672134228608/t30064771174(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/448 e 0 to 0 dl 1787826956 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826945.466721:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa683c0 with x1874672134228608 ext(574619648->578813951) 00002000:00010000:1.0:1787826945.466727:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa683c0 00000100:00100000:0.0:1787826945.717072:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826945.717206:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228736 00000100:00100000:2.0:1787826945.717245:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228736 00002000:00100000:2.0:1787826945.717313:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (578813952->583008255) req@ffff8d547fa6a940 x1874672134228736/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/0 e 0 to 0 dl 1787826956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826945.717325:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6a940 with x1874672134228736 ext(578813952->583008255) 00002000:00010000:2.0:1787826945.717331:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6a940 00000100:00100000:2.0:1787826945.717359:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 170 00000100:00100000:2.0:1787826945.717366:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134228736:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826945.738495:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134228736:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21120us (21424us total) trans 30064771175 rc 0/0 00000100:00100000:0.0:1787826945.738509:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 170 00002000:00100000:0.0:1787826945.738521:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (578813952->583008255) req@ffff8d547fa6a940 x1874672134228736/t30064771175(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/448 e 0 to 0 dl 1787826956 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826945.738532:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6a940 with x1874672134228736 ext(578813952->583008255) 00002000:00010000:0.0:1787826945.738537:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6a940 00000100:00100000:3.0:1787826945.968902:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826945.969036:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228864 00000100:00100000:1.0:1787826945.969045:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228864 00002000:00100000:1.0:1787826945.969089:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (583008256->587202559) req@ffff8d547f9dd680 x1874672134228864/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/0 e 0 to 0 dl 1787826956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826945.969100:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9dd680 with x1874672134228864 ext(583008256->587202559) 00002000:00010000:1.0:1787826945.969105:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9dd680 00000100:00100000:1.0:1787826945.969141:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 171 00000100:00100000:1.0:1787826945.969151:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134228864:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826945.995872:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134228864:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 26712us (26967us total) trans 30064771176 rc 0/0 00000100:00100000:1.0:1787826945.995886:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 171 00002000:00100000:1.0:1787826945.995901:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (583008256->587202559) req@ffff8d547f9dd680 x1874672134228864/t30064771176(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:546/0 lens 488/448 e 0 to 0 dl 1787826956 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826945.995912:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9dd680 with x1874672134228864 ext(583008256->587202559) 00002000:00010000:1.0:1787826945.995918:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9dd680 00000100:00100000:3.0:1787826946.129363:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826946.129385:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143744896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826946.129399:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143745152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826946.129468:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826946.129475:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826946.129525:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143744896 00000100:00100000:3.0:1787826946.129528:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143745024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826946.129534:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143744896 00000100:00100000:1.0:1787826946.129546:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745152 00000100:00100000:1.0:1787826946.129552:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745152 00000100:00100000:3.0:1787826946.129558:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826946.129574:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826946.129591:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745024 00000100:00100000:2.0:1787826946.129597:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745024 00000100:00100000:0.0:1787826946.129598:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787826946.129600:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787826946.129611:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143744896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826946.129611:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5451bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143745152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826946.129653:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:0.0:1787826946.129654:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787826946.129660:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826946.129666:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787826946.129674:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143745024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826946.129688:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826946.129708:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5451bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143745152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.129709:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143744896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.129717:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787826946.129720:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787826946.129729:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143745024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826946.129737:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787826946.129738:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143745152:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787826946.129767:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9dde00 x1874672143744896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826946.129781:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143744896:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787826946.129790:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa69a40 x1874672143745024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826946.129798:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143745024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826946.236726:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826946.236932:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134228992 00000100:00100000:1.0:1787826946.236942:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134228992 00002000:00100000:1.0:1787826946.236993:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (587202560->591396863) req@ffff8d547f9d2940 x1874672134228992/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:547/0 lens 488/0 e 0 to 0 dl 1787826957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826946.237004:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d2940 with x1874672134228992 ext(587202560->591396863) 00002000:00010000:1.0:1787826946.237010:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d2940 00000100:00100000:1.0:1787826946.237048:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 172 00000100:00100000:1.0:1787826946.237057:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2391:x1874672134228992:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787826946.257795:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826946.259334:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2391:x1874672134228992:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22261us (22600us total) trans 30064771177 rc 0/0 00000100:00100000:1.0:1787826946.259352:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 172 00002000:00100000:1.0:1787826946.259370:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (587202560->591396863) req@ffff8d547f9d2940 x1874672134228992/t30064771177(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:547/0 lens 488/448 e 0 to 0 dl 1787826957 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826946.259382:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d2940 with x1874672134228992 ext(587202560->591396863) 00002000:00010000:1.0:1787826946.259390:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d2940 00000100:00100000:2.0:1787826946.508327:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826946.508398:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134229120 00000100:00100000:3.0:1787826946.508408:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134229120 00002000:00100000:3.0:1787826946.508460:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (591396864->595591167) req@ffff8d547f9d2580 x1874672134229120/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:547/0 lens 488/0 e 0 to 0 dl 1787826957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826946.508472:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d2580 with x1874672134229120 ext(591396864->595591167) 00002000:00010000:3.0:1787826946.508490:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d2580 00000100:00100000:3.0:1787826946.508539:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:3.0:1787826946.508549:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134229120:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826946.531694:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134229120:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23136us (23366us total) trans 30064771178 rc 0/0 00000100:00100000:2.0:1787826946.531709:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 173 00002000:00100000:2.0:1787826946.531722:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (591396864->595591167) req@ffff8d547f9d2580 x1874672134229120/t30064771178(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:547/0 lens 488/448 e 0 to 0 dl 1787826957 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826946.531733:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d2580 with x1874672134229120 ext(591396864->595591167) 00002000:00010000:2.0:1787826946.531738:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d2580 00000100:00100000:2.0:1787826946.641484:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143745280:0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.641563:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826946.641597:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745280 00000100:00100000:3.0:1787826946.641606:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745280 00000100:00100000:2.0:1787826946.641621:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143745792:0@lo:400:kworker.0 00000100:00100000:1.0:1787826946.641653:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143745408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641674:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1787826946.641682:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143745664:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641689:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143745280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826946.641697:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826946.641703:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826946.641733:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826946.641733:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143745920:0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.641738:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143746304:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641769:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143745280:12345-0@lo:400:kworker.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.641778:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143746176:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641781:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1787826946.641793:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826946.641794:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826946.641822:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826946.641831:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745792 00000100:00100000:2.0:1787826946.641836:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143746816:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641838:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745792 00000100:00100000:1.0:1787826946.641843:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143746432:0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.641853:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143746688:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641879:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787826946.641880:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826946.641888:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826946.641893:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143745792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.641901:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745408 00000100:00100000:0.0:1787826946.641912:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745408 00000100:00100000:1.0:1787826946.641925:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826946.641933:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143745280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641941:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143745792:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.641943:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787826946.641954:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787826946.641959:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143745536:0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.641960:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143745408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.641967:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143745792:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.641980:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745920 00000100:00100000:3.0:1787826946.641985:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745920 00000100:00100000:2.0:1787826946.642001:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745664 00000100:00100000:1.0:1787826946.642008:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826946.642008:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745664 00000100:00100000:0.0:1787826946.642019:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143745408:12345-0@lo:400:kworker.0 Request processed in 64us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.642028:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787826946.642029:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746432 00000100:00100000:3.0:1787826946.642035:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746432 00000100:00100000:2.0:1787826946.642043:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746304 00000100:00100000:0.0:1787826946.642048:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746176 00000100:00100000:2.0:1787826946.642048:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746304 00000100:00100000:0.0:1787826946.642054:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746176 00000100:00100000:1.0:1787826946.642059:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143746048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.642068:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787826946.642080:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746816 00000100:00100000:3.0:1787826946.642080:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143745920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642086:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746816 00000100:00100000:0.0:1787826946.642088:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787826946.642094:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826946.642102:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143745664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826946.642124:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143746560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642138:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787826946.642147:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143745920:12345-0@lo:400:kworker.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826946.642150:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143746304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.642158:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143745664:12345-0@lo:400:kworker.0 Request processed in 58us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826946.642162:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787826946.642174:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787826946.642175:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826946.642179:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746048 00000100:00100000:3.0:1787826946.642190:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746048 00000100:00100000:0.0:1787826946.642202:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787826946.642240:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746560 00000100:00100000:3.0:1787826946.642246:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746560 00000100:00100000:0.0:1787826946.642248:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143746176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642248:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143746304:12345-0@lo:400:kworker.0 Request processed in 65us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826946.642251:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143745408:0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642263:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787826946.642269:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787826946.642280:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143745920:0@lo:400:kworker.0 00000100:00100000:3.0:1787826946.642281:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547faca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143746432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642287:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787826946.642301:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143746816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.642306:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143746176:12345-0@lo:400:kworker.0 Request processed in 94us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.642314:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787826946.642345:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547faca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143746432:12345-0@lo:400:kworker.0 Request processed in 66us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.642349:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787826946.642352:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143746816:12345-0@lo:400:kworker.0 Request processed in 54us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826946.642360:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787826946.642363:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143746048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642368:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787826946.642376:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787826946.642382:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143746560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642399:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143745536 00000100:00100000:2.0:1787826946.642404:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143745536 00000100:00080000:3.0:1787826946.642406:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826946.642409:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143746048:12345-0@lo:400:kworker.0 Request processed in 49us (316us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826946.642413:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826946.642419:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1787826946.642420:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826946.642433:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143746560:12345-0@lo:400:kworker.0 Request processed in 56us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826946.642443:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787826946.642445:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787826946.642456:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143745536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.642462:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826946.642480:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243e1c0 x1874672143746304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826946.642489:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f996940 x1874672143746048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826946.642514:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143746304:0@lo:400:kworker.0 00000100:00100000:1.0:1787826946.642515:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143746048:0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.642516:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143745664:0@lo:400:kworker.0 00000100:00100000:2.0:1787826946.642517:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143745536:12345-0@lo:400:kworker.0 Request processed in 56us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826946.642534:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:3.0:1787826946.642542:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e15da40 x1874672143746816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826946.642554:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143746816:0@lo:400:kworker.0 00010000:00080000:1.0:1787826946.642560:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0fc00 x1874672143746560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826946.642565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f994f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143746176:0@lo:400:kworker.0 00000100:00100000:1.0:1787826946.642580:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143746560:0@lo:400:kworker.0 00000100:00100000:1.0:1787826946.642597:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143746432:0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.642604:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746688 00000100:00100000:0.0:1787826946.642609:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746688 00000100:00100000:1.0:1787826946.642625:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143745536:0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.642787:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787826946.642795:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143746688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826946.642838:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143746688:12345-0@lo:400:kworker.0 Request processed in 43us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826946.642845:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787826946.642861:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143746688:0@lo:400:kworker.0 00000100:00080000:3.0:1787826946.642900:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826946.768952:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826946.769058:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134229248 00000100:00100000:3.0:1787826946.769067:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134229248 00002000:00100000:3.0:1787826946.769121:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (595591168->599785471) req@ffff8d534479d2c0 x1874672134229248/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:547/0 lens 488/0 e 0 to 0 dl 1787826957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826946.769134:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479d2c0 with x1874672134229248 ext(595591168->599785471) 00002000:00010000:3.0:1787826946.769140:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479d2c0 00000100:00100000:3.0:1787826946.769171:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 174 00000100:00100000:3.0:1787826946.769181:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134229248:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826946.788606:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134229248:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19415us (19661us total) trans 30064771179 rc 0/0 00000100:00100000:3.0:1787826946.788630:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 174 00002000:00100000:3.0:1787826946.788653:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (595591168->599785471) req@ffff8d534479d2c0 x1874672134229248/t30064771179(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:547/0 lens 488/448 e 0 to 0 dl 1787826957 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826946.788664:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479d2c0 with x1874672134229248 ext(595591168->599785471) 00002000:00010000:3.0:1787826946.788669:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479d2c0 00000100:00100000:1.0:1787826947.024906:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826947.024969:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134229376 00000100:00100000:2.0:1787826947.024992:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134229376 00002000:00100000:2.0:1787826947.025193:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (599785472->603979775) req@ffff8d547facb840 x1874672134229376/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/0 e 0 to 0 dl 1787826958 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826947.025205:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facb840 with x1874672134229376 ext(599785472->603979775) 00002000:00010000:2.0:1787826947.025210:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facb840 00000100:00100000:2.0:1787826947.025262:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 175 00000100:00100000:2.0:1787826947.025270:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134229376:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:3.0:1787826947.025853:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826947.049976:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134229376:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24696us (25069us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1787826947.049989:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 175 00002000:00100000:2.0:1787826947.050001:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (599785472->603979775) req@ffff8d547facb840 x1874672134229376/t30064771180(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/448 e 0 to 0 dl 1787826958 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826947.050011:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facb840 with x1874672134229376 ext(599785472->603979775) 00002000:00010000:2.0:1787826947.050016:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facb840 00000100:00100000:1.0:1787826947.154013:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143746944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826947.154080:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826947.154153:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143746944 00000100:00100000:3.0:1787826947.154161:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143746944 00000100:00100000:3.0:1787826947.154257:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787826947.154267:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547faca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143746944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826947.154300:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826947.154357:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547faca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143746944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826947.154363:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787826947.154433:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143746944:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826947.281402:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826947.290153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826947.290243:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134229504 00000100:00100000:2.0:1787826947.290252:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134229504 00002000:00100000:2.0:1787826947.290294:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (603979776->608174079) req@ffff8d547fa69680 x1874672134229504/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/0 e 0 to 0 dl 1787826958 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826947.290306:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa69680 with x1874672134229504 ext(603979776->608174079) 00002000:00010000:2.0:1787826947.290311:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa69680 00000100:00100000:2.0:1787826947.290337:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 176 00000100:00100000:2.0:1787826947.290345:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2391:x1874672134229504:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826947.314543:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2391:x1874672134229504:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24191us (24389us total) trans 30064771181 rc 0/0 00000100:00100000:1.0:1787826947.314554:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 176 00002000:00100000:1.0:1787826947.314566:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (603979776->608174079) req@ffff8d547fa69680 x1874672134229504/t30064771181(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/448 e 0 to 0 dl 1787826958 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826947.314575:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa69680 with x1874672134229504 ext(603979776->608174079) 00002000:00010000:1.0:1787826947.314580:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa69680 00000100:00100000:0.0:1787826947.544807:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826947.544868:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134229632 00000100:00100000:1.0:1787826947.544878:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134229632 00002000:00100000:1.0:1787826947.544921:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (608174080->612368383) req@ffff8d547fa68f00 x1874672134229632/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/0 e 0 to 0 dl 1787826958 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826947.544933:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa68f00 with x1874672134229632 ext(608174080->612368383) 00002000:00010000:1.0:1787826947.544938:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa68f00 00000100:00100000:1.0:1787826947.544965:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00100000:1.0:1787826947.544974:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2390:x1874672134229632:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826947.562543:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2390:x1874672134229632:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17561us (17737us total) trans 30064771182 rc 0/0 00000100:00100000:1.0:1787826947.562562:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 177 00002000:00100000:1.0:1787826947.562576:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (608174080->612368383) req@ffff8d547fa68f00 x1874672134229632/t30064771182(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/448 e 0 to 0 dl 1787826958 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826947.562596:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa68f00 with x1874672134229632 ext(608174080->612368383) 00002000:00010000:1.0:1787826947.562602:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa68f00 00000100:00100000:2.0:1787826947.799427:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826947.799506:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134229760 00000100:00100000:0.0:1787826947.799516:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134229760 00002000:00100000:0.0:1787826947.799564:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (612368384->616562687) req@ffff8d534479de00 x1874672134229760/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/0 e 0 to 0 dl 1787826958 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826947.799576:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479de00 with x1874672134229760 ext(612368384->616562687) 00002000:00010000:0.0:1787826947.799590:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479de00 00000100:00100000:0.0:1787826947.799643:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 178 00000100:00100000:0.0:1787826947.799652:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2391:x1874672134229760:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826947.821825:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2391:x1874672134229760:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22162us (22396us total) trans 30064771183 rc 0/0 00000100:00100000:1.0:1787826947.821837:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 178 00002000:00100000:1.0:1787826947.821847:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (612368384->616562687) req@ffff8d534479de00 x1874672134229760/t30064771183(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:548/0 lens 488/448 e 0 to 0 dl 1787826958 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826947.821855:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479de00 with x1874672134229760 ext(612368384->616562687) 00002000:00010000:1.0:1787826947.821860:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479de00 00000100:00100000:0.0:1787826948.051008:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826948.051068:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134229888 00000100:00100000:1.0:1787826948.051078:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134229888 00002000:00100000:1.0:1787826948.051135:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (616562688->620756991) req@ffff8d547f9e0f00 x1874672134229888/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/0 e 0 to 0 dl 1787826959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826948.051146:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0f00 with x1874672134229888 ext(616562688->620756991) 00002000:00010000:1.0:1787826948.051151:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0f00 00000100:00100000:1.0:1787826948.051181:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 179 00000100:00100000:1.0:1787826948.051190:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134229888:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826948.069445:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134229888:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18245us (18435us total) trans 30064771184 rc 0/0 00000100:00100000:2.0:1787826948.069459:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 179 00002000:00100000:2.0:1787826948.069473:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (616562688->620756991) req@ffff8d547f9e0f00 x1874672134229888/t30064771184(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/448 e 0 to 0 dl 1787826959 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826948.069484:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0f00 with x1874672134229888 ext(616562688->620756991) 00002000:00010000:2.0:1787826948.069501:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0f00 00010000:00010000:2.0:1787826948.305433:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826948.306247:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826948.306315:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230016 00000100:00100000:1.0:1787826948.306325:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230016 00002000:00100000:1.0:1787826948.306368:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (620756992->624951295) req@ffff8d534486e1c0 x1874672134230016/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/0 e 0 to 0 dl 1787826959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826948.306380:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486e1c0 with x1874672134230016 ext(620756992->624951295) 00002000:00010000:1.0:1787826948.306385:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486e1c0 00000100:00100000:1.0:1787826948.306433:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 180 00000100:00100000:1.0:1787826948.306443:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134230016:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826948.319472:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134230016:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13020us (13220us total) trans 30064771185 rc 0/0 00000100:00100000:1.0:1787826948.319483:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 180 00002000:00100000:1.0:1787826948.319493:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (620756992->624951295) req@ffff8d534486e1c0 x1874672134230016/t30064771185(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/448 e 0 to 0 dl 1787826959 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826948.319501:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486e1c0 with x1874672134230016 ext(620756992->624951295) 00002000:00010000:1.0:1787826948.319505:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486e1c0 00000100:00100000:2.0:1787826948.560004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826948.560072:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230144 00000100:00100000:0.0:1787826948.560083:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230144 00002000:00100000:0.0:1787826948.560135:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (624951296->629145599) req@ffff8d534479cf00 x1874672134230144/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/0 e 0 to 0 dl 1787826959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826948.560147:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479cf00 with x1874672134230144 ext(624951296->629145599) 00002000:00010000:0.0:1787826948.560152:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479cf00 00000100:00100000:0.0:1787826948.560185:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 181 00000100:00100000:0.0:1787826948.560194:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134230144:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826948.575230:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134230144:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15011us (15209us total) trans 30064771186 rc 0/0 00000100:00100000:1.0:1787826948.575246:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 181 00002000:00100000:1.0:1787826948.575266:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (624951296->629145599) req@ffff8d534479cf00 x1874672134230144/t30064771186(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/448 e 0 to 0 dl 1787826959 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826948.575283:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479cf00 with x1874672134230144 ext(624951296->629145599) 00002000:00010000:1.0:1787826948.575290:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479cf00 00000100:00100000:1.0:1787826948.689400:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826948.689524:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143747072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826948.689535:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143747200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826948.689591:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826948.689618:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826948.689651:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747072 00000100:00100000:2.0:1787826948.689658:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747072 00000100:00100000:3.0:1787826948.689676:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747200 00000100:00100000:3.0:1787826948.689682:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747200 00000100:00080000:1.0:1787826948.689714:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826948.689723:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787826948.689735:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787826948.689736:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547faca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143747072:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826948.689751:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143747200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826948.689769:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 729088 granted 565806528 pending 80158720 free 3320233984 avail 3088711680 00002000:00000024:3.0:1787826948.689770:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 729088 granted 565806528 pending 80158720 free 3320233984 avail 3088711680 00000100:00100000:2.0:1787826948.689831:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143747200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826948.689838:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547faca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143747072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826948.689839:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787826948.689851:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787826948.689881:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143747200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826948.689884:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143747072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826948.794365:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826948.794433:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230272 00000100:00100000:3.0:1787826948.794465:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230272 00002000:00100000:3.0:1787826948.794530:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (629145600->633339903) req@ffff8d534486de00 x1874672134230272/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/0 e 0 to 0 dl 1787826959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826948.794543:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486de00 with x1874672134230272 ext(629145600->633339903) 00002000:00010000:3.0:1787826948.794550:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486de00 00000100:00100000:3.0:1787826948.794582:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 182 00000100:00100000:3.0:1787826948.794591:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134230272:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826948.808908:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134230272:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14309us (14549us total) trans 30064771187 rc 0/0 00000100:00100000:3.0:1787826948.808921:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 182 00002000:00100000:3.0:1787826948.808935:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (629145600->633339903) req@ffff8d534486de00 x1874672134230272/t30064771187(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:549/0 lens 488/448 e 0 to 0 dl 1787826959 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826948.808945:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486de00 with x1874672134230272 ext(629145600->633339903) 00002000:00010000:3.0:1787826948.808952:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486de00 00000100:00100000:2.0:1787826949.020970:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826949.021037:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230400 00000100:00100000:0.0:1787826949.021047:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230400 00002000:00100000:0.0:1787826949.021113:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (633339904->637534207) req@ffff8d534479fc00 x1874672134230400/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/0 e 0 to 0 dl 1787826960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826949.021123:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787826949.021125:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479fc00 with x1874672134230400 ext(633339904->637534207) 00002000:00010000:0.0:1787826949.021132:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479fc00 00000100:00100000:0.0:1787826949.021162:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 183 00000100:00100000:0.0:1787826949.021185:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2390:x1874672134230400:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826949.035496:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2390:x1874672134230400:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14302us (14525us total) trans 30064771188 rc 0/0 00000100:00100000:0.0:1787826949.035521:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 183 00002000:00100000:0.0:1787826949.035536:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (633339904->637534207) req@ffff8d534479fc00 x1874672134230400/t30064771188(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/448 e 0 to 0 dl 1787826960 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00000001:00080000:1.0:1787826949.035544:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771188 is committed 00002000:00100000:0.0:1787826949.035546:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479fc00 with x1874672134230400 ext(633339904->637534207) 00002000:00010000:0.0:1787826949.035554:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479fc00 00000100:00100000:1.0:1787826949.240752:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826949.240831:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230528 00000100:00100000:2.0:1787826949.240840:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230528 00002000:00100000:2.0:1787826949.240885:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (637534208->641728511) req@ffff8d547fac92c0 x1874672134230528/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/0 e 0 to 0 dl 1787826960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826949.240897:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac92c0 with x1874672134230528 ext(637534208->641728511) 00002000:00010000:2.0:1787826949.240902:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac92c0 00000100:00100000:2.0:1787826949.240932:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 184 00000100:00100000:2.0:1787826949.240942:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134230528:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826949.256348:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134230528:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15395us (15596us total) trans 30064771189 rc 0/0 00000100:00100000:1.0:1787826949.256363:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 184 00002000:00100000:1.0:1787826949.256377:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (637534208->641728511) req@ffff8d547fac92c0 x1874672134230528/t30064771189(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/448 e 0 to 0 dl 1787826960 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826949.256388:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac92c0 with x1874672134230528 ext(637534208->641728511) 00002000:00010000:1.0:1787826949.256394:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac92c0 00010000:00010000:2.0:1787826949.329481:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826949.481731:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826949.481802:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230656 00000100:00100000:1.0:1787826949.481813:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230656 00002000:00100000:1.0:1787826949.481862:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (641728512->645922815) req@ffff8d547f9de1c0 x1874672134230656/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/0 e 0 to 0 dl 1787826960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826949.481872:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9de1c0 with x1874672134230656 ext(641728512->645922815) 00002000:00010000:1.0:1787826949.481876:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9de1c0 00000100:00100000:1.0:1787826949.481903:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 185 00000100:00100000:1.0:1787826949.481913:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134230656:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826949.494468:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134230656:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12538us (12724us total) trans 30064771190 rc 0/0 00000100:00100000:1.0:1787826949.494492:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 185 00002000:00100000:1.0:1787826949.494508:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (641728512->645922815) req@ffff8d547f9de1c0 x1874672134230656/t30064771190(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/448 e 0 to 0 dl 1787826960 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826949.494520:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9de1c0 with x1874672134230656 ext(641728512->645922815) 00002000:00010000:1.0:1787826949.494526:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9de1c0 00000100:00100000:0.0:1787826949.720346:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826949.720449:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230784 00000100:00100000:1.0:1787826949.720459:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230784 00002000:00100000:1.0:1787826949.720529:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (645922816->650117119) req@ffff8d534486c780 x1874672134230784/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/0 e 0 to 0 dl 1787826960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826949.720540:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486c780 with x1874672134230784 ext(645922816->650117119) 00002000:00010000:1.0:1787826949.720545:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486c780 00000100:00100000:1.0:1787826949.720578:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 186 00000100:00100000:1.0:1787826949.720589:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134230784:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826949.742344:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2391:x1874672134230784:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21745us (21996us total) trans 30064771191 rc 0/0 00000100:00100000:0.0:1787826949.742359:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 186 00002000:00100000:0.0:1787826949.742372:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (645922816->650117119) req@ffff8d534486c780 x1874672134230784/t30064771191(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/448 e 0 to 0 dl 1787826960 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826949.742384:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486c780 with x1874672134230784 ext(645922816->650117119) 00002000:00010000:0.0:1787826949.742390:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486c780 00000100:00100000:2.0:1787826949.957509:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826949.957583:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134230912 00000100:00100000:1.0:1787826949.957592:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134230912 00002000:00100000:1.0:1787826949.957658:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (650117120->654311423) req@ffff8d547f9dd2c0 x1874672134230912/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/0 e 0 to 0 dl 1787826960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826949.957669:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9dd2c0 with x1874672134230912 ext(650117120->654311423) 00002000:00010000:1.0:1787826949.957674:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9dd2c0 00000100:00100000:1.0:1787826949.957704:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 187 00000100:00100000:1.0:1787826949.957713:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134230912:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826949.972876:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134230912:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15154us (15365us total) trans 30064771192 rc 0/0 00000100:00100000:3.0:1787826949.972891:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 187 00002000:00100000:3.0:1787826949.972905:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (650117120->654311423) req@ffff8d547f9dd2c0 x1874672134230912/t30064771192(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:550/0 lens 488/448 e 0 to 0 dl 1787826960 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826949.972916:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9dd2c0 with x1874672134230912 ext(650117120->654311423) 00002000:00010000:3.0:1787826949.972923:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9dd2c0 00000100:00100000:2.0:1787826950.202558:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826950.202633:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231040 00000100:00100000:1.0:1787826950.202643:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231040 00002000:00100000:1.0:1787826950.202691:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (654311424->658505727) req@ffff8d547f9de580 x1874672134231040/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/0 e 0 to 0 dl 1787826961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826950.202710:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9de580 with x1874672134231040 ext(654311424->658505727) 00002000:00010000:1.0:1787826950.202716:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9de580 00000100:00100000:1.0:1787826950.202747:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 188 00000100:00100000:1.0:1787826950.202757:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134231040:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826950.216788:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134231040:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14022us (14227us total) trans 30064771193 rc 0/0 00000100:00100000:3.0:1787826950.216803:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 188 00002000:00100000:3.0:1787826950.216828:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (654311424->658505727) req@ffff8d547f9de580 x1874672134231040/t30064771193(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/448 e 0 to 0 dl 1787826961 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826950.216839:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9de580 with x1874672134231040 ext(654311424->658505727) 00002000:00010000:3.0:1787826950.216846:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9de580 00010000:00010000:2.0:1787826950.353407:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826950.456330:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826950.456629:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231168 00000100:00100000:0.0:1787826950.456639:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231168 00002000:00100000:0.0:1787826950.456687:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (658505728->662700031) req@ffff8d547f9dc3c0 x1874672134231168/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/0 e 0 to 0 dl 1787826961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826950.456698:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9dc3c0 with x1874672134231168 ext(658505728->662700031) 00002000:00010000:0.0:1787826950.456704:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9dc3c0 00000100:00100000:0.0:1787826950.456744:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 189 00000100:00100000:0.0:1787826950.456753:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134231168:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826950.474781:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134231168:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18019us (18449us total) trans 30064771194 rc 0/0 00000100:00100000:0.0:1787826950.474795:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 189 00002000:00100000:0.0:1787826950.474816:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (658505728->662700031) req@ffff8d547f9dc3c0 x1874672134231168/t30064771194(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/448 e 0 to 0 dl 1787826961 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826950.474825:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9dc3c0 with x1874672134231168 ext(658505728->662700031) 00002000:00010000:0.0:1787826950.474830:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9dc3c0 00000100:00100000:2.0:1787826950.545269:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826950.545312:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826950.545344:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826950.545349:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231296 00000100:00100000:3.0:1787826950.545359:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231296 00000100:00100000:1.0:1787826950.545371:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231424 00000100:00100000:1.0:1787826950.545389:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231424 00000100:00100000:2.0:1787826950.545402:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826950.545425:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 503 00000100:00100000:3.0:1787826950.545437:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134231296:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826950.545446:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231552 00000100:00100000:1.0:1787826950.545451:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231552 00000100:00100000:2.0:1787826950.545463:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 320 00000100:00100000:2.0:1787826950.545473:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134231424:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826950.545493:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 321 00000100:00100000:3.0:1787826950.545505:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134231296:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 70us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826950.545516:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134231552:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826950.545517:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 503 00000100:00100000:2.0:1787826950.545524:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134231424:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826950.545535:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 320 00000100:00100000:3.0:1787826950.545557:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231680 00000100:00100000:1.0:1787826950.545559:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134231552:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 56us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826950.545563:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231680 00000100:00100000:1.0:1787826950.545568:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 321 00000100:00080000:2.0:1787826950.545574:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826950.545581:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826950.545583:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826950.545602:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 179 00000100:00100000:3.0:1787826950.545625:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134231680:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826950.545724:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134231680:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 114us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826950.545732:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 179 00000100:00100000:2.0:1787826950.713701:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826950.713768:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231808 00000100:00100000:3.0:1787826950.713778:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231808 00002000:00100000:3.0:1787826950.713831:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (662700032->666894335) req@ffff8d546e0fcb40 x1874672134231808/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/0 e 0 to 0 dl 1787826961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826950.713843:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0fcb40 with x1874672134231808 ext(662700032->666894335) 00002000:00010000:3.0:1787826950.713849:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0fcb40 00000100:00100000:3.0:1787826950.713881:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 190 00000100:00100000:3.0:1787826950.713904:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134231808:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826950.728075:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134231808:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14164us (14373us total) trans 30064771195 rc 0/0 00000100:00100000:2.0:1787826950.728089:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 190 00002000:00100000:2.0:1787826950.728101:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (662700032->666894335) req@ffff8d546e0fcb40 x1874672134231808/t30064771195(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/448 e 0 to 0 dl 1787826961 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826950.728111:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0fcb40 with x1874672134231808 ext(662700032->666894335) 00002000:00010000:2.0:1787826950.728117:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0fcb40 00000100:00100000:0.0:1787826950.991676:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826950.991740:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134231936 00000100:00100000:2.0:1787826950.991751:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134231936 00002000:00100000:2.0:1787826950.991799:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (666894336->671088639) req@ffff8d534486c3c0 x1874672134231936/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/0 e 0 to 0 dl 1787826961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826950.991810:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486c3c0 with x1874672134231936 ext(666894336->671088639) 00002000:00010000:2.0:1787826950.991815:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486c3c0 00000100:00100000:2.0:1787826950.991865:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 191 00000100:00100000:2.0:1787826950.991875:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134231936:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826951.013995:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134231936:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22111us (22318us total) trans 30064771196 rc 0/0 00000100:00100000:2.0:1787826951.014008:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 191 00002000:00100000:2.0:1787826951.014019:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (666894336->671088639) req@ffff8d534486c3c0 x1874672134231936/t30064771196(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:551/0 lens 488/448 e 0 to 0 dl 1787826961 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826951.014027:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486c3c0 with x1874672134231936 ext(666894336->671088639) 00002000:00010000:2.0:1787826951.014033:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486c3c0 00000100:00100000:2.0:1787826951.249424:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143747328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826951.249425:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e15da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143747456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826951.249433:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143747584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826951.249506:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826951.249511:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826951.249548:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747328 00000100:00100000:3.0:1787826951.249555:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747328 00000100:00100000:0.0:1787826951.249598:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747456 00000100:00100000:0.0:1787826951.249614:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747456 00000100:00100000:3.0:1787826951.249620:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787826951.249631:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143747328:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826951.249646:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826951.249662:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:3.0:1787826951.249663:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826951.249671:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747584 00000100:00100000:0.0:1787826951.249676:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747584 00000100:00100000:2.0:1787826951.249683:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787826951.249691:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143747456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826951.249711:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826951.249718:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143747328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826951.249728:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787826951.249731:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787826951.249748:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143747328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826951.249758:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143747456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826951.249760:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143747584:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826951.249769:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00002000:00000024:0.0:1787826951.249777:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787826951.249783:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e15da40 x1874672143747456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826951.249785:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826951.249802:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e15da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143747456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826951.249826:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143747584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826951.249835:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00010000:00080000:2.0:1787826951.249838:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534486f0c0 x1874672143747584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826951.249852:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143747584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826951.255361:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826951.255574:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232064 00000100:00100000:2.0:1787826951.255582:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232064 00002000:00100000:2.0:1787826951.255650:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (671088640->675282943) req@ffff8d534486f0c0 x1874672134232064/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:552/0 lens 488/0 e 0 to 0 dl 1787826962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826951.255656:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826951.255675:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486f0c0 with x1874672134232064 ext(671088640->675282943) 00002000:00010000:2.0:1787826951.255681:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486f0c0 00000100:00100000:2.0:1787826951.255711:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 192 00000100:00100000:2.0:1787826951.255721:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134232064:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826951.274192:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134232064:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18462us (18826us total) trans 30064771197 rc 0/0 00000100:00100000:1.0:1787826951.274206:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 192 00002000:00100000:1.0:1787826951.274246:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (671088640->675282943) req@ffff8d534486f0c0 x1874672134232064/t30064771197(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:552/0 lens 488/448 e 0 to 0 dl 1787826962 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826951.274256:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486f0c0 with x1874672134232064 ext(671088640->675282943) 00002000:00010000:1.0:1787826951.274263:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486f0c0 00010000:00010000:2.0:1787826951.377380:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826951.501516:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826951.501586:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232192 00000100:00100000:1.0:1787826951.501597:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232192 00002000:00100000:1.0:1787826951.501658:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (675282944->679477247) req@ffff8d53492bde00 x1874672134232192/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:552/0 lens 488/0 e 0 to 0 dl 1787826962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826951.501669:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bde00 with x1874672134232192 ext(675282944->679477247) 00002000:00010000:1.0:1787826951.501686:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bde00 00000100:00100000:1.0:1787826951.501715:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 193 00000100:00100000:1.0:1787826951.501725:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134232192:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826951.521150:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134232192:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19416us (19632us total) trans 30064771198 rc 0/0 00000100:00100000:1.0:1787826951.521166:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 193 00002000:00100000:1.0:1787826951.521181:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (675282944->679477247) req@ffff8d53492bde00 x1874672134232192/t30064771198(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:552/0 lens 488/448 e 0 to 0 dl 1787826962 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826951.521201:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bde00 with x1874672134232192 ext(675282944->679477247) 00002000:00010000:1.0:1787826951.521208:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bde00 00000100:00100000:0.0:1787826951.761587:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143747712:0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.761637:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547faca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143748096:0@lo:400:kworker.0 00000100:00100000:0.0:1787826951.761672:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826951.761697:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826951.761712:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547facb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143747840:0@lo:400:kworker.0 00000100:00100000:0.0:1787826951.761743:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143748224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.761744:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143748608:0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.761766:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826951.761799:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826951.761825:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787826951.761831:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143747968:0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.761857:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826951.761879:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747840 00000100:00100000:2.0:1787826951.761881:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143748480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826951.761888:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747840 00000100:00100000:2.0:1787826951.761949:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826951.761960:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547facbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143748352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.761981:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747968 00000100:00100000:2.0:1787826951.761986:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747968 00000100:00100000:3.0:1787826951.761995:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826951.762015:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748480 00000100:00100000:2.0:1787826951.762019:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748480 00000100:00100000:3.0:1787826951.762019:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143748864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762047:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826951.762048:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748352 00000100:00100000:2.0:1787826951.762052:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748352 00000100:00100000:2.0:1787826951.762071:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748864 00000100:00100000:2.0:1787826951.762074:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748864 00000100:00100000:3.0:1787826951.762084:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787826951.762097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143747840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.762098:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787826951.762120:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349265e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143747968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762168:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143747840:12345-0@lo:400:kworker.0 Request processed in 73us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826951.762182:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349265e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143747968:12345-0@lo:400:kworker.0 Request processed in 64us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826951.762195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787826951.762204:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787826951.762208:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826951.762253:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787826951.762262:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349266d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143748480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826951.762265:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143748736:0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.762269:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787826951.762298:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143748352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762302:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349266d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143748480:12345-0@lo:400:kworker.0 Request processed in 40us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826951.762314:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787826951.762318:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826951.762334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748736 00000100:00100000:3.0:1787826951.762339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748736 00000100:00100000:0.0:1787826951.762357:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748608 00000100:00100000:0.0:1787826951.762362:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748608 00000100:00100000:2.0:1787826951.762364:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143748352:12345-0@lo:400:kworker.0 Request processed in 84us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826951.762365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787826951.762376:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143748864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.762380:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787826951.762408:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748224 00000100:00100000:3.0:1787826951.762413:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143748864:12345-0@lo:400:kworker.0 Request processed in 38us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826951.762414:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748224 00000100:00100000:2.0:1787826951.762421:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787826951.762440:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143748736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826951.762445:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787826951.762456:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143748608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826951.762486:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787826951.762498:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826951.762502:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143748608:12345-0@lo:400:kworker.0 Request processed in 47us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826951.762509:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143748736:12345-0@lo:400:kworker.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826951.762513:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787826951.762544:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143748224:12345-0@lo:400:kworker.0 Request processed in 49us (339us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826951.762548:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826951.762553:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1787826951.762555:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826951.762559:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826951.762598:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143747968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826951.762612:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143748224:0@lo:400:kworker.0 00010000:00080000:0.0:1787826951.762629:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0e940 x1874672143748480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826951.762637:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143748736:0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787826951.762649:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143748480:0@lo:400:kworker.0 00000100:00100000:0.0:1787826951.762667:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143748608:0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762671:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143747712 00000100:00100000:3.0:1787826951.762676:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143747712 00000100:00100000:1.0:1787826951.762678:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748096 00000100:00100000:1.0:1787826951.762681:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748096 00000100:00100000:1.0:1787826951.762708:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787826951.762708:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1787826951.762716:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143748096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762716:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143747712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826951.762752:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143748096:12345-0@lo:400:kworker.0 Request processed in 37us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826951.762752:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143747712:12345-0@lo:400:kworker.0 Request processed in 37us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826951.762759:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1787826951.762764:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787826951.762770:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547faca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143748096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762799:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547facb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143747840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826951.762802:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143747712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826951.762809:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547facbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143748352:0@lo:400:kworker.0 00010000:00080000:3.0:1787826951.762818:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c7480 x1874672143748864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826951.762847:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143748864:0@lo:400:kworker.0 00000100:00100000:2.0:1787826951.763071:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787826951.769101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826951.769161:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232320 00000100:00100000:0.0:1787826951.769170:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232320 00002000:00100000:0.0:1787826951.769207:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (679477248->683671551) req@ffff8d5349264780 x1874672134232320/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:552/0 lens 488/0 e 0 to 0 dl 1787826962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826951.769238:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349264780 with x1874672134232320 ext(679477248->683671551) 00002000:00010000:0.0:1787826951.769241:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349264780 00000100:00100000:0.0:1787826951.769273:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 194 00000100:00100000:0.0:1787826951.769280:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134232320:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826951.786738:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134232320:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17445us (17635us total) trans 30064771199 rc 0/0 00000100:00100000:1.0:1787826951.786753:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 194 00002000:00100000:1.0:1787826951.786767:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (679477248->683671551) req@ffff8d5349264780 x1874672134232320/t30064771199(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:552/0 lens 488/448 e 0 to 0 dl 1787826962 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826951.786778:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349264780 with x1874672134232320 ext(679477248->683671551) 00002000:00010000:1.0:1787826951.786785:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349264780 00000100:00100000:0.0:1787826952.044164:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826952.044258:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232448 00000100:00100000:3.0:1787826952.044271:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232448 00002000:00100000:3.0:1787826952.044345:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (683671552->687865855) req@ffff8d53492be1c0 x1874672134232448/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/0 e 0 to 0 dl 1787826963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826952.044359:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be1c0 with x1874672134232448 ext(683671552->687865855) 00002000:00010000:3.0:1787826952.044365:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be1c0 00000100:00100000:3.0:1787826952.044414:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 195 00000100:00100000:3.0:1787826952.044425:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134232448:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826952.062839:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134232448:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18400us (18676us total) trans 30064771200 rc 0/0 00000100:00100000:3.0:1787826952.062854:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 195 00002000:00100000:3.0:1787826952.062867:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (683671552->687865855) req@ffff8d53492be1c0 x1874672134232448/t30064771200(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/448 e 0 to 0 dl 1787826963 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826952.062879:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be1c0 with x1874672134232448 ext(683671552->687865855) 00002000:00010000:3.0:1787826952.062885:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be1c0 00000100:00100000:3.0:1787826952.273509:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143748992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826952.273579:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826952.273630:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143748992 00000100:00100000:2.0:1787826952.273637:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143748992 00000100:00100000:2.0:1787826952.273677:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787826952.273684:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143748992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826952.273710:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787826952.273761:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143748992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826952.273767:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787826952.273829:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143748992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826952.291566:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826952.291635:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232576 00000100:00100000:3.0:1787826952.291644:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232576 00002000:00100000:3.0:1787826952.291687:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (687865856->692060159) req@ffff8d5349264000 x1874672134232576/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/0 e 0 to 0 dl 1787826963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826952.291713:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349264000 with x1874672134232576 ext(687865856->692060159) 00002000:00010000:3.0:1787826952.291718:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349264000 00000100:00100000:3.0:1787826952.291757:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 196 00000100:00100000:3.0:1787826952.291766:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2391:x1874672134232576:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826952.312049:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2391:x1874672134232576:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20272us (20478us total) trans 30064771201 rc 0/0 00000100:00100000:3.0:1787826952.312066:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 196 00002000:00100000:3.0:1787826952.312080:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (687865856->692060159) req@ffff8d5349264000 x1874672134232576/t30064771201(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/448 e 0 to 0 dl 1787826963 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826952.312091:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349264000 with x1874672134232576 ext(687865856->692060159) 00002000:00010000:3.0:1787826952.312099:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349264000 00010000:00010000:2.0:1787826952.401456:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826952.542619:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826952.542727:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232704 00000100:00100000:0.0:1787826952.542736:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232704 00002000:00100000:0.0:1787826952.542782:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (692060160->696254463) req@ffff8d53492670c0 x1874672134232704/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/0 e 0 to 0 dl 1787826963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826952.542793:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492670c0 with x1874672134232704 ext(692060160->696254463) 00002000:00010000:0.0:1787826952.542798:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492670c0 00000100:00100000:0.0:1787826952.542830:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 197 00000100:00100000:0.0:1787826952.542838:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134232704:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826952.557582:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2390:x1874672134232704:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14735us (14962us total) trans 30064771202 rc 0/0 00000100:00100000:1.0:1787826952.557607:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 197 00002000:00100000:1.0:1787826952.557621:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (692060160->696254463) req@ffff8d53492670c0 x1874672134232704/t30064771202(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/448 e 0 to 0 dl 1787826963 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826952.557631:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492670c0 with x1874672134232704 ext(692060160->696254463) 00002000:00010000:1.0:1787826952.557637:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492670c0 00000100:00100000:2.0:1787826952.776272:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826952.776366:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232832 00000100:00100000:0.0:1787826952.776379:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232832 00002000:00100000:0.0:1787826952.776544:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (696254464->700448767) req@ffff8d5349267840 x1874672134232832/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/0 e 0 to 0 dl 1787826963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826952.776556:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349267840 with x1874672134232832 ext(696254464->700448767) 00002000:00010000:0.0:1787826952.776563:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349267840 00000100:00100000:0.0:1787826952.776614:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 198 00000100:00100000:0.0:1787826952.776627:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134232832:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826952.798652:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134232832:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22018us (22382us total) trans 30064771203 rc 0/0 00000100:00100000:2.0:1787826952.798678:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 198 00002000:00100000:2.0:1787826952.798691:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (696254464->700448767) req@ffff8d5349267840 x1874672134232832/t30064771203(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:553/0 lens 488/448 e 0 to 0 dl 1787826963 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826952.798702:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349267840 with x1874672134232832 ext(696254464->700448767) 00002000:00010000:2.0:1787826952.798708:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349267840 00000100:00100000:2.0:1787826953.025928:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826953.026013:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134232960 00000100:00100000:0.0:1787826953.026022:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134232960 00002000:00100000:0.0:1787826953.026091:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (700448768->704643071) req@ffff8d5349265a40 x1874672134232960/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/0 e 0 to 0 dl 1787826964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826953.026091:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787826953.026105:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349265a40 with x1874672134232960 ext(700448768->704643071) 00002000:00010000:0.0:1787826953.026122:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349265a40 00000100:00100000:0.0:1787826953.026162:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 199 00000100:00100000:0.0:1787826953.026190:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349265a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134232960:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826953.049299:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349265a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134232960:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23106us (23370us total) trans 30064771204 rc 0/0 00000100:00100000:1.0:1787826953.049314:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 199 00002000:00100000:1.0:1787826953.049326:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (700448768->704643071) req@ffff8d5349265a40 x1874672134232960/t30064771204(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/448 e 0 to 0 dl 1787826964 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826953.049336:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349265a40 with x1874672134232960 ext(700448768->704643071) 00002000:00010000:1.0:1787826953.049348:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349265a40 00000100:00100000:0.0:1787826953.277344:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826953.277508:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233088 00000100:00100000:1.0:1787826953.277518:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233088 00002000:00100000:1.0:1787826953.277562:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (704643072->708837375) req@ffff8d5343b0e940 x1874672134233088/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/0 e 0 to 0 dl 1787826964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826953.277574:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0e940 with x1874672134233088 ext(704643072->708837375) 00002000:00010000:1.0:1787826953.277579:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0e940 00000100:00100000:1.0:1787826953.277616:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 200 00000100:00100000:1.0:1787826953.277625:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2390:x1874672134233088:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826953.293589:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2390:x1874672134233088:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15957us (16246us total) trans 30064771205 rc 0/0 00000100:00100000:1.0:1787826953.293612:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 200 00002000:00100000:1.0:1787826953.293624:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (704643072->708837375) req@ffff8d5343b0e940 x1874672134233088/t30064771205(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/448 e 0 to 0 dl 1787826964 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826953.293633:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0e940 with x1874672134233088 ext(704643072->708837375) 00002000:00010000:1.0:1787826953.293638:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0e940 00010000:00010000:2.0:1787826953.425538:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826953.498564:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826953.498792:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233216 00000100:00100000:1.0:1787826953.498803:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233216 00002000:00100000:1.0:1787826953.498857:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (708837376->713031679) req@ffff8d5349264b40 x1874672134233216/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/0 e 0 to 0 dl 1787826964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826953.498868:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349264b40 with x1874672134233216 ext(708837376->713031679) 00002000:00010000:1.0:1787826953.498873:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349264b40 00000100:00100000:1.0:1787826953.498917:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 201 00000100:00100000:1.0:1787826953.498927:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134233216:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826953.517832:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134233216:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18892us (19263us total) trans 30064771206 rc 0/0 00000100:00100000:3.0:1787826953.517843:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 201 00002000:00100000:3.0:1787826953.517854:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (708837376->713031679) req@ffff8d5349264b40 x1874672134233216/t30064771206(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/448 e 0 to 0 dl 1787826964 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826953.517862:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349264b40 with x1874672134233216 ext(708837376->713031679) 00002000:00010000:3.0:1787826953.517867:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349264b40 00000100:00100000:1.0:1787826953.762287:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826953.762359:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233344 00000100:00100000:0.0:1787826953.762368:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233344 00002000:00100000:0.0:1787826953.762412:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (713031680->717225983) req@ffff8d53492c52c0 x1874672134233344/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/0 e 0 to 0 dl 1787826964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826953.762422:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c52c0 with x1874672134233344 ext(713031680->717225983) 00002000:00010000:0.0:1787826953.762427:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c52c0 00000100:00100000:0.0:1787826953.762463:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 202 00000100:00100000:0.0:1787826953.762472:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134233344:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826953.776944:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134233344:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14457us (14649us total) trans 30064771207 rc 0/0 00000100:00100000:1.0:1787826953.776960:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 202 00002000:00100000:1.0:1787826953.776973:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (713031680->717225983) req@ffff8d53492c52c0 x1874672134233344/t30064771207(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:554/0 lens 488/448 e 0 to 0 dl 1787826964 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826953.776984:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c52c0 with x1874672134233344 ext(713031680->717225983) 00002000:00010000:1.0:1787826953.776990:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c52c0 00000100:00100000:3.0:1787826953.809748:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826953.809760:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826953.809771:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143749120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826953.809775:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143749248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826953.809851:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826953.809900:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826953.810031:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143749248 00000100:00100000:2.0:1787826953.810031:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143749120 00000100:00100000:1.0:1787826953.810039:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143749248 00000100:00100000:2.0:1787826953.810046:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143749120 00000100:00100000:1.0:1787826953.810155:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1787826953.810158:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826953.810167:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143749248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826953.810186:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 770048 granted 565847488 pending 80158720 free 3219570688 avail 2988048384 00000100:00100000:1.0:1787826953.810272:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143749248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826953.810281:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787826953.810299:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787826953.810308:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143749120:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826953.810312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143749248:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826953.810322:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 770048 granted 565847488 pending 80158720 free 3219570688 avail 2988048384 00000100:00100000:1.0:1787826953.810364:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143749120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826953.810371:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787826953.810398:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143749120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826954.000087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826954.000192:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233472 00000100:00100000:3.0:1787826954.000262:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233472 00002000:00100000:3.0:1787826954.000313:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (717225984->721420287) req@ffff8d5349266940 x1874672134233472/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/0 e 0 to 0 dl 1787826965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826954.000325:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349266940 with x1874672134233472 ext(717225984->721420287) 00002000:00010000:3.0:1787826954.000330:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349266940 00000100:00100000:3.0:1787826954.000366:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 203 00000100:00100000:3.0:1787826954.000384:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349266940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134233472:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826954.018996:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349266940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134233472:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18603us (18908us total) trans 30064771208 rc 0/0 00000100:00100000:3.0:1787826954.019011:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 203 00002000:00100000:3.0:1787826954.019024:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (717225984->721420287) req@ffff8d5349266940 x1874672134233472/t30064771208(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/448 e 0 to 0 dl 1787826965 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826954.019036:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5349266940 with x1874672134233472 ext(717225984->721420287) 00002000:00010000:3.0:1787826954.019042:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5349266940 00000100:00100000:0.0:1787826954.246999:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826954.247098:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233600 00000100:00100000:3.0:1787826954.247108:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233600 00002000:00100000:3.0:1787826954.247155:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (721420288->725614591) req@ffff8d54533e4f00 x1874672134233600/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/0 e 0 to 0 dl 1787826965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826954.247167:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d54533e4f00 with x1874672134233600 ext(721420288->725614591) 00002000:00010000:3.0:1787826954.247173:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d54533e4f00 00000100:00100000:3.0:1787826954.247211:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 204 00000100:00100000:3.0:1787826954.247246:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134233600:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826954.262042:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134233600:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14787us (15041us total) trans 30064771209 rc 0/0 00000100:00100000:3.0:1787826954.262067:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 204 00002000:00100000:3.0:1787826954.262079:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (721420288->725614591) req@ffff8d54533e4f00 x1874672134233600/t30064771209(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/448 e 0 to 0 dl 1787826965 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826954.262090:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d54533e4f00 with x1874672134233600 ext(721420288->725614591) 00002000:00010000:3.0:1787826954.262096:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d54533e4f00 00000001:00080000:1.0:1787826954.262880:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771209 is committed 00010000:00010000:2.0:1787826954.449396:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826954.501709:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826954.501777:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233728 00000100:00100000:0.0:1787826954.501786:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233728 00002000:00100000:0.0:1787826954.501833:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (725614592->729808895) req@ffff8d53477df0c0 x1874672134233728/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/0 e 0 to 0 dl 1787826965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826954.501844:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df0c0 with x1874672134233728 ext(725614592->729808895) 00002000:00010000:0.0:1787826954.501863:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df0c0 00000100:00100000:0.0:1787826954.501893:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 205 00000100:00100000:0.0:1787826954.501902:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134233728:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826954.523710:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134233728:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21797us (21999us total) trans 30064771210 rc 0/0 00000100:00100000:1.0:1787826954.523789:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 205 00002000:00100000:1.0:1787826954.523800:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (725614592->729808895) req@ffff8d53477df0c0 x1874672134233728/t30064771210(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/448 e 0 to 0 dl 1787826965 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826954.523808:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df0c0 with x1874672134233728 ext(725614592->729808895) 00002000:00010000:1.0:1787826954.523813:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df0c0 00000100:00100000:0.0:1787826954.747876:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826954.747938:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233856 00000100:00100000:2.0:1787826954.747947:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233856 00002000:00100000:2.0:1787826954.747991:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (729808896->734003199) req@ffff8d5343b0fc00 x1874672134233856/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/0 e 0 to 0 dl 1787826965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826954.748002:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0fc00 with x1874672134233856 ext(729808896->734003199) 00002000:00010000:2.0:1787826954.748007:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0fc00 00000100:00100000:2.0:1787826954.748035:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 206 00000100:00100000:2.0:1787826954.748045:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134233856:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826954.762972:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134233856:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14917us (15094us total) trans 30064771211 rc 0/0 00000100:00100000:0.0:1787826954.762988:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 206 00002000:00100000:0.0:1787826954.763002:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (729808896->734003199) req@ffff8d5343b0fc00 x1874672134233856/t30064771211(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/448 e 0 to 0 dl 1787826965 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826954.763011:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0fc00 with x1874672134233856 ext(729808896->734003199) 00002000:00010000:0.0:1787826954.763016:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0fc00 00000100:00100000:2.0:1787826954.980488:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826954.980607:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134233984 00000100:00100000:1.0:1787826954.980617:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134233984 00002000:00100000:1.0:1787826954.980667:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (734003200->738197503) req@ffff8d53477df480 x1874672134233984/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/0 e 0 to 0 dl 1787826965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826954.980678:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df480 with x1874672134233984 ext(734003200->738197503) 00002000:00010000:1.0:1787826954.980684:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df480 00000100:00100000:1.0:1787826954.980715:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 207 00000100:00100000:1.0:1787826954.980724:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134233984:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826955.000817:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134233984:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20083us (20327us total) trans 30064771212 rc 0/0 00000100:00100000:1.0:1787826955.000832:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 207 00002000:00100000:1.0:1787826955.000846:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (734003200->738197503) req@ffff8d53477df480 x1874672134233984/t30064771212(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:555/0 lens 488/448 e 0 to 0 dl 1787826965 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826955.000856:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df480 with x1874672134233984 ext(734003200->738197503) 00002000:00010000:1.0:1787826955.000862:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df480 00000100:00100000:0.0:1787826955.234463:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826955.234532:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134234112 00000100:00100000:1.0:1787826955.234540:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134234112 00000100:00080000:0.0:1787826955.234597:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787826955.234603:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (738197504->742391807) req@ffff8d534479d680 x1874672134234112/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/0 e 0 to 0 dl 1787826966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826955.234620:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479d680 with x1874672134234112 ext(738197504->742391807) 00002000:00010000:1.0:1787826955.234625:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479d680 00000100:00100000:1.0:1787826955.234649:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 208 00000100:00100000:1.0:1787826955.234668:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134234112:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826955.250072:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134234112:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15402us (15609us total) trans 30064771213 rc 0/0 00000100:00100000:2.0:1787826955.250088:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 208 00002000:00100000:2.0:1787826955.250112:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (738197504->742391807) req@ffff8d534479d680 x1874672134234112/t30064771213(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/448 e 0 to 0 dl 1787826966 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826955.250124:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534479d680 with x1874672134234112 ext(738197504->742391807) 00002000:00010000:2.0:1787826955.250130:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534479d680 00010000:00010000:2.0:1787826955.473399:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826955.480865:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826955.480921:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134234240 00000100:00100000:3.0:1787826955.480930:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134234240 00002000:00100000:3.0:1787826955.480976:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (742391808->746586111) req@ffff8d547f9be580 x1874672134234240/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/0 e 0 to 0 dl 1787826966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826955.480988:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9be580 with x1874672134234240 ext(742391808->746586111) 00002000:00010000:3.0:1787826955.480993:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9be580 00000100:00100000:3.0:1787826955.481023:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 209 00000100:00100000:3.0:1787826955.481033:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134234240:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826955.496832:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134234240:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15790us (15965us total) trans 30064771214 rc 0/0 00000100:00100000:2.0:1787826955.496848:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 209 00002000:00100000:2.0:1787826955.496860:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (742391808->746586111) req@ffff8d547f9be580 x1874672134234240/t30064771214(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/448 e 0 to 0 dl 1787826966 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826955.496871:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9be580 with x1874672134234240 ext(742391808->746586111) 00002000:00010000:2.0:1787826955.496876:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9be580 00000100:00100000:0.0:1787826955.665129:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826955.665165:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826955.665194:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134234368 00000100:00100000:0.0:1787826955.665199:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826955.665204:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134234368 00000100:00100000:1.0:1787826955.665251:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134234496 00000100:00100000:1.0:1787826955.665256:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134234496 00000100:00100000:0.0:1787826955.665272:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826955.665299:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 505 00000100:00100000:1.0:1787826955.665307:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134234624 00000100:00080000:0.0:1787826955.665312:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826955.665314:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134234624 00000100:00100000:2.0:1787826955.665314:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134234368:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826955.665329:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 328 00000100:00100000:0.0:1787826955.665340:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134234496:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826955.665343:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134234752 00000100:00100000:1.0:1787826955.665348:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 329 00000100:00100000:3.0:1787826955.665351:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134234752 00000100:00100000:1.0:1787826955.665358:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134234624:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826955.665380:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134234368:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826955.665382:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134234496:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826955.665387:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134234624:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 31us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826955.665392:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 505 00000100:00100000:0.0:1787826955.665394:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 328 00000100:00100000:3.0:1787826955.665401:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 194 00000100:00100000:1.0:1787826955.665404:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 329 00000100:00100000:3.0:1787826955.665417:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134234752:12345-192.168.203.6@tcp:9:kworker.0 00000100:00080000:0.0:1787826955.665432:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1787826955.665439:0:19009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79542c7 00000100:00080000:0.0:1787826955.665449:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826955.665458:0:19009:0:(import.c:65:import_set_state_nolock()) ffff8d53494c5800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826955.665490:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787826955.665516:0:19009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787826955.665700:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+2:2389:x1874672134234752:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 288us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826955.665709:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 194 00000100:00100000:0.0:1787826955.727422:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826955.727489:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134234880 00000100:00100000:1.0:1787826955.727499:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134234880 00002000:00100000:1.0:1787826955.727543:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (746586112->750780415) req@ffff8d547f9bf840 x1874672134234880/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/0 e 0 to 0 dl 1787826966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826955.727554:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bf840 with x1874672134234880 ext(746586112->750780415) 00002000:00010000:1.0:1787826955.727560:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bf840 00000100:00100000:1.0:1787826955.727599:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 210 00000100:00100000:1.0:1787826955.727608:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134234880:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826955.748184:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134234880:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20566us (20757us total) trans 30064771215 rc 0/0 00000100:00100000:2.0:1787826955.748202:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 210 00002000:00100000:2.0:1787826955.748348:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (746586112->750780415) req@ffff8d547f9bf840 x1874672134234880/t30064771215(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/448 e 0 to 0 dl 1787826966 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826955.748377:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bf840 with x1874672134234880 ext(746586112->750780415) 00002000:00010000:2.0:1787826955.748389:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bf840 00000100:00100000:1.0:1787826955.976900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826955.976955:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235008 00000100:00100000:3.0:1787826955.976986:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235008 00002000:00100000:3.0:1787826955.977050:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (750780416->754974719) req@ffff8d53492c7c00 x1874672134235008/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/0 e 0 to 0 dl 1787826966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826955.977060:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7c00 with x1874672134235008 ext(750780416->754974719) 00002000:00010000:3.0:1787826955.977065:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7c00 00000100:00100000:3.0:1787826955.977097:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 211 00000100:00100000:3.0:1787826955.977105:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134235008:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826955.991376:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134235008:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14263us (14482us total) trans 30064771216 rc 0/0 00000100:00100000:3.0:1787826955.991386:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 211 00002000:00100000:3.0:1787826955.991401:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (750780416->754974719) req@ffff8d53492c7c00 x1874672134235008/t30064771216(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:556/0 lens 488/448 e 0 to 0 dl 1787826966 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826955.991412:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7c00 with x1874672134235008 ext(750780416->754974719) 00002000:00010000:3.0:1787826955.991419:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7c00 00000100:00100000:0.0:1787826956.223349:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826956.223457:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235136 00000100:00100000:3.0:1787826956.223466:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235136 00002000:00100000:3.0:1787826956.223521:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (754974720->759169023) req@ffff8d547f9bf480 x1874672134235136/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/0 e 0 to 0 dl 1787826967 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826956.223539:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bf480 with x1874672134235136 ext(754974720->759169023) 00002000:00010000:3.0:1787826956.223544:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bf480 00000100:00100000:3.0:1787826956.223587:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 212 00000100:00100000:3.0:1787826956.223597:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134235136:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826956.238690:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134235136:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15083us (15339us total) trans 30064771217 rc 0/0 00000100:00100000:3.0:1787826956.238717:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 212 00002000:00100000:3.0:1787826956.238731:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (754974720->759169023) req@ffff8d547f9bf480 x1874672134235136/t30064771217(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/448 e 0 to 0 dl 1787826967 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826956.238742:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9bf480 with x1874672134235136 ext(754974720->759169023) 00002000:00010000:3.0:1787826956.238748:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9bf480 00000100:00100000:1.0:1787826956.369630:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826956.369655:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143749376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826956.369695:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826956.369717:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143749504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826956.369742:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826956.369757:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826956.369788:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143749376 00000100:00100000:0.0:1787826956.369796:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143749376 00000100:00100000:0.0:1787826956.369852:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787826956.369866:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143749376:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787826956.369892:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787826956.369897:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826956.369921:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143749504 00000100:00100000:1.0:1787826956.369924:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826956.369927:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143749504 00000100:00100000:1.0:1787826956.369937:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143749632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826956.369951:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143749376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826956.369960:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787826956.369966:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787826956.369973:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826956.369980:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143749504:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826956.369997:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143749632 00000100:00100000:2.0:1787826956.370002:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143749632 00000004:00000024:3.0:1787826956.370006:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00010000:00080000:0.0:1787826956.370019:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5345ae0000 x1874672143749376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826956.370033:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143749376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826956.370060:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787826956.370064:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143749504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826956.370073:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143749632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826956.370074:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1787826956.370076:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826956.370101:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143749504:0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1787826956.370101:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826956.370143:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143749632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826956.370151:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:1.0:1787826956.370160:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e0b40 x1874672143749632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826956.370175:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143749632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826956.481081:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826956.481150:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235264 00000100:00100000:1.0:1787826956.481160:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235264 00002000:00100000:1.0:1787826956.481208:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (759169024->763363327) req@ffff8d5345ae0000 x1874672134235264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/0 e 0 to 0 dl 1787826967 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826956.481252:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae0000 with x1874672134235264 ext(759169024->763363327) 00002000:00010000:1.0:1787826956.481259:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae0000 00000100:00100000:1.0:1787826956.481300:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 213 00000100:00100000:1.0:1787826956.481310:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2391:x1874672134235264:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826956.496457:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2391:x1874672134235264:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15137us (15375us total) trans 30064771218 rc 0/0 00000100:00100000:1.0:1787826956.496472:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 213 00002000:00100000:1.0:1787826956.496485:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (759169024->763363327) req@ffff8d5345ae0000 x1874672134235264/t30064771218(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/448 e 0 to 0 dl 1787826967 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826956.496497:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae0000 with x1874672134235264 ext(759169024->763363327) 00002000:00010000:1.0:1787826956.496515:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae0000 00010000:00010000:2.0:1787826956.497561:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826956.734535:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826956.734608:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235392 00000100:00100000:0.0:1787826956.734625:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235392 00002000:00100000:0.0:1787826956.734686:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (763363328->767557631) req@ffff8d53477dcb40 x1874672134235392/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/0 e 0 to 0 dl 1787826967 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826956.734706:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dcb40 with x1874672134235392 ext(763363328->767557631) 00002000:00010000:0.0:1787826956.734713:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dcb40 00000100:00100000:0.0:1787826956.734795:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 214 00000100:00100000:0.0:1787826956.734806:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134235392:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826956.750025:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134235392:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15211us (15492us total) trans 30064771219 rc 0/0 00000100:00100000:1.0:1787826956.750040:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 214 00002000:00100000:1.0:1787826956.750054:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (763363328->767557631) req@ffff8d53477dcb40 x1874672134235392/t30064771219(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/448 e 0 to 0 dl 1787826967 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826956.750064:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dcb40 with x1874672134235392 ext(763363328->767557631) 00002000:00010000:1.0:1787826956.750070:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dcb40 00000100:00100000:0.0:1787826956.881524:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143749760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826956.881563:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143750016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826956.881601:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143750144:0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.881604:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143749888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826956.881673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826956.881681:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826956.881688:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826956.881742:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826956.881762:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547facbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143750272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826956.881770:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143750528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826956.881775:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547faca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143750656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.881804:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547facb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143750400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826956.881816:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826956.881824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826956.881839:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750016 00000100:00100000:2.0:1787826956.881848:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750016 00000100:00100000:3.0:1787826956.881884:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826956.881887:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143750784:0@lo:400:kworker.0 00000100:00100000:1.0:1787826956.881913:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143749888 00000100:00100000:1.0:1787826956.881919:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143749888 00000100:00100000:3.0:1787826956.881934:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143750912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826956.881936:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826956.881940:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750528 00000100:00100000:2.0:1787826956.881949:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750528 00000100:00100000:1.0:1787826956.881953:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750400 00000100:00100000:1.0:1787826956.881960:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750400 00000100:00100000:0.0:1787826956.881984:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143749760 00000100:00100000:0.0:1787826956.881990:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143749760 00000100:00100000:1.0:1787826956.882003:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750784 00000100:00100000:1.0:1787826956.882009:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750784 00000100:00100000:2.0:1787826956.882021:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787826956.882026:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826956.882052:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143750016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826956.882053:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1787826956.882054:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750912 00000100:00100000:1.0:1787826956.882061:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750912 00000100:00100000:0.0:1787826956.882068:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143749760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826956.882110:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787826956.882115:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750144 00000100:00100000:1.0:1787826956.882123:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143749888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.882127:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750144 00000100:00100000:2.0:1787826956.882144:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143750016:12345-0@lo:400:kworker.0 Request processed in 97us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826956.882151:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143749760:12345-0@lo:400:kworker.0 Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826956.882171:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787826956.882172:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1787826956.882207:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787826956.882238:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143749888:12345-0@lo:400:kworker.0 Request processed in 93us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826956.882244:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787826956.882254:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787826956.882260:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826956.882283:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00080000:0.0:1787826956.882295:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826956.882303:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826956.882310:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143750528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.882310:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143750144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826956.882322:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143750400:12345-0@lo:400:kworker.0 Request processed in 66us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826956.882332:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787826956.882355:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787826956.882366:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143750784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826956.882381:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143750528:12345-0@lo:400:kworker.0 Request processed in 86us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826956.882394:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787826956.882398:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143749760:0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.882410:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143750144:12345-0@lo:400:kworker.0 Request processed in 112us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826956.882418:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787826956.882436:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143750912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826956.882436:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143750784:12345-0@lo:400:kworker.0 Request processed in 66us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826956.882446:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143750784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826956.882467:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787826956.882473:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787826956.882491:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826956.882510:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143750912:12345-0@lo:400:kworker.0 Request processed in 80us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826956.882523:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787826956.882546:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750272 00000100:00100000:3.0:1787826956.882552:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750272 00000100:00100000:0.0:1787826956.882555:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143750144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826956.882562:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143750016:0@lo:400:kworker.0 00010000:00080000:2.0:1787826956.882603:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fac8b40 x1874672143750528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826956.882611:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143750656 00000100:00100000:0.0:1787826956.882618:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143750656 00000100:00100000:1.0:1787826956.882618:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143749888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826956.882619:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143750528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.882632:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787826956.882651:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143750272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826956.882652:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547facb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143750400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826956.882668:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787826956.882681:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143750656:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826956.882686:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fac9e00 x1874672143750912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826956.882689:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826956.882702:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143750912:0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.882745:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143750272:12345-0@lo:400:kworker.0 Request processed in 98us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826956.882756:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547facbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143750272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826956.882766:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787826956.882768:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143750656:12345-0@lo:400:kworker.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826956.882775:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547faca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143750656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826956.882785:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787826956.972695:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826956.972803:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235520 00000100:00100000:1.0:1787826956.972813:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235520 00002000:00100000:1.0:1787826956.972872:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (767557632->771751935) req@ffff8d547faca940 x1874672134235520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/0 e 0 to 0 dl 1787826967 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826956.972882:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547faca940 with x1874672134235520 ext(767557632->771751935) 00002000:00010000:1.0:1787826956.972887:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547faca940 00000100:00100000:1.0:1787826956.972920:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 215 00000100:00100000:1.0:1787826956.972931:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547faca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134235520:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826956.991818:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547faca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134235520:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18880us (19123us total) trans 30064771220 rc 0/0 00000100:00100000:1.0:1787826956.991841:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 215 00002000:00100000:1.0:1787826956.991858:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (767557632->771751935) req@ffff8d547faca940 x1874672134235520/t30064771220(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:557/0 lens 488/448 e 0 to 0 dl 1787826967 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826956.991869:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547faca940 with x1874672134235520 ext(767557632->771751935) 00002000:00010000:1.0:1787826956.991875:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547faca940 00000100:00100000:3.0:1787826957.226746:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826957.226846:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235648 00000100:00100000:2.0:1787826957.226859:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235648 00002000:00100000:2.0:1787826957.226933:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (771751936->775946239) req@ffff8d547f9ded00 x1874672134235648/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:558/0 lens 488/0 e 0 to 0 dl 1787826968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:0.0:1787826957.226941:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826957.226948:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9ded00 with x1874672134235648 ext(771751936->775946239) 00002000:00010000:2.0:1787826957.226954:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9ded00 00000100:00100000:2.0:1787826957.227006:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 216 00000100:00100000:2.0:1787826957.227016:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134235648:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826957.250055:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2391:x1874672134235648:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23023us (23306us total) trans 30064771221 rc 0/0 00000100:00100000:2.0:1787826957.250073:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 216 00002000:00100000:2.0:1787826957.250089:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (771751936->775946239) req@ffff8d547f9ded00 x1874672134235648/t30064771221(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:558/0 lens 488/448 e 0 to 0 dl 1787826968 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826957.250100:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9ded00 with x1874672134235648 ext(771751936->775946239) 00002000:00010000:2.0:1787826957.250108:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9ded00 00000100:00100000:1.0:1787826957.393462:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547facbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143751040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826957.393536:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826957.393653:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751040 00000100:00100000:0.0:1787826957.393661:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751040 00000100:00100000:0.0:1787826957.393724:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787826957.393734:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143751040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826957.393777:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826957.394085:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143751040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 352us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826957.394093:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787826957.394093:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547facbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143751040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826957.488895:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826957.489042:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235776 00000100:00100000:2.0:1787826957.489052:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235776 00002000:00100000:2.0:1787826957.489099:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (775946240->780140543) req@ffff8d547fac9e00 x1874672134235776/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:558/0 lens 488/0 e 0 to 0 dl 1787826968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826957.489111:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac9e00 with x1874672134235776 ext(775946240->780140543) 00002000:00010000:2.0:1787826957.489117:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac9e00 00000100:00100000:2.0:1787826957.489157:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 217 00000100:00100000:2.0:1787826957.489167:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134235776:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826957.519496:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134235776:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 30320us (30600us total) trans 30064771222 rc 0/0 00000100:00100000:1.0:1787826957.519512:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 217 00002000:00100000:1.0:1787826957.519526:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (775946240->780140543) req@ffff8d547fac9e00 x1874672134235776/t30064771222(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:558/0 lens 488/448 e 0 to 0 dl 1787826968 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826957.519536:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac9e00 with x1874672134235776 ext(775946240->780140543) 00002000:00010000:1.0:1787826957.519543:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac9e00 00010000:00010000:2.0:1787826957.521411:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826957.768914:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826957.768990:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134235904 00000100:00100000:2.0:1787826957.768999:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134235904 00002000:00100000:2.0:1787826957.769044:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (780140544->784334847) req@ffff8d547facb0c0 x1874672134235904/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:558/0 lens 488/0 e 0 to 0 dl 1787826968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826957.769056:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facb0c0 with x1874672134235904 ext(780140544->784334847) 00002000:00010000:2.0:1787826957.769061:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facb0c0 00000100:00100000:2.0:1787826957.769102:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 218 00000100:00100000:2.0:1787826957.769109:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134235904:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826957.788793:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134235904:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19665us (19867us total) trans 30064771223 rc 0/0 00000100:00100000:1.0:1787826957.788808:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 218 00002000:00100000:1.0:1787826957.788822:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (780140544->784334847) req@ffff8d547facb0c0 x1874672134235904/t30064771223(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:558/0 lens 488/448 e 0 to 0 dl 1787826968 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826957.788829:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facb0c0 with x1874672134235904 ext(780140544->784334847) 00002000:00010000:1.0:1787826957.788834:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facb0c0 00000100:00100000:0.0:1787826958.011672:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826958.011768:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236032 00000100:00100000:3.0:1787826958.011777:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236032 00002000:00100000:3.0:1787826958.011820:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (784334848->788529151) req@ffff8d547fac8b40 x1874672134236032/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/0 e 0 to 0 dl 1787826969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826958.011828:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac8b40 with x1874672134236032 ext(784334848->788529151) 00002000:00010000:3.0:1787826958.011832:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac8b40 00000100:00100000:3.0:1787826958.011854:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 219 00000100:00100000:3.0:1787826958.011860:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134236032:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826958.026542:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134236032:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14670us (14868us total) trans 30064771224 rc 0/0 00000100:00100000:3.0:1787826958.026555:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 219 00002000:00100000:3.0:1787826958.026579:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (784334848->788529151) req@ffff8d547fac8b40 x1874672134236032/t30064771224(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/448 e 0 to 0 dl 1787826969 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826958.026589:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac8b40 with x1874672134236032 ext(784334848->788529151) 00002000:00010000:3.0:1787826958.026595:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac8b40 00000100:00100000:0.0:1787826958.264703:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826958.264756:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236160 00000100:00100000:3.0:1787826958.264765:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236160 00002000:00100000:3.0:1787826958.264814:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (788529152->792723455) req@ffff8d547facbc00 x1874672134236160/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/0 e 0 to 0 dl 1787826969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826958.264825:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facbc00 with x1874672134236160 ext(788529152->792723455) 00002000:00010000:3.0:1787826958.264829:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facbc00 00000100:00100000:3.0:1787826958.264861:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 220 00000100:00100000:3.0:1787826958.264871:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2390:x1874672134236160:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826958.279960:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2390:x1874672134236160:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15081us (15259us total) trans 30064771225 rc 0/0 00000100:00100000:3.0:1787826958.279974:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 220 00002000:00100000:3.0:1787826958.279986:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (788529152->792723455) req@ffff8d547facbc00 x1874672134236160/t30064771225(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/448 e 0 to 0 dl 1787826969 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826958.279994:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facbc00 with x1874672134236160 ext(788529152->792723455) 00002000:00010000:3.0:1787826958.280000:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facbc00 00000100:00100000:2.0:1787826958.509011:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826958.509070:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236288 00000100:00100000:1.0:1787826958.509077:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236288 00002000:00100000:1.0:1787826958.509134:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (792723456->796917759) req@ffff8d5342440000 x1874672134236288/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/0 e 0 to 0 dl 1787826969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826958.509144:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342440000 with x1874672134236288 ext(792723456->796917759) 00002000:00010000:1.0:1787826958.509149:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342440000 00000100:00100000:1.0:1787826958.509177:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 221 00000100:00100000:1.0:1787826958.509186:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2391:x1874672134236288:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826958.526478:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2391:x1874672134236288:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17280us (17462us total) trans 30064771226 rc 0/0 00000100:00100000:1.0:1787826958.526494:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 221 00002000:00100000:1.0:1787826958.526510:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (792723456->796917759) req@ffff8d5342440000 x1874672134236288/t30064771226(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/448 e 0 to 0 dl 1787826969 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826958.526522:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342440000 with x1874672134236288 ext(792723456->796917759) 00002000:00010000:1.0:1787826958.526528:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342440000 00010000:00010000:2.0:1787826958.545478:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826958.764052:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826958.764120:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236416 00000100:00100000:1.0:1787826958.764127:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236416 00002000:00100000:1.0:1787826958.764166:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (796917760->801112063) req@ffff8d53492c5a40 x1874672134236416/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/0 e 0 to 0 dl 1787826969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826958.764174:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c5a40 with x1874672134236416 ext(796917760->801112063) 00002000:00010000:1.0:1787826958.764178:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c5a40 00000100:00100000:1.0:1787826958.764252:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 222 00000100:00100000:1.0:1787826958.764262:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134236416:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826958.781834:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134236416:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17557us (17774us total) trans 30064771227 rc 0/0 00000100:00100000:0.0:1787826958.781852:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 222 00002000:00100000:0.0:1787826958.781870:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (796917760->801112063) req@ffff8d53492c5a40 x1874672134236416/t30064771227(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:559/0 lens 488/448 e 0 to 0 dl 1787826969 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826958.781881:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c5a40 with x1874672134236416 ext(796917760->801112063) 00002000:00010000:0.0:1787826958.781889:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c5a40 00000100:00100000:2.0:1787826958.929481:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143751296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826958.929481:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143751168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826958.929582:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826958.929727:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826958.929781:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751296 00000100:00100000:0.0:1787826958.929782:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751168 00000100:00100000:2.0:1787826958.929790:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751296 00000100:00100000:0.0:1787826958.929791:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751168 00000100:00080000:3.0:1787826958.929856:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826958.929881:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787826958.929898:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143751296:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826958.929909:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787826958.929923:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143751168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826958.929925:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 729088 granted 561587648 pending 75939840 free 3152461824 avail 2920939520 00002000:00000024:0.0:1787826958.929937:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 729088 granted 561587648 pending 75939840 free 3152461824 avail 2920939520 00000100:00100000:2.0:1787826958.929984:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143751296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826958.929993:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787826958.930013:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143751168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826958.930019:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787826958.930062:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143751296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826958.930162:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143751168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826959.022145:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826959.022260:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236544 00000100:00100000:0.0:1787826959.022270:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236544 00000100:00080000:3.0:1787826959.022334:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787826959.022336:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (801112064->805306367) req@ffff8d546e108b40 x1874672134236544/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/0 e 0 to 0 dl 1787826970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826959.022365:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e108b40 with x1874672134236544 ext(801112064->805306367) 00002000:00010000:0.0:1787826959.022372:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e108b40 00000100:00100000:0.0:1787826959.022400:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 223 00000100:00100000:0.0:1787826959.022410:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134236544:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826959.041790:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134236544:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19372us (19645us total) trans 30064771228 rc 0/0 00000100:00100000:0.0:1787826959.041804:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 223 00002000:00100000:0.0:1787826959.041814:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (801112064->805306367) req@ffff8d546e108b40 x1874672134236544/t30064771228(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/448 e 0 to 0 dl 1787826970 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826959.041822:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e108b40 with x1874672134236544 ext(801112064->805306367) 00002000:00010000:0.0:1787826959.041827:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e108b40 00000100:00100000:1.0:1787826959.283579:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826959.283653:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236672 00000100:00100000:2.0:1787826959.283664:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236672 00002000:00100000:2.0:1787826959.283707:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (805306368->809500671) req@ffff8d546e10a1c0 x1874672134236672/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/0 e 0 to 0 dl 1787826970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826959.283716:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10a1c0 with x1874672134236672 ext(805306368->809500671) 00002000:00010000:2.0:1787826959.283720:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10a1c0 00000100:00100000:2.0:1787826959.283752:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 224 00000100:00100000:2.0:1787826959.283763:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134236672:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826959.305080:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134236672:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21310us (21518us total) trans 30064771229 rc 0/0 00000100:00100000:2.0:1787826959.305094:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 224 00002000:00100000:2.0:1787826959.305118:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (805306368->809500671) req@ffff8d546e10a1c0 x1874672134236672/t30064771229(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/448 e 0 to 0 dl 1787826970 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826959.305129:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e10a1c0 with x1874672134236672 ext(805306368->809500671) 00002000:00010000:2.0:1787826959.305135:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e10a1c0 00000100:00100000:2.0:1787826959.543178:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826959.543434:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236800 00000100:00100000:1.0:1787826959.543443:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236800 00002000:00100000:1.0:1787826959.543484:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (809500672->813694975) req@ffff8d5342440f00 x1874672134236800/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/0 e 0 to 0 dl 1787826970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826959.543494:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342440f00 with x1874672134236800 ext(809500672->813694975) 00002000:00010000:1.0:1787826959.543499:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342440f00 00000100:00100000:1.0:1787826959.543528:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 225 00000100:00100000:1.0:1787826959.543537:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134236800:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826959.569539:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134236800:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 25990us (26357us total) trans 30064771230 rc 0/0 00010000:00010000:0.0:1787826959.569545:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826959.569566:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 225 00002000:00100000:1.0:1787826959.569580:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (809500672->813694975) req@ffff8d5342440f00 x1874672134236800/t30064771230(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/448 e 0 to 0 dl 1787826970 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826959.569597:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5342440f00 with x1874672134236800 ext(809500672->813694975) 00002000:00010000:1.0:1787826959.569604:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5342440f00 00000001:00080000:1.0:1787826959.570243:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771230 is committed 00000100:00100000:2.0:1787826959.794571:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826959.794656:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134236928 00000100:00100000:1.0:1787826959.794669:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134236928 00002000:00100000:1.0:1787826959.794735:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (813694976->817889279) req@ffff8d546e0703c0 x1874672134236928/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/0 e 0 to 0 dl 1787826970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826959.794745:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0703c0 with x1874672134236928 ext(813694976->817889279) 00002000:00010000:1.0:1787826959.794751:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0703c0 00000100:00100000:1.0:1787826959.794805:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 226 00000100:00100000:1.0:1787826959.794818:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134236928:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826959.815501:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134236928:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20675us (20944us total) trans 30064771231 rc 0/0 00000100:00100000:1.0:1787826959.815516:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 226 00002000:00100000:1.0:1787826959.815532:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (813694976->817889279) req@ffff8d546e0703c0 x1874672134236928/t30064771231(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:560/0 lens 488/448 e 0 to 0 dl 1787826970 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826959.815543:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0703c0 with x1874672134236928 ext(813694976->817889279) 00002000:00010000:1.0:1787826959.815561:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0703c0 00000100:00100000:2.0:1787826960.053189:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826960.053271:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237056 00000100:00100000:3.0:1787826960.053282:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237056 00002000:00100000:3.0:1787826960.053328:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (817889280->822083583) req@ffff8d546e073840 x1874672134237056/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/0 e 0 to 0 dl 1787826971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826960.053367:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e073840 with x1874672134237056 ext(817889280->822083583) 00002000:00010000:3.0:1787826960.053373:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e073840 00000100:00100000:3.0:1787826960.053411:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 227 00000100:00100000:3.0:1787826960.053421:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e073840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134237056:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826960.072334:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e073840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134237056:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18898us (19136us total) trans 30064771232 rc 0/0 00000100:00100000:3.0:1787826960.072353:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 227 00002000:00100000:3.0:1787826960.072372:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (817889280->822083583) req@ffff8d546e073840 x1874672134237056/t30064771232(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/448 e 0 to 0 dl 1787826971 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826960.072385:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e073840 with x1874672134237056 ext(817889280->822083583) 00002000:00010000:3.0:1787826960.072393:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e073840 00000100:00100000:2.0:1787826960.312270:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826960.312407:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237184 00000100:00100000:3.0:1787826960.312417:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237184 00002000:00100000:3.0:1787826960.312462:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (822083584->826277887) req@ffff8d546e0721c0 x1874672134237184/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/0 e 0 to 0 dl 1787826971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826960.312470:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0721c0 with x1874672134237184 ext(822083584->826277887) 00002000:00010000:3.0:1787826960.312475:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0721c0 00000100:00100000:3.0:1787826960.312500:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 228 00000100:00100000:3.0:1787826960.312513:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134237184:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826960.335394:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134237184:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22872us (23123us total) trans 30064771233 rc 0/0 00000100:00100000:3.0:1787826960.335410:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 228 00002000:00100000:3.0:1787826960.335433:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (822083584->826277887) req@ffff8d546e0721c0 x1874672134237184/t30064771233(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/448 e 0 to 0 dl 1787826971 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826960.335444:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0721c0 with x1874672134237184 ext(822083584->826277887) 00002000:00010000:3.0:1787826960.335451:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0721c0 00000100:00100000:2.0:1787826960.571980:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826960.572035:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237312 00000100:00100000:0.0:1787826960.572048:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237312 00002000:00100000:0.0:1787826960.572094:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (826277888->830472191) req@ffff8d546e0712c0 x1874672134237312/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/0 e 0 to 0 dl 1787826971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826960.572105:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0712c0 with x1874672134237312 ext(826277888->830472191) 00002000:00010000:0.0:1787826960.572110:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0712c0 00000100:00100000:0.0:1787826960.572149:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 229 00000100:00100000:0.0:1787826960.572164:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134237312:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826960.590580:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134237312:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18410us (18600us total) trans 30064771234 rc 0/0 00000100:00100000:0.0:1787826960.590590:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 229 00002000:00100000:0.0:1787826960.590602:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (826277888->830472191) req@ffff8d546e0712c0 x1874672134237312/t30064771234(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/448 e 0 to 0 dl 1787826971 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826960.590612:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e0712c0 with x1874672134237312 ext(826277888->830472191) 00002000:00010000:0.0:1787826960.590617:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e0712c0 00010000:00010000:2.0:1787826960.593530:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826960.785401:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826960.785478:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826960.785619:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237440 00000100:00100000:3.0:1787826960.785637:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237440 00000100:00100000:1.0:1787826960.785695:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826960.785701:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 507 00000100:00100000:3.0:1787826960.785713:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134237440:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826960.785789:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134237440:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826960.785797:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 507 00000100:00100000:2.0:1787826960.785883:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237568 00000100:00100000:2.0:1787826960.785888:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237568 00000100:00100000:2.0:1787826960.785935:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237696 00000100:00100000:2.0:1787826960.785938:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237696 00000100:00100000:1.0:1787826960.785971:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 336 00000100:00100000:1.0:1787826960.785981:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e071e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134237568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826960.786011:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 337 00000100:00100000:1.0:1787826960.786021:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e071e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134237568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 41us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826960.786024:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134237696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826960.786034:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 336 00000100:00100000:0.0:1787826960.786076:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134237696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826960.786083:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 337 00000100:00080000:3.0:1787826960.786581:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826960.786585:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826960.832912:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826960.832999:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237824 00000100:00100000:0.0:1787826960.833010:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237824 00002000:00100000:0.0:1787826960.833123:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (830472192->834666495) req@ffff8d546f6dbc00 x1874672134237824/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/0 e 0 to 0 dl 1787826971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826960.833136:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6dbc00 with x1874672134237824 ext(830472192->834666495) 00002000:00010000:0.0:1787826960.833142:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6dbc00 00000100:00100000:0.0:1787826960.833180:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 230 00000100:00100000:0.0:1787826960.833190:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134237824:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826960.853913:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134237824:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20714us (20999us total) trans 30064771235 rc 0/0 00000100:00100000:0.0:1787826960.853935:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 230 00002000:00100000:0.0:1787826960.853949:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (830472192->834666495) req@ffff8d546f6dbc00 x1874672134237824/t30064771235(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:561/0 lens 488/448 e 0 to 0 dl 1787826971 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826960.853959:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6dbc00 with x1874672134237824 ext(830472192->834666495) 00002000:00010000:0.0:1787826960.853965:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6dbc00 00000001:00100000:1.0:1787826960.978328:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:1.0:1787826960.978337:0:9469:0:(genops.c:885:class_export_put()) final put ffff8d53494c2000/2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:2.0:1787826960.978399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53494c2000/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0001 00000020:00000080:2.0:1787826960.978456:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53494c5800 for lustre-OST0001 00000100:00100000:2.0:1787826961.086404:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826961.086631:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134237952 00000100:00100000:0.0:1787826961.086640:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134237952 00002000:00100000:0.0:1787826961.086730:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (834666496->838860799) req@ffff8d546f6a3480 x1874672134237952/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/0 e 0 to 0 dl 1787826972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826961.086750:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a3480 with x1874672134237952 ext(834666496->838860799) 00002000:00010000:0.0:1787826961.086756:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a3480 00000100:00100000:0.0:1787826961.086782:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 231 00000100:00100000:0.0:1787826961.086791:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134237952:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:3.0:1787826961.087831:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826961.102954:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134237952:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16153us (16548us total) trans 30064771236 rc 0/0 00000100:00100000:2.0:1787826961.102969:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 231 00002000:00100000:2.0:1787826961.102983:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (834666496->838860799) req@ffff8d546f6a3480 x1874672134237952/t30064771236(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/448 e 0 to 0 dl 1787826972 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826961.102994:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a3480 with x1874672134237952 ext(834666496->838860799) 00002000:00010000:2.0:1787826961.103000:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a3480 00000100:00100000:0.0:1787826961.337253:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826961.337383:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238080 00000100:00100000:2.0:1787826961.337404:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238080 00002000:00100000:2.0:1787826961.337451:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (838860800->843055103) req@ffff8d53492c7480 x1874672134238080/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/0 e 0 to 0 dl 1787826972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826961.337461:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7480 with x1874672134238080 ext(838860800->843055103) 00002000:00010000:2.0:1787826961.337467:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7480 00000100:00100000:2.0:1787826961.337553:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 232 00000100:00100000:2.0:1787826961.337562:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134238080:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826961.357987:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134238080:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20409us (20767us total) trans 30064771237 rc 0/0 00000100:00100000:3.0:1787826961.358005:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 232 00002000:00100000:3.0:1787826961.358021:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (838860800->843055103) req@ffff8d53492c7480 x1874672134238080/t30064771237(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/448 e 0 to 0 dl 1787826972 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826961.358032:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7480 with x1874672134238080 ext(838860800->843055103) 00002000:00010000:3.0:1787826961.358040:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7480 00000100:00100000:1.0:1787826961.489455:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143751424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826961.489544:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143751680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826961.489561:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143751552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826961.489577:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826961.489623:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826961.489652:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751424 00000100:00100000:3.0:1787826961.489664:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751424 00000100:00100000:2.0:1787826961.489671:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826961.489710:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751680 00000100:00100000:0.0:1787826961.489717:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751680 00000100:00100000:1.0:1787826961.489723:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751552 00000100:00100000:1.0:1787826961.489730:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751552 00000100:00100000:0.0:1787826961.489768:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787826961.489780:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787826961.489781:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787826961.489783:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143751424:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787826961.489785:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826961.489799:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143751552:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826961.489801:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143751680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826961.489824:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787826961.489846:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:1.0:1787826961.489860:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787826961.489903:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143751424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826961.489906:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143751680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826961.489920:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787826961.489939:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143751552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826961.489941:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787826961.489953:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:2.0:1787826961.489968:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c6580 x1874672143751424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826961.489998:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143751424:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787826961.490017:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6b840 x1874672143751680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826961.490030:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143751552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826961.490039:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143751680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826961.585342:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826961.585419:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238208 00000100:00100000:1.0:1787826961.585436:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238208 00002000:00100000:1.0:1787826961.585500:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (843055104->847249407) req@ffff8d5344bd4780 x1874672134238208/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/0 e 0 to 0 dl 1787826972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826961.585513:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd4780 with x1874672134238208 ext(843055104->847249407) 00002000:00010000:1.0:1787826961.585530:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd4780 00000100:00100000:1.0:1787826961.585574:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 233 00000100:00100000:1.0:1787826961.585586:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134238208:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826961.612321:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2390:x1874672134238208:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 26729us (26978us total) trans 30064771238 rc 0/0 00000100:00100000:1.0:1787826961.612337:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 233 00002000:00100000:1.0:1787826961.612350:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (843055104->847249407) req@ffff8d5344bd4780 x1874672134238208/t30064771238(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/448 e 0 to 0 dl 1787826972 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826961.612361:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd4780 with x1874672134238208 ext(843055104->847249407) 00002000:00010000:1.0:1787826961.612367:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd4780 00010000:00010000:2.0:1787826961.617426:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826961.845775:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826961.845844:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238336 00000100:00100000:1.0:1787826961.845854:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238336 00002000:00100000:1.0:1787826961.845905:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (847249408->851443711) req@ffff8d53492c6580 x1874672134238336/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/0 e 0 to 0 dl 1787826972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826961.845916:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c6580 with x1874672134238336 ext(847249408->851443711) 00002000:00010000:1.0:1787826961.845936:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c6580 00000100:00100000:1.0:1787826961.845974:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 234 00000100:00100000:1.0:1787826961.845986:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134238336:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826961.866362:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134238336:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20369us (20586us total) trans 30064771239 rc 0/0 00000100:00100000:1.0:1787826961.866376:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 234 00002000:00100000:1.0:1787826961.866388:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (847249408->851443711) req@ffff8d53492c6580 x1874672134238336/t30064771239(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:562/0 lens 488/448 e 0 to 0 dl 1787826972 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826961.866398:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c6580 with x1874672134238336 ext(847249408->851443711) 00002000:00010000:1.0:1787826961.866404:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c6580 00000100:00100000:3.0:1787826962.001458:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143751808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826962.001460:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143751936:0@lo:400:kworker.0 00000100:00100000:1.0:1787826962.001511:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143752192:0@lo:400:kworker.0 00000100:00100000:2.0:1787826962.001543:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826962.001550:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826962.001595:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751808 00000100:00100000:0.0:1787826962.001603:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751808 00000100:00100000:1.0:1787826962.001623:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826962.001629:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143752448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826962.001637:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143752320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.001666:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1787826962.001674:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143752704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.001687:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143751808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826962.001697:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826962.001705:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826962.001737:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143752960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826962.001747:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143752064:0@lo:400:kworker.0 00000100:00100000:3.0:1787826962.001758:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143752832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.001769:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143751808:12345-0@lo:400:kworker.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826962.001782:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1787826962.001789:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826962.001812:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826962.001828:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752320 00000100:00100000:3.0:1787826962.001837:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752320 00000100:00100000:0.0:1787826962.001890:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752704 00000100:00100000:2.0:1787826962.001890:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143751936 00000100:00100000:2.0:1787826962.001896:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143751936 00000100:00100000:0.0:1787826962.001898:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752704 00000100:00100000:3.0:1787826962.001898:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787826962.001915:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752448 00000100:00100000:1.0:1787826962.001923:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752448 00000100:00100000:3.0:1787826962.001937:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143752320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.001949:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787826962.001949:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752960 00000100:00100000:2.0:1787826962.001956:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752960 00000100:00100000:0.0:1787826962.001962:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143752704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826962.001978:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787826962.001994:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143751936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826962.002004:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143752320:12345-0@lo:400:kworker.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826962.002014:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787826962.002030:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143752704:12345-0@lo:400:kworker.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826962.002030:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143752448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.002043:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787826962.002074:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143751936:12345-0@lo:400:kworker.0 Request processed in 80us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826962.002082:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787826962.002088:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143752704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826962.002089:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787826962.002102:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143752448:12345-0@lo:400:kworker.0 Request processed in 75us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826962.002112:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:3.0:1787826962.002135:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826962.002141:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00080000:3.0:1787826962.002142:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826962.002151:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826962.002152:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143752960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.002161:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826962.002185:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752192 00000100:00100000:3.0:1787826962.002192:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752192 00000100:00100000:0.0:1787826962.002204:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143752576:0@lo:400:kworker.0 00000100:00100000:1.0:1787826962.002242:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143752960:12345-0@lo:400:kworker.0 Request processed in 67us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826962.002252:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787826962.002267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826962.002284:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752064 00000100:00100000:3.0:1787826962.002285:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787826962.002289:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752576 00000100:00100000:1.0:1787826962.002294:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752064 00000100:00100000:2.0:1787826962.002298:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752576 00000100:00100000:3.0:1787826962.002305:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e155e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143752192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.002323:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826962.002351:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143752832 00000100:00100000:2.0:1787826962.002357:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787826962.002358:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143752832 00000100:00100000:0.0:1787826962.002371:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143751808:0@lo:400:kworker.0 00000100:00100000:2.0:1787826962.002371:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143752064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826962.002407:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e155e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143752192:12345-0@lo:400:kworker.0 Request processed in 105us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826962.002412:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1787826962.002422:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143752320:0@lo:400:kworker.0 00000100:00100000:3.0:1787826962.002430:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787826962.002432:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143752576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826962.002442:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143752064:12345-0@lo:400:kworker.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826962.002454:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787826962.002466:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787826962.002484:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143752832:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826962.002492:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826962.002495:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143752576:12345-0@lo:400:kworker.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826962.002502:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826962.002511:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143752448:0@lo:400:kworker.0 00000100:00100000:1.0:1787826962.002518:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787826962.002553:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143752064:0@lo:400:kworker.0 00010000:00080000:3.0:1787826962.002565:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74c3c0 x1874672143752960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826962.002577:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b11680 x1874672143752576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826962.002580:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143752960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.002593:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143752832:12345-0@lo:400:kworker.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826962.002600:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143752576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.002606:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787826962.002613:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143752192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826962.002616:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143751936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826962.002661:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143752832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826962.120907:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826962.121142:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238464 00000100:00100000:1.0:1787826962.121158:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238464 00002000:00100000:1.0:1787826962.121265:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (851443712->855638015) req@ffff8d5344bd52c0 x1874672134238464/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/0 e 0 to 0 dl 1787826973 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826962.121278:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd52c0 with x1874672134238464 ext(851443712->855638015) 00002000:00010000:1.0:1787826962.121284:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd52c0 00000100:00100000:1.0:1787826962.121455:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 235 00000100:00100000:1.0:1787826962.121468:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134238464:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826962.141595:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134238464:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20121us (20685us total) trans 30064771240 rc 0/0 00000100:00100000:2.0:1787826962.141609:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 235 00002000:00100000:2.0:1787826962.141622:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (851443712->855638015) req@ffff8d5344bd52c0 x1874672134238464/t30064771240(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/448 e 0 to 0 dl 1787826973 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826962.141631:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd52c0 with x1874672134238464 ext(851443712->855638015) 00002000:00010000:2.0:1787826962.141646:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd52c0 00000100:00100000:0.0:1787826962.369116:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826962.369296:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238592 00000100:00100000:3.0:1787826962.369306:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238592 00002000:00100000:3.0:1787826962.369355:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (855638016->859832319) req@ffff8d547f994f00 x1874672134238592/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/0 e 0 to 0 dl 1787826973 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826962.369365:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f994f00 with x1874672134238592 ext(855638016->859832319) 00002000:00010000:3.0:1787826962.369369:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f994f00 00000100:00100000:3.0:1787826962.369401:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 236 00000100:00100000:3.0:1787826962.369408:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2391:x1874672134238592:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826962.390023:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134238592:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20603us (20905us total) trans 30064771241 rc 0/0 00000100:00100000:2.0:1787826962.390037:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 236 00002000:00100000:2.0:1787826962.390049:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (855638016->859832319) req@ffff8d547f994f00 x1874672134238592/t30064771241(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/448 e 0 to 0 dl 1787826973 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826962.390060:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f994f00 with x1874672134238592 ext(855638016->859832319) 00002000:00010000:2.0:1787826962.390066:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f994f00 00000100:00100000:1.0:1787826962.513762:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826962.513784:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143753088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826962.513859:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826962.514006:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753088 00000100:00100000:3.0:1787826962.514014:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753088 00000100:00100000:3.0:1787826962.514066:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787826962.514075:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143753088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826962.514106:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826962.514162:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143753088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826962.514186:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787826962.514237:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143753088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826962.615423:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826962.615485:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238720 00000100:00100000:1.0:1787826962.615506:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238720 00002000:00100000:1.0:1787826962.615570:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (859832320->864026623) req@ffff8d547f997c00 x1874672134238720/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/0 e 0 to 0 dl 1787826973 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826962.615583:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f997c00 with x1874672134238720 ext(859832320->864026623) 00002000:00010000:1.0:1787826962.615589:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f997c00 00000100:00100000:1.0:1787826962.615617:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 237 00000100:00100000:1.0:1787826962.615627:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2390:x1874672134238720:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826962.632456:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f997c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2390:x1874672134238720:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16821us (17032us total) trans 30064771242 rc 0/0 00000100:00100000:2.0:1787826962.632471:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 237 00002000:00100000:2.0:1787826962.632484:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (859832320->864026623) req@ffff8d547f997c00 x1874672134238720/t30064771242(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/448 e 0 to 0 dl 1787826973 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826962.632496:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f997c00 with x1874672134238720 ext(859832320->864026623) 00002000:00010000:2.0:1787826962.632516:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f997c00 00010000:00010000:2.0:1787826962.641412:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826962.859105:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826962.859242:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238848 00000100:00100000:0.0:1787826962.859252:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238848 00002000:00100000:0.0:1787826962.859300:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (864026624->868220927) req@ffff8d547fa4c3c0 x1874672134238848/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/0 e 0 to 0 dl 1787826973 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826962.859311:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa4c3c0 with x1874672134238848 ext(864026624->868220927) 00002000:00010000:0.0:1787826962.859317:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa4c3c0 00000100:00100000:0.0:1787826962.859349:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 238 00000100:00100000:0.0:1787826962.859359:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2391:x1874672134238848:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826962.879918:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2391:x1874672134238848:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20548us (20810us total) trans 30064771243 rc 0/0 00000100:00100000:0.0:1787826962.879933:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 238 00002000:00100000:0.0:1787826962.879945:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (864026624->868220927) req@ffff8d547fa4c3c0 x1874672134238848/t30064771243(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:563/0 lens 488/448 e 0 to 0 dl 1787826973 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826962.879957:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa4c3c0 with x1874672134238848 ext(864026624->868220927) 00002000:00010000:0.0:1787826962.879963:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa4c3c0 00000100:00100000:1.0:1787826963.102181:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826963.102338:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134238976 00000100:00100000:2.0:1787826963.102352:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134238976 00002000:00100000:2.0:1787826963.102438:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (868220928->872415231) req@ffff8d547fa4e940 x1874672134238976/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/0 e 0 to 0 dl 1787826974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826963.102452:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa4e940 with x1874672134238976 ext(868220928->872415231) 00002000:00010000:2.0:1787826963.102459:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa4e940 00000100:00080000:3.0:1787826963.102601:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826963.102653:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 239 00000100:00100000:2.0:1787826963.102665:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134238976:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826963.120838:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2390:x1874672134238976:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18165us (18663us total) trans 30064771244 rc 0/0 00000100:00100000:3.0:1787826963.120861:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 239 00002000:00100000:3.0:1787826963.120875:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (868220928->872415231) req@ffff8d547fa4e940 x1874672134238976/t30064771244(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/448 e 0 to 0 dl 1787826974 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826963.120885:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa4e940 with x1874672134238976 ext(868220928->872415231) 00002000:00010000:3.0:1787826963.120892:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa4e940 00000100:00100000:2.0:1787826963.343882:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826963.343941:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134239104 00000100:00100000:3.0:1787826963.343951:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134239104 00002000:00100000:3.0:1787826963.344011:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (872415232->876609535) req@ffff8d5344bd6940 x1874672134239104/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/0 e 0 to 0 dl 1787826974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826963.344022:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd6940 with x1874672134239104 ext(872415232->876609535) 00002000:00010000:3.0:1787826963.344041:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd6940 00000100:00100000:3.0:1787826963.344074:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 240 00000100:00100000:3.0:1787826963.344084:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134239104:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826963.366483:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134239104:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22389us (22599us total) trans 30064771245 rc 0/0 00000100:00100000:3.0:1787826963.366498:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 240 00002000:00100000:3.0:1787826963.366511:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (872415232->876609535) req@ffff8d5344bd6940 x1874672134239104/t30064771245(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/448 e 0 to 0 dl 1787826974 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826963.366534:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd6940 with x1874672134239104 ext(872415232->876609535) 00002000:00010000:3.0:1787826963.366551:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd6940 00000100:00100000:2.0:1787826963.597958:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826963.598076:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134239232 00000100:00100000:1.0:1787826963.598087:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134239232 00002000:00100000:1.0:1787826963.598134:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (876609536->880803839) req@ffff8d5343b130c0 x1874672134239232/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/0 e 0 to 0 dl 1787826974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826963.598146:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b130c0 with x1874672134239232 ext(876609536->880803839) 00002000:00010000:1.0:1787826963.598152:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b130c0 00000100:00100000:1.0:1787826963.598243:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 241 00000100:00100000:1.0:1787826963.598253:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134239232:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826963.624815:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134239232:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 26553us (26856us total) trans 30064771246 rc 0/0 00000100:00100000:2.0:1787826963.624830:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 241 00002000:00100000:2.0:1787826963.624844:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (876609536->880803839) req@ffff8d5343b130c0 x1874672134239232/t30064771246(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/448 e 0 to 0 dl 1787826974 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826963.624855:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b130c0 with x1874672134239232 ext(876609536->880803839) 00002000:00010000:2.0:1787826963.624861:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b130c0 00010000:00010000:0.0:1787826963.665839:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826963.861533:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826963.861648:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134239360 00000100:00100000:1.0:1787826963.861658:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134239360 00002000:00100000:1.0:1787826963.861704:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (880803840->884998143) req@ffff8d5343b11680 x1874672134239360/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/0 e 0 to 0 dl 1787826974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826963.861724:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b11680 with x1874672134239360 ext(880803840->884998143) 00002000:00010000:1.0:1787826963.861729:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b11680 00000100:00100000:1.0:1787826963.861759:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 242 00000100:00100000:1.0:1787826963.861771:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134239360:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826963.883062:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134239360:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21284us (21541us total) trans 30064771247 rc 0/0 00000100:00100000:1.0:1787826963.883075:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 242 00002000:00100000:1.0:1787826963.883088:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (880803840->884998143) req@ffff8d5343b11680 x1874672134239360/t30064771247(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:564/0 lens 488/448 e 0 to 0 dl 1787826974 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826963.883099:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b11680 with x1874672134239360 ext(880803840->884998143) 00002000:00010000:1.0:1787826963.883106:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b11680 00000100:00100000:0.0:1787826964.049483:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143753344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826964.049506:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143753216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826964.049599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826964.049670:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826964.049764:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753344 00000100:00100000:3.0:1787826964.049772:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753344 00000100:00100000:3.0:1787826964.049831:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753216 00000100:00100000:3.0:1787826964.049834:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753216 00000100:00100000:3.0:1787826964.049858:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787826964.049866:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787826964.049870:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143753344:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826964.049877:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143753216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826964.049894:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 770048 granted 557409728 pending 71720960 free 3051798528 avail 2820276224 00002000:00000024:3.0:1787826964.049894:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 770048 granted 557409728 pending 71720960 free 3051798528 avail 2820276224 00000100:00100000:1.0:1787826964.049949:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143753216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826964.049956:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787826964.049967:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143753344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (367us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826964.049969:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826964.049983:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787826964.050004:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143753216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826964.050036:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143753344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826964.127175:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826964.127318:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134239488 00000100:00100000:1.0:1787826964.127331:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134239488 00002000:00100000:1.0:1787826964.127386:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (884998144->889192447) req@ffff8d547f74c3c0 x1874672134239488/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/0 e 0 to 0 dl 1787826975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826964.127400:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f74c3c0 with x1874672134239488 ext(884998144->889192447) 00002000:00010000:1.0:1787826964.127405:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f74c3c0 00000100:00100000:1.0:1787826964.127448:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 243 00000100:00100000:1.0:1787826964.127472:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134239488:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826964.145989:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134239488:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18511us (18818us total) trans 30064771248 rc 0/0 00000100:00100000:1.0:1787826964.145999:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 243 00002000:00100000:1.0:1787826964.146009:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (884998144->889192447) req@ffff8d547f74c3c0 x1874672134239488/t30064771248(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/448 e 0 to 0 dl 1787826975 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826964.146016:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f74c3c0 with x1874672134239488 ext(884998144->889192447) 00002000:00010000:1.0:1787826964.146021:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f74c3c0 00000100:00100000:2.0:1787826964.372288:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826964.372371:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134239616 00000100:00100000:1.0:1787826964.372384:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134239616 00002000:00100000:1.0:1787826964.372451:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (889192448->893386751) req@ffff8d547f7030c0 x1874672134239616/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/0 e 0 to 0 dl 1787826975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826964.372461:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7030c0 with x1874672134239616 ext(889192448->893386751) 00002000:00010000:1.0:1787826964.372466:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7030c0 00000100:00100000:1.0:1787826964.372496:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 244 00000100:00100000:1.0:1787826964.372505:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2391:x1874672134239616:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826964.391554:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2391:x1874672134239616:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19042us (19273us total) trans 30064771249 rc 0/0 00000100:00100000:1.0:1787826964.391566:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 244 00002000:00100000:1.0:1787826964.391577:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (889192448->893386751) req@ffff8d547f7030c0 x1874672134239616/t30064771249(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/448 e 0 to 0 dl 1787826975 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826964.391584:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7030c0 with x1874672134239616 ext(889192448->893386751) 00002000:00010000:1.0:1787826964.391589:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7030c0 00000100:00100000:0.0:1787826964.612665:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826964.612734:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134239744 00000100:00100000:2.0:1787826964.612744:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134239744 00002000:00100000:2.0:1787826964.612793:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (893386752->897581055) req@ffff8d547d2b03c0 x1874672134239744/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/0 e 0 to 0 dl 1787826975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826964.612802:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b03c0 with x1874672134239744 ext(893386752->897581055) 00002000:00010000:2.0:1787826964.612807:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b03c0 00000100:00100000:2.0:1787826964.612834:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 245 00000100:00100000:2.0:1787826964.612841:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134239744:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826964.637650:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134239744:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24796us (24982us total) trans 30064771250 rc 0/0 00000100:00100000:2.0:1787826964.637665:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 245 00002000:00100000:2.0:1787826964.637678:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (893386752->897581055) req@ffff8d547d2b03c0 x1874672134239744/t30064771250(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/448 e 0 to 0 dl 1787826975 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826964.637703:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b03c0 with x1874672134239744 ext(893386752->897581055) 00002000:00010000:2.0:1787826964.637709:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b03c0 00010000:00010000:2.0:1787826964.689461:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826964.876059:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826964.876172:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134239872 00000100:00100000:0.0:1787826964.876186:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134239872 00002000:00100000:0.0:1787826964.876283:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (897581056->901775359) req@ffff8d546e16c780 x1874672134239872/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/0 e 0 to 0 dl 1787826975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826964.876294:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16c780 with x1874672134239872 ext(897581056->901775359) 00002000:00010000:0.0:1787826964.876300:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16c780 00000100:00100000:0.0:1787826964.876342:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 246 00000100:00100000:0.0:1787826964.876352:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134239872:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826964.892917:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134239872:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16549us (16854us total) trans 30064771251 rc 0/0 00000100:00100000:0.0:1787826964.892937:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 246 00002000:00100000:0.0:1787826964.892950:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (897581056->901775359) req@ffff8d546e16c780 x1874672134239872/t30064771251(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:565/0 lens 488/448 e 0 to 0 dl 1787826975 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826964.892961:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16c780 with x1874672134239872 ext(897581056->901775359) 00002000:00010000:0.0:1787826964.892969:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16c780 00000001:00080000:1.0:1787826964.893627:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771251 is committed 00000100:00100000:1.0:1787826965.120811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826965.120865:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240000 00000100:00100000:3.0:1787826965.120875:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240000 00002000:00100000:3.0:1787826965.120933:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (901775360->905969663) req@ffff8d547fa4c000 x1874672134240000/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/0 e 0 to 0 dl 1787826976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826965.120944:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa4c000 with x1874672134240000 ext(901775360->905969663) 00000100:00080000:0.0:1787826965.120948:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1787826965.120950:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa4c000 00000100:00100000:3.0:1787826965.120983:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 247 00000100:00100000:3.0:1787826965.120992:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134240000:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826965.137923:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134240000:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16918us (17106us total) trans 30064771252 rc 0/0 00000100:00100000:2.0:1787826965.137937:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 247 00002000:00100000:2.0:1787826965.137953:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (901775360->905969663) req@ffff8d547fa4c000 x1874672134240000/t30064771252(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/448 e 0 to 0 dl 1787826976 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826965.137965:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa4c000 with x1874672134240000 ext(901775360->905969663) 00002000:00010000:2.0:1787826965.137972:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa4c000 00000100:00100000:2.0:1787826965.368027:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826965.368090:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240128 00000100:00100000:3.0:1787826965.368102:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240128 00002000:00100000:3.0:1787826965.368169:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (905969664->910163967) req@ffff8d547f703480 x1874672134240128/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/0 e 0 to 0 dl 1787826976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826965.368204:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f703480 with x1874672134240128 ext(905969664->910163967) 00002000:00010000:3.0:1787826965.368211:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f703480 00000100:00100000:3.0:1787826965.368316:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 248 00000100:00100000:3.0:1787826965.368327:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134240128:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826965.388902:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134240128:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20566us (20877us total) trans 30064771253 rc 0/0 00000100:00100000:3.0:1787826965.388916:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 248 00002000:00100000:3.0:1787826965.388928:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (905969664->910163967) req@ffff8d547f703480 x1874672134240128/t30064771253(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/448 e 0 to 0 dl 1787826976 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826965.388938:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f703480 with x1874672134240128 ext(905969664->910163967) 00002000:00010000:3.0:1787826965.388943:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f703480 00000100:00100000:0.0:1787826965.624981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826965.625069:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240256 00000100:00100000:1.0:1787826965.625079:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240256 00002000:00100000:1.0:1787826965.625123:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (910163968->914358271) req@ffff8d547d2b30c0 x1874672134240256/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/0 e 0 to 0 dl 1787826976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826965.625134:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b30c0 with x1874672134240256 ext(910163968->914358271) 00002000:00010000:1.0:1787826965.625139:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b30c0 00000100:00100000:1.0:1787826965.625178:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 249 00000100:00100000:1.0:1787826965.625187:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134240256:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826965.645653:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134240256:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20450us (20664us total) trans 30064771254 rc 0/0 00000100:00100000:3.0:1787826965.645668:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 249 00002000:00100000:3.0:1787826965.645681:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (910163968->914358271) req@ffff8d547d2b30c0 x1874672134240256/t30064771254(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/448 e 0 to 0 dl 1787826976 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826965.645691:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b30c0 with x1874672134240256 ext(910163968->914358271) 00002000:00010000:3.0:1787826965.645697:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b30c0 00010000:00010000:2.0:1787826965.713450:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826965.874925:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826965.875010:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240384 00000100:00100000:2.0:1787826965.875025:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240384 00002000:00100000:2.0:1787826965.875069:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (914358272->918552575) req@ffff8d5444f083c0 x1874672134240384/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/0 e 0 to 0 dl 1787826976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826965.875080:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f083c0 with x1874672134240384 ext(914358272->918552575) 00002000:00010000:2.0:1787826965.875086:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f083c0 00000100:00100000:2.0:1787826965.875123:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 250 00000100:00100000:2.0:1787826965.875132:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134240384:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826965.892384:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134240384:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17242us (17456us total) trans 30064771255 rc 0/0 00000100:00100000:2.0:1787826965.892397:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 250 00002000:00100000:2.0:1787826965.892421:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (914358272->918552575) req@ffff8d5444f083c0 x1874672134240384/t30064771255(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 488/448 e 0 to 0 dl 1787826976 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826965.892432:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5444f083c0 with x1874672134240384 ext(914358272->918552575) 00002000:00010000:2.0:1787826965.892437:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5444f083c0 00000100:00100000:3.0:1787826965.905453:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826965.905530:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240640 00000100:00100000:2.0:1787826965.905540:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240640 00000100:00100000:3.0:1787826965.905567:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826965.905606:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00080000:0.0:1787826965.905667:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826965.905667:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240512 00000100:00100000:1.0:1787826965.905673:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240512 00000100:00100000:1.0:1787826965.905720:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 509 00000100:00100000:1.0:1787826965.905727:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134240512:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826965.905797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240768 00000100:00100000:2.0:1787826965.905803:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240768 00000100:00100000:1.0:1787826965.905811:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134240512:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 84us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826965.905826:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 509 00000100:00100000:2.0:1787826965.905834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 344 00000100:00100000:2.0:1787826965.905844:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134240640:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826965.905873:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 345 00000100:00100000:1.0:1787826965.905882:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134240768:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787826965.905904:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826965.906071:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134240768:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 190us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826965.906076:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 345 00000100:00100000:2.0:1787826965.906093:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134240640:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 249us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826965.906100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 344 00000100:00100000:3.0:1787826965.906411:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826965.906466:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134240896 00000100:00100000:1.0:1787826965.906471:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134240896 00002000:00100000:1.0:1787826965.906519:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (401948672->919048191) req@ffff8d534243e1c0 x1874672134240896/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 504/0 e 0 to 0 dl 1787826976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826965.906532:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243e1c0 with x1874672134240896 ext(401948672->919048191) 00002000:00010000:1.0:1787826965.906538:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243e1c0 00000100:00100000:1.0:1787826965.906562:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 251 00000100:00100000:1.0:1787826965.906569:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134240896:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826965.907328:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826965.907398:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241024 00000100:00100000:2.0:1787826965.907404:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241024 00002000:00100000:2.0:1787826965.907491:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (919048192->919064575) req@ffff8d545326a580 x1874672134241024/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 16872/0 e 0 to 0 dl 1787826976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826965.907502:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545326a580 with x1874672134241024 ext(919048192->919064575) 00002000:00010000:2.0:1787826965.907517:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545326a580 00000100:00100000:2.0:1787826965.907540:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 252 00000100:00100000:2.0:1787826965.907549:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134241024:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826965.908269:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134241024:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 718us (939us total) trans 30064771256 rc 0/0 00000100:00100000:2.0:1787826965.908278:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 252 00002000:00100000:2.0:1787826965.908286:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (919048192->919064575) req@ffff8d545326a580 x1874672134241024/t30064771256(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 16872/448 e 0 to 0 dl 1787826976 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826965.908300:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545326a580 with x1874672134241024 ext(919048192->919064575) 00002000:00010000:2.0:1787826965.908303:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545326a580 00000100:00100000:2.0:1787826965.913477:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134240896:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 6899us (7057us total) trans 30064771257 rc 0/0 00000100:00100000:2.0:1787826965.913492:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 251 00002000:00100000:2.0:1787826965.913515:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (401948672->919048191) req@ffff8d534243e1c0 x1874672134240896/t30064771257(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:566/0 lens 504/448 e 0 to 0 dl 1787826976 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826965.913527:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243e1c0 with x1874672134240896 ext(401948672->919048191) 00002000:00010000:2.0:1787826965.913534:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243e1c0 00000100:00100000:3.0:1787826966.351175:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826966.351318:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241152 00000100:00100000:2.0:1787826966.351334:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241152 00002000:00100000:2.0:1787826966.351418:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (922746880->926941183) req@ffff8d545326ad00 x1874672134241152/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:567/0 lens 488/0 e 0 to 0 dl 1787826977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826966.351430:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545326ad00 with x1874672134241152 ext(922746880->926941183) 00002000:00010000:2.0:1787826966.351436:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545326ad00 00000100:00100000:2.0:1787826966.351477:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 253 00000100:00100000:2.0:1787826966.351488:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134241152:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826966.370282:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134241152:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18777us (19097us total) trans 30064771258 rc 0/0 00000100:00100000:2.0:1787826966.370300:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 253 00002000:00100000:2.0:1787826966.370316:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (922746880->926941183) req@ffff8d545326ad00 x1874672134241152/t30064771258(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:567/0 lens 488/448 e 0 to 0 dl 1787826977 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826966.370371:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545326ad00 with x1874672134241152 ext(922746880->926941183) 00002000:00010000:2.0:1787826966.370380:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545326ad00 00000100:00100000:1.0:1787826966.587746:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826966.587809:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241280 00000100:00100000:0.0:1787826966.587818:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241280 00002000:00100000:0.0:1787826966.587864:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (926941184->931135487) req@ffff8d5453334780 x1874672134241280/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:567/0 lens 488/0 e 0 to 0 dl 1787826977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826966.587880:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453334780 with x1874672134241280 ext(926941184->931135487) 00002000:00010000:0.0:1787826966.587884:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453334780 00000100:00100000:0.0:1787826966.587920:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:0.0:1787826966.587930:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134241280:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826966.602692:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134241280:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14747us (14939us total) trans 30064771259 rc 0/0 00000100:00100000:2.0:1787826966.602707:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 254 00002000:00100000:2.0:1787826966.602723:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (926941184->931135487) req@ffff8d5453334780 x1874672134241280/t30064771259(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:567/0 lens 488/448 e 0 to 0 dl 1787826977 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826966.602734:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453334780 with x1874672134241280 ext(926941184->931135487) 00002000:00010000:2.0:1787826966.602742:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453334780 00000100:00100000:3.0:1787826966.609399:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787826966.609411:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143753728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826966.609417:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143753472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826966.609512:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826966.609513:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826966.609571:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753728 00000100:00100000:0.0:1787826966.609579:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753472 00000100:00100000:1.0:1787826966.609582:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753728 00000100:00100000:0.0:1787826966.609587:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753472 00000100:00100000:3.0:1787826966.609605:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143753600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826966.609661:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787826966.609662:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787826966.609677:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143753472:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826966.609678:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143753728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826966.609697:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826966.609701:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:0.0:1787826966.609717:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:1.0:1787826966.609719:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826966.609737:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753600 00000100:00100000:3.0:1787826966.609746:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753600 00000100:00080000:3.0:1787826966.609822:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826966.609824:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143753728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826966.609827:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143753472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826966.609842:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787826966.609844:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787826966.609856:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787826966.609875:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54765b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143753600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826966.609903:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787826966.609928:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b3840 x1874672143753728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826966.609935:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143753472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826966.609956:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54765b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143753600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (255us total) trans 0 rc 0/0 00010000:00080000:0.0:1787826966.609971:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c0000 x1874672143753600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826966.609972:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143753728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826966.609973:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787826966.610006:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143753600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787826966.737428:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826966.805285:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826966.805381:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241408 00000100:00100000:2.0:1787826966.805400:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241408 00002000:00100000:2.0:1787826966.805470:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (931135488->935329791) req@ffff8d547d2b0b40 x1874672134241408/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:567/0 lens 488/0 e 0 to 0 dl 1787826977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826966.805480:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b0b40 with x1874672134241408 ext(931135488->935329791) 00002000:00010000:2.0:1787826966.805514:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b0b40 00000100:00100000:2.0:1787826966.805555:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 255 00000100:00100000:2.0:1787826966.805567:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134241408:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826966.819894:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134241408:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14319us (14609us total) trans 30064771260 rc 0/0 00000100:00100000:2.0:1787826966.819907:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 255 00002000:00100000:2.0:1787826966.819921:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (931135488->935329791) req@ffff8d547d2b0b40 x1874672134241408/t30064771260(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:567/0 lens 488/448 e 0 to 0 dl 1787826977 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826966.819932:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b0b40 with x1874672134241408 ext(931135488->935329791) 00002000:00010000:2.0:1787826966.819937:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b0b40 00000100:00100000:1.0:1787826967.039015:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826967.039072:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241536 00000100:00100000:2.0:1787826967.039080:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241536 00002000:00100000:2.0:1787826967.039134:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (935329792->939524095) req@ffff8d5453335680 x1874672134241536/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/0 e 0 to 0 dl 1787826978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:3.0:1787826967.039142:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826967.039143:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453335680 with x1874672134241536 ext(935329792->939524095) 00002000:00010000:2.0:1787826967.039152:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453335680 00000100:00100000:2.0:1787826967.039185:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 256 00000100:00100000:2.0:1787826967.039196:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134241536:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826967.052274:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134241536:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13071us (13258us total) trans 30064771261 rc 0/0 00000100:00100000:2.0:1787826967.052288:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 256 00002000:00100000:2.0:1787826967.052301:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (935329792->939524095) req@ffff8d5453335680 x1874672134241536/t30064771261(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/448 e 0 to 0 dl 1787826978 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826967.052329:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5453335680 with x1874672134241536 ext(935329792->939524095) 00002000:00010000:2.0:1787826967.052335:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5453335680 00000100:00100000:1.0:1787826967.121398:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143753856:0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.121416:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143753984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826967.121420:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143754240:0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.121481:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826967.121485:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143754112:0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.121491:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826967.121491:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826967.121546:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826967.121560:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143754496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826967.121560:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143754752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.121577:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143754624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.121577:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143754368:0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.121591:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826967.121622:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143755008:0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.121623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826967.121629:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826967.121634:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143754240 00000100:00100000:3.0:1787826967.121641:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143754240 00000100:00100000:2.0:1787826967.121670:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143754368 00000100:00100000:2.0:1787826967.121674:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143754368 00000100:00100000:1.0:1787826967.121681:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143754880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826967.121688:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787826967.121696:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753984 00000100:00100000:3.0:1787826967.121698:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143754240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.121714:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753984 00000100:00100000:2.0:1787826967.121718:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787826967.121719:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826967.121731:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143754368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.121750:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143754112 00000100:00100000:0.0:1787826967.121754:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143754112 00000100:00100000:3.0:1787826967.121759:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143754240:12345-0@lo:400:kworker.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826967.121766:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787826967.121769:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143754368:12345-0@lo:400:kworker.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826967.121772:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143754496 00000100:00100000:0.0:1787826967.121775:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143754496 00000100:00100000:1.0:1787826967.121780:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143754368:0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.121780:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787826967.121795:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143754624 00000100:00100000:0.0:1787826967.121796:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143754880 00000100:00100000:3.0:1787826967.121801:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143754624 00000100:00100000:0.0:1787826967.121802:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143754880 00000100:00100000:2.0:1787826967.121807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826967.121818:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755008 00000100:00100000:1.0:1787826967.121831:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755008 00000100:00100000:0.0:1787826967.121832:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787826967.121847:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787826967.121851:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143753984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.121859:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826967.121859:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143754112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.121867:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787826967.121879:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143754496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.121893:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143754240:0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.121904:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143753984:12345-0@lo:400:kworker.0 Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826967.121911:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143754112:12345-0@lo:400:kworker.0 Request processed in 55us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826967.121914:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787826967.121925:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787826967.121931:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143754496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.121933:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143754496:12345-0@lo:400:kworker.0 Request processed in 56us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826967.121941:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787826967.121947:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143753984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826967.121948:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787826967.121953:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143754880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.121954:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787826967.121967:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143754624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.121983:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143754752 00000100:00100000:1.0:1787826967.121986:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787826967.121988:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143754752 00000100:00100000:0.0:1787826967.121993:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453337840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143754880:12345-0@lo:400:kworker.0 Request processed in 44us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826967.122000:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143755008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.122001:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787826967.122009:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143754624:12345-0@lo:400:kworker.0 Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826967.122016:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787826967.122022:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787826967.122030:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.122033:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143753856 00000100:00100000:0.0:1787826967.122038:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143753856 00000100:00100000:3.0:1787826967.122050:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f700780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143754112:0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.122056:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143755008:12345-0@lo:400:kworker.0 Request processed in 59us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826967.122065:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00080000:3.0:1787826967.122070:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81cf00 x1874672143754624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826967.122071:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1787826967.122082:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143753856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.122083:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143754752:12345-0@lo:400:kworker.0 Request processed in 53us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826967.122091:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143754624:0@lo:400:kworker.0 00000100:00100000:2.0:1787826967.122094:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1787826967.122116:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787826967.122117:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343ac7480 x1874672143755008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826967.122123:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826967.122128:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826967.122129:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143753856:12345-0@lo:400:kworker.0 Request processed in 50us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826967.122134:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143755008:0@lo:400:kworker.0 00000100:00100000:0.0:1787826967.122138:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1787826967.122143:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143754752:0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.122178:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143754880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826967.122189:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143753856:0@lo:400:kworker.0 00000100:00100000:3.0:1787826967.262101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826967.262177:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241664 00000100:00100000:1.0:1787826967.262186:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241664 00002000:00100000:1.0:1787826967.262254:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (939524096->943718399) req@ffff8d53439c0000 x1874672134241664/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/0 e 0 to 0 dl 1787826978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826967.262265:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53439c0000 with x1874672134241664 ext(939524096->943718399) 00002000:00010000:1.0:1787826967.262270:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53439c0000 00000100:00100000:1.0:1787826967.262299:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 257 00000100:00100000:1.0:1787826967.262309:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134241664:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826967.280540:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134241664:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18225us (18442us total) trans 30064771262 rc 0/0 00000100:00100000:1.0:1787826967.280552:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 257 00002000:00100000:1.0:1787826967.280562:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (939524096->943718399) req@ffff8d53439c0000 x1874672134241664/t30064771262(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/448 e 0 to 0 dl 1787826978 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826967.280570:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53439c0000 with x1874672134241664 ext(939524096->943718399) 00002000:00010000:1.0:1787826967.280574:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53439c0000 00000100:00100000:3.0:1787826967.491490:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826967.491567:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241792 00000100:00100000:2.0:1787826967.491576:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241792 00002000:00100000:2.0:1787826967.491621:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (943718400->947912703) req@ffff8d547f700780 x1874672134241792/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/0 e 0 to 0 dl 1787826978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826967.491632:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f700780 with x1874672134241792 ext(943718400->947912703) 00002000:00010000:2.0:1787826967.491637:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f700780 00000100:00100000:2.0:1787826967.491673:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 258 00000100:00100000:2.0:1787826967.491683:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2390:x1874672134241792:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826967.504776:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2390:x1874672134241792:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13084us (13285us total) trans 30064771263 rc 0/0 00000100:00100000:1.0:1787826967.504791:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 258 00002000:00100000:1.0:1787826967.504804:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (943718400->947912703) req@ffff8d547f700780 x1874672134241792/t30064771263(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/448 e 0 to 0 dl 1787826978 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826967.504815:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f700780 with x1874672134241792 ext(943718400->947912703) 00002000:00010000:1.0:1787826967.504821:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f700780 00000100:00100000:3.0:1787826967.633459:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343ac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143755136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826967.633534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826967.633585:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755136 00000100:00100000:0.0:1787826967.633592:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755136 00000100:00100000:0.0:1787826967.633646:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787826967.633669:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143755136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826967.633723:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826967.633776:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143755136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826967.633784:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787826967.633834:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343ac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143755136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826967.715910:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826967.715967:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134241920 00000100:00100000:3.0:1787826967.715978:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134241920 00002000:00100000:3.0:1787826967.716025:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (947912704->952107007) req@ffff8d5343ac6580 x1874672134241920/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/0 e 0 to 0 dl 1787826978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826967.716068:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343ac6580 with x1874672134241920 ext(947912704->952107007) 00002000:00010000:3.0:1787826967.716075:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343ac6580 00000100:00100000:3.0:1787826967.716107:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 259 00000100:00100000:3.0:1787826967.716117:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2391:x1874672134241920:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826967.729778:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2391:x1874672134241920:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13653us (13875us total) trans 30064771264 rc 0/0 00000100:00100000:0.0:1787826967.729794:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 259 00002000:00100000:0.0:1787826967.729808:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (947912704->952107007) req@ffff8d5343ac6580 x1874672134241920/t30064771264(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/448 e 0 to 0 dl 1787826978 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826967.729818:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343ac6580 with x1874672134241920 ext(947912704->952107007) 00002000:00010000:0.0:1787826967.729826:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343ac6580 00010000:00010000:0.0:1787826967.761369:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826967.926741:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826967.926795:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242048 00000100:00100000:1.0:1787826967.926804:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242048 00002000:00100000:1.0:1787826967.926843:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (952107008->956301311) req@ffff8d547d2b2580 x1874672134242048/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/0 e 0 to 0 dl 1787826978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826967.926851:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b2580 with x1874672134242048 ext(952107008->956301311) 00002000:00010000:1.0:1787826967.926855:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b2580 00000100:00100000:1.0:1787826967.926876:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 260 00000100:00100000:1.0:1787826967.926883:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134242048:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826967.942020:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134242048:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15127us (15278us total) trans 30064771265 rc 0/0 00000100:00100000:1.0:1787826967.942038:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 260 00002000:00100000:1.0:1787826967.942049:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (952107008->956301311) req@ffff8d547d2b2580 x1874672134242048/t30064771265(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:568/0 lens 488/448 e 0 to 0 dl 1787826978 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826967.942056:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b2580 with x1874672134242048 ext(952107008->956301311) 00002000:00010000:1.0:1787826967.942061:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b2580 00000100:00100000:3.0:1787826968.177900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826968.177989:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242176 00000100:00100000:2.0:1787826968.177998:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242176 00002000:00100000:2.0:1787826968.178044:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (956301312->960495615) req@ffff8d547f9d3840 x1874672134242176/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/0 e 0 to 0 dl 1787826979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826968.178057:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d3840 with x1874672134242176 ext(956301312->960495615) 00002000:00010000:2.0:1787826968.178062:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d3840 00000100:00100000:2.0:1787826968.178091:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 261 00000100:00100000:2.0:1787826968.178102:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134242176:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826968.192816:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134242176:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14707us (14916us total) trans 30064771266 rc 0/0 00000100:00100000:1.0:1787826968.192831:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 261 00002000:00100000:1.0:1787826968.192844:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (956301312->960495615) req@ffff8d547f9d3840 x1874672134242176/t30064771266(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/448 e 0 to 0 dl 1787826979 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826968.192854:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9d3840 with x1874672134242176 ext(956301312->960495615) 00002000:00010000:1.0:1787826968.192860:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9d3840 00000100:00100000:3.0:1787826968.409290:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826968.409338:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242304 00000100:00100000:0.0:1787826968.409347:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242304 00002000:00100000:0.0:1787826968.409391:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (960495616->964689919) req@ffff8d534486e580 x1874672134242304/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/0 e 0 to 0 dl 1787826979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826968.409402:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486e580 with x1874672134242304 ext(960495616->964689919) 00002000:00010000:0.0:1787826968.409414:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486e580 00000100:00100000:0.0:1787826968.409440:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 262 00000100:00100000:0.0:1787826968.409447:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134242304:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826968.430036:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134242304:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20579us (20745us total) trans 30064771267 rc 0/0 00000100:00100000:0.0:1787826968.430051:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 262 00002000:00100000:0.0:1787826968.430077:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (960495616->964689919) req@ffff8d534486e580 x1874672134242304/t30064771267(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/448 e 0 to 0 dl 1787826979 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826968.430087:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486e580 with x1874672134242304 ext(960495616->964689919) 00002000:00010000:0.0:1787826968.430093:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486e580 00000100:00100000:3.0:1787826968.663605:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826968.663732:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242432 00000100:00100000:2.0:1787826968.663742:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242432 00002000:00100000:2.0:1787826968.663806:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (964689920->968884223) req@ffff8d534486fc00 x1874672134242432/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/0 e 0 to 0 dl 1787826979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826968.663817:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486fc00 with x1874672134242432 ext(964689920->968884223) 00002000:00010000:2.0:1787826968.663822:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486fc00 00000100:00100000:2.0:1787826968.663860:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 263 00000100:00100000:2.0:1787826968.663871:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134242432:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826968.683015:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134242432:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19138us (19410us total) trans 30064771268 rc 0/0 00000100:00100000:3.0:1787826968.683027:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 263 00002000:00100000:3.0:1787826968.683040:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (964689920->968884223) req@ffff8d534486fc00 x1874672134242432/t30064771268(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/448 e 0 to 0 dl 1787826979 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826968.683051:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486fc00 with x1874672134242432 ext(964689920->968884223) 00002000:00010000:3.0:1787826968.683057:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486fc00 00010000:00010000:2.0:1787826968.785439:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826968.908854:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826968.908924:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242560 00000100:00100000:1.0:1787826968.908934:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242560 00002000:00100000:1.0:1787826968.908983:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (968884224->973078527) req@ffff8d547d2b3840 x1874672134242560/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/0 e 0 to 0 dl 1787826979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826968.908994:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b3840 with x1874672134242560 ext(968884224->973078527) 00002000:00010000:1.0:1787826968.909000:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b3840 00000100:00100000:1.0:1787826968.909033:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 264 00000100:00100000:1.0:1787826968.909043:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134242560:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826968.924288:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134242560:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15233us (15427us total) trans 30064771269 rc 0/0 00000100:00100000:2.0:1787826968.924303:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 264 00002000:00100000:2.0:1787826968.924316:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (968884224->973078527) req@ffff8d547d2b3840 x1874672134242560/t30064771269(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:569/0 lens 488/448 e 0 to 0 dl 1787826979 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826968.924327:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d2b3840 with x1874672134242560 ext(968884224->973078527) 00002000:00010000:2.0:1787826968.924340:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d2b3840 00000100:00100000:0.0:1787826969.139943:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826969.140994:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242688 00000100:00100000:1.0:1787826969.141004:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242688 00000100:00080000:2.0:1787826969.141066:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787826969.141069:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (973078528->977272831) req@ffff8d5343ac7480 x1874672134242688/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/0 e 0 to 0 dl 1787826980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826969.141092:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343ac7480 with x1874672134242688 ext(973078528->977272831) 00002000:00010000:1.0:1787826969.141098:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343ac7480 00000100:00100000:1.0:1787826969.141132:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 265 00000100:00100000:1.0:1787826969.141143:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2390:x1874672134242688:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826969.154653:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2390:x1874672134242688:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13505us (14710us total) trans 30064771270 rc 0/0 00000100:00100000:1.0:1787826969.154665:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 265 00002000:00100000:1.0:1787826969.154677:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (973078528->977272831) req@ffff8d5343ac7480 x1874672134242688/t30064771270(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/448 e 0 to 0 dl 1787826980 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826969.154687:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343ac7480 with x1874672134242688 ext(973078528->977272831) 00002000:00010000:1.0:1787826969.154694:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343ac7480 00000100:00100000:1.0:1787826969.169415:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143755392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826969.169415:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143755264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826969.169496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826969.169552:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755392 00000100:00100000:3.0:1787826969.169559:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755392 00000100:00100000:0.0:1787826969.169568:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826969.169617:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826969.169624:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755264 00000100:00100000:3.0:1787826969.169629:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755264 00000100:00100000:0.0:1787826969.169653:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1787826969.169663:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826969.169669:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143755392:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826969.169676:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787826969.169687:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547faca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143755264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826969.169692:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3735552 granted 561665472 pending 73011200 free 2954113024 avail 2722590720 00002000:00000024:1.0:1787826969.169702:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3735552 granted 561665472 pending 73011200 free 2954113024 avail 2722590720 00000100:00100000:0.0:1787826969.169751:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143755392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826969.169759:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547faca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143755264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826969.169765:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787826969.169774:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787826969.169794:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143755392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826969.169802:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143755264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826969.371607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826969.371668:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242816 00000100:00100000:1.0:1787826969.371678:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242816 00002000:00100000:1.0:1787826969.371733:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (977272832->981467135) req@ffff8d534486f480 x1874672134242816/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/0 e 0 to 0 dl 1787826980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826969.371775:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486f480 with x1874672134242816 ext(977272832->981467135) 00002000:00010000:1.0:1787826969.371780:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486f480 00000100:00100000:1.0:1787826969.371812:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 266 00000100:00100000:1.0:1787826969.371830:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2391:x1874672134242816:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826969.384988:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2391:x1874672134242816:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13158us (13380us total) trans 30064771271 rc 0/0 00000100:00100000:1.0:1787826969.385002:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 266 00002000:00100000:1.0:1787826969.385015:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (977272832->981467135) req@ffff8d534486f480 x1874672134242816/t30064771271(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/448 e 0 to 0 dl 1787826980 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826969.385031:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486f480 with x1874672134242816 ext(977272832->981467135) 00002000:00010000:1.0:1787826969.385037:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486f480 00000100:00100000:3.0:1787826969.621796:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826969.621865:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134242944 00000100:00100000:0.0:1787826969.621875:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134242944 00002000:00100000:0.0:1787826969.621931:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (981467136->985661439) req@ffff8d534486d2c0 x1874672134242944/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/0 e 0 to 0 dl 1787826980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826969.621942:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486d2c0 with x1874672134242944 ext(981467136->985661439) 00002000:00010000:0.0:1787826969.621949:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486d2c0 00000100:00100000:0.0:1787826969.621988:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 267 00000100:00100000:0.0:1787826969.621999:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134242944:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826969.642015:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134242944:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20010us (20221us total) trans 30064771272 rc 0/0 00000100:00100000:3.0:1787826969.642044:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 267 00002000:00100000:3.0:1787826969.642056:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (981467136->985661439) req@ffff8d534486d2c0 x1874672134242944/t30064771272(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/448 e 0 to 0 dl 1787826980 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826969.642067:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486d2c0 with x1874672134242944 ext(981467136->985661439) 00002000:00010000:3.0:1787826969.642073:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486d2c0 00010000:00010000:2.0:1787826969.809367:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826969.861297:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826969.861394:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243072 00000100:00100000:2.0:1787826969.861404:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243072 00002000:00100000:2.0:1787826969.861449:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (985661440->989855743) req@ffff8d547facb480 x1874672134243072/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/0 e 0 to 0 dl 1787826980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826969.861459:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facb480 with x1874672134243072 ext(985661440->989855743) 00002000:00010000:2.0:1787826969.861474:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facb480 00000100:00100000:2.0:1787826969.861521:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 268 00000100:00100000:2.0:1787826969.861530:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134243072:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826969.879092:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134243072:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17553us (17792us total) trans 30064771273 rc 0/0 00000100:00100000:2.0:1787826969.879106:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 268 00002000:00100000:2.0:1787826969.879119:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (985661440->989855743) req@ffff8d547facb480 x1874672134243072/t30064771273(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:570/0 lens 488/448 e 0 to 0 dl 1787826980 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826969.879130:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547facb480 with x1874672134243072 ext(985661440->989855743) 00002000:00010000:2.0:1787826969.879149:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547facb480 00000100:00100000:1.0:1787826970.096275:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826970.096339:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243200 00000100:00100000:2.0:1787826970.096346:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243200 00002000:00100000:2.0:1787826970.096383:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (989855744->994050047) req@ffff8d547f7f3480 x1874672134243200/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/0 e 0 to 0 dl 1787826981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826970.096391:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f3480 with x1874672134243200 ext(989855744->994050047) 00002000:00010000:2.0:1787826970.096395:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f3480 00000100:00100000:2.0:1787826970.096416:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 269 00000100:00100000:2.0:1787826970.096422:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134243200:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826970.108308:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134243200:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11876us (12032us total) trans 30064771274 rc 0/0 00000100:00100000:1.0:1787826970.108319:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 269 00002000:00100000:1.0:1787826970.108329:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (989855744->994050047) req@ffff8d547f7f3480 x1874672134243200/t30064771274(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/448 e 0 to 0 dl 1787826981 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826970.108337:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f7f3480 with x1874672134243200 ext(989855744->994050047) 00002000:00010000:1.0:1787826970.108342:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f7f3480 00000100:00100000:0.0:1787826970.318574:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826970.318680:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243328 00000100:00100000:2.0:1787826970.318690:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243328 00002000:00100000:2.0:1787826970.318733:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (994050048->998244351) req@ffff8d547fac8000 x1874672134243328/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/0 e 0 to 0 dl 1787826981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826970.318745:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac8000 with x1874672134243328 ext(994050048->998244351) 00002000:00010000:2.0:1787826970.318751:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac8000 00000100:00100000:2.0:1787826970.318800:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 270 00000100:00100000:2.0:1787826970.318810:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134243328:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826970.334201:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134243328:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15385us (15628us total) trans 30064771275 rc 0/0 00000100:00100000:2.0:1787826970.334211:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 270 00002000:00100000:2.0:1787826970.334241:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (994050048->998244351) req@ffff8d547fac8000 x1874672134243328/t30064771275(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/448 e 0 to 0 dl 1787826981 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826970.334252:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fac8000 with x1874672134243328 ext(994050048->998244351) 00002000:00010000:2.0:1787826970.334259:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fac8000 00000001:00080000:3.0:1787826970.334928:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771275 is committed 00000100:00100000:3.0:1787826970.542466:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826970.542544:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243456 00000100:00100000:2.0:1787826970.542554:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243456 00002000:00100000:2.0:1787826970.542603:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (998244352->1002438655) req@ffff8d534486ed00 x1874672134243456/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/0 e 0 to 0 dl 1787826981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826970.542615:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486ed00 with x1874672134243456 ext(998244352->1002438655) 00002000:00010000:2.0:1787826970.542620:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486ed00 00000100:00100000:2.0:1787826970.542652:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 271 00000100:00100000:2.0:1787826970.542661:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134243456:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826970.558629:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134243456:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15952us (16155us total) trans 30064771276 rc 0/0 00000100:00100000:3.0:1787826970.558649:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 271 00002000:00100000:3.0:1787826970.558668:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (998244352->1002438655) req@ffff8d534486ed00 x1874672134243456/t30064771276(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/448 e 0 to 0 dl 1787826981 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826970.558677:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534486ed00 with x1874672134243456 ext(998244352->1002438655) 00002000:00010000:3.0:1787826970.558684:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534486ed00 00000100:00100000:2.0:1787826970.792054:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826970.792129:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243584 00000100:00100000:1.0:1787826970.792139:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243584 00002000:00100000:1.0:1787826970.792199:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1002438656->1006632959) req@ffff8d546f6a1a40 x1874672134243584/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/0 e 0 to 0 dl 1787826981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826970.792262:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a1a40 with x1874672134243584 ext(1002438656->1006632959) 00002000:00010000:1.0:1787826970.792268:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a1a40 00000100:00100000:1.0:1787826970.792297:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 272 00000100:00100000:1.0:1787826970.792308:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134243584:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826970.807830:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134243584:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15515us (15774us total) trans 30064771277 rc 0/0 00000100:00100000:2.0:1787826970.807844:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 272 00002000:00100000:2.0:1787826970.807856:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1002438656->1006632959) req@ffff8d546f6a1a40 x1874672134243584/t30064771277(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:571/0 lens 488/448 e 0 to 0 dl 1787826981 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826970.807881:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a1a40 with x1874672134243584 ext(1002438656->1006632959) 00002000:00010000:2.0:1787826970.807887:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a1a40 00010000:00010000:2.0:1787826970.833350:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826971.025332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826971.025372:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826971.025403:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826971.025440:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243840 00000100:00100000:1.0:1787826971.025450:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244096 00000100:00100000:0.0:1787826971.025451:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243840 00000100:00100000:1.0:1787826971.025456:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244096 00000100:00100000:2.0:1787826971.025485:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243712 00000100:00100000:2.0:1787826971.025490:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243712 00000100:00100000:1.0:1787826971.025522:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 352 00000100:00100000:0.0:1787826971.025524:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 511 00002000:00100000:2.0:1787826971.025531:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1006632960->1010827263) req@ffff8d547f81c000 x1874672134243712/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787826971.025532:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134244096:12345-192.168.203.6@tcp:400:kworker.0 00002000:00100000:2.0:1787826971.025545:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f81c000 with x1874672134243712 ext(1006632960->1010827263) 00002000:00010000:2.0:1787826971.025551:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f81c000 00000100:00100000:0.0:1787826971.025554:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134243840:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826971.025576:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 273 00000100:00100000:2.0:1787826971.025586:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134243712:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:3.0:1787826971.025601:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826971.025602:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134243840:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 50us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826971.025603:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134244096:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826971.025609:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826971.025620:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 511 00000100:00100000:1.0:1787826971.025621:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 352 00000100:00100000:3.0:1787826971.025663:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826971.025694:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134243968 00000100:00100000:3.0:1787826971.025699:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134243968 00000100:00080000:0.0:1787826971.025745:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826971.025754:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 353 00000100:00100000:3.0:1787826971.025765:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134243968:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826971.025857:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134243968:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826971.025876:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 353 00000100:00100000:2.0:1787826971.028895:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826971.029062:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244224 00000100:00100000:3.0:1787826971.029077:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244224 00002000:00100000:3.0:1787826971.029128:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (919064576->1010860031) req@ffff8d5341f60000 x1874672134244224/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 504/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826971.029140:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5341f60000 with x1874672134244224 ext(919064576->1010860031) 00002000:00010000:3.0:1787826971.029549:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5341f60000 00000100:00100000:3.0:1787826971.029597:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 274 00000100:00100000:3.0:1787826971.029607:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134244224:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826971.033884:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826971.033933:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826971.033942:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244352 00000100:00100000:1.0:1787826971.033955:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244352 00000100:00100000:2.0:1787826971.033959:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826971.033982:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244608 00000100:00100000:2.0:1787826971.033986:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244608 00002000:00100000:1.0:1787826971.034009:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1010860032->1010876415) req@ffff8d5343b0d680 x1874672134244352/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 16872/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826971.034011:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1010880512->1010884607) req@ffff8d546e16f480 x1874672134244608/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 4584/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826971.034024:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0d680 with x1874672134244352 ext(1010860032->1010876415) 00002000:00010000:1.0:1787826971.034032:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0d680 00002000:00100000:2.0:1787826971.034041:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16f480 with x1874672134244608 ext(1010880512->1010884607) 00002000:00010000:2.0:1787826971.034046:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16f480 00000100:00100000:1.0:1787826971.034057:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244480 00000100:00100000:1.0:1787826971.034061:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244480 00000100:00100000:2.0:1787826971.034072:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 275 00002000:00100000:1.0:1787826971.034078:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1010876416->1010880511) req@ffff8d5343b121c0 x1874672134244480/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 4584/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787826971.034086:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2390:x1874672134244352:12345-192.168.203.6@tcp:4:iozone.0 00002000:00100000:1.0:1787826971.034117:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b121c0 with x1874672134244480 ext(1010876416->1010880511) 00002000:00010000:1.0:1787826971.034121:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b121c0 00000100:00100000:1.0:1787826971.034140:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 276 00000100:00100000:1.0:1787826971.034148:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2390:x1874672134244608:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826971.034513:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 277 00000100:00100000:2.0:1787826971.034522:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134244480:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826971.034961:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2390:x1874672134244352:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 876us (1083us total) trans 30064771279 rc 0/0 00000100:00100000:1.0:1787826971.034962:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2390:x1874672134244608:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 811us (1025us total) trans 30064771278 rc 0/0 00000100:00100000:1.0:1787826971.034977:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 276 00002000:00100000:1.0:1787826971.034988:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1010880512->1010884607) req@ffff8d546e16f480 x1874672134244608/t30064771278(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 4584/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826971.034998:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16f480 with x1874672134244608 ext(1010880512->1010884607) 00002000:00010000:1.0:1787826971.035002:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16f480 00000100:00100000:2.0:1787826971.035084:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 275 00002000:00100000:2.0:1787826971.035092:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1010860032->1010876415) req@ffff8d5343b0d680 x1874672134244352/t30064771279(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 16872/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826971.035101:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0d680 with x1874672134244352 ext(1010860032->1010876415) 00002000:00010000:2.0:1787826971.035105:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0d680 00000100:00100000:1.0:1787826971.035391:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134244480:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 870us (1433us total) trans 30064771280 rc 0/0 00000100:00100000:1.0:1787826971.035399:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 277 00002000:00100000:1.0:1787826971.035405:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (1010876416->1010880511) req@ffff8d5343b121c0 x1874672134244480/t30064771280(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 4584/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826971.035414:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b121c0 with x1874672134244480 ext(1010876416->1010880511) 00002000:00010000:1.0:1787826971.035418:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b121c0 00000100:00100000:3.0:1787826971.042388:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134243712:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16797us (17055us total) trans 30064771281 rc 0/0 00000100:00100000:3.0:1787826971.042402:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 273 00002000:00100000:3.0:1787826971.042416:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1006632960->1010827263) req@ffff8d547f81c000 x1874672134243712/t30064771281(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826971.042427:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f81c000 with x1874672134243712 ext(1006632960->1010827263) 00002000:00010000:3.0:1787826971.042433:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f81c000 00000100:00100000:2.0:1787826971.053752:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134244224:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24136us (24853us total) trans 30064771282 rc 0/0 00000100:00100000:2.0:1787826971.053766:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 274 00002000:00100000:2.0:1787826971.053787:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (919064576->1010860031) req@ffff8d5341f60000 x1874672134244224/t30064771282(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 504/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826971.053798:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5341f60000 with x1874672134244224 ext(919064576->1010860031) 00002000:00010000:2.0:1787826971.053805:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5341f60000 00000100:00100000:2.0:1787826971.505332:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826971.505389:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244736 00000100:00100000:1.0:1787826971.505398:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244736 00002000:00100000:1.0:1787826971.505450:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1015021568->1019215871) req@ffff8d5344bd4000 x1874672134244736/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826971.505495:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd4000 with x1874672134244736 ext(1015021568->1019215871) 00002000:00010000:1.0:1787826971.505507:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd4000 00000100:00100000:1.0:1787826971.505540:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 278 00000100:00100000:1.0:1787826971.505547:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2391:x1874672134244736:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826971.521993:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2391:x1874672134244736:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16436us (16659us total) trans 30064771283 rc 0/0 00000100:00100000:2.0:1787826971.522005:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 278 00002000:00100000:2.0:1787826971.522016:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1015021568->1019215871) req@ffff8d5344bd4000 x1874672134244736/t30064771283(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826971.522041:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd4000 with x1874672134244736 ext(1015021568->1019215871) 00002000:00010000:2.0:1787826971.522048:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd4000 00000100:00100000:1.0:1787826971.729634:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143755776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826971.729655:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143755648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826971.729709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826971.729733:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143755520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826971.729770:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826971.729908:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755520 00000100:00100000:1.0:1787826971.729917:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755776 00000100:00100000:0.0:1787826971.729921:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755520 00000100:00100000:1.0:1787826971.729924:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755776 00000100:00100000:0.0:1787826971.730021:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787826971.730033:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143755520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826971.730044:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787826971.730054:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143755776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826971.730061:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787826971.730068:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826971.730127:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143755776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826971.730133:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:1.0:1787826971.730173:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9de940 x1874672143755776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826971.730190:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143755776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826971.730285:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787826971.730343:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533e52c0 x1874672143755520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826971.730357:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143755520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826971.730378:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755648 00000100:00100000:3.0:1787826971.730383:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755648 00000100:00100000:3.0:1787826971.730416:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787826971.730423:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143755648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826971.730454:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826971.730503:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143755648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826971.730509:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787826971.730530:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143755648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826971.730577:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143755520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 547us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826971.730584:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1787826971.730637:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826971.735306:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826971.735349:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244864 00000100:00100000:1.0:1787826971.735369:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244864 00002000:00100000:1.0:1787826971.735412:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1019215872->1023410175) req@ffff8d54533e5e00 x1874672134244864/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826971.735420:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d54533e5e00 with x1874672134244864 ext(1019215872->1023410175) 00002000:00010000:1.0:1787826971.735424:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d54533e5e00 00000100:00100000:1.0:1787826971.735446:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 279 00000100:00100000:1.0:1787826971.735453:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134244864:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826971.746586:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134244864:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11125us (11281us total) trans 30064771284 rc 0/0 00000100:00100000:3.0:1787826971.746597:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 279 00002000:00100000:3.0:1787826971.746607:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1019215872->1023410175) req@ffff8d54533e5e00 x1874672134244864/t30064771284(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826971.746614:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d54533e5e00 with x1874672134244864 ext(1019215872->1023410175) 00002000:00010000:3.0:1787826971.746619:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d54533e5e00 00010000:00010000:0.0:1787826971.857877:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826971.981304:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826971.981568:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134244992 00000100:00100000:2.0:1787826971.981578:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134244992 00002000:00100000:2.0:1787826971.981629:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1023410176->1027604479) req@ffff8d547f81d680 x1874672134244992/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/0 e 0 to 0 dl 1787826982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826971.981640:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f81d680 with x1874672134244992 ext(1023410176->1027604479) 00002000:00010000:2.0:1787826971.981645:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f81d680 00000100:00100000:2.0:1787826971.981674:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 280 00000100:00100000:2.0:1787826971.981684:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134244992:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826971.996522:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134244992:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14825us (15211us total) trans 30064771285 rc 0/0 00000100:00100000:2.0:1787826971.996536:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 280 00002000:00100000:2.0:1787826971.996548:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1023410176->1027604479) req@ffff8d547f81d680 x1874672134244992/t30064771285(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:572/0 lens 488/448 e 0 to 0 dl 1787826982 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826971.996558:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f81d680 with x1874672134244992 ext(1023410176->1027604479) 00002000:00010000:2.0:1787826971.996564:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f81d680 00000100:00100000:1.0:1787826972.201437:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826972.201516:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134245120 00000100:00100000:3.0:1787826972.201526:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134245120 00002000:00100000:3.0:1787826972.201575:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1027604480->1031798783) req@ffff8d5343474b40 x1874672134245120/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/0 e 0 to 0 dl 1787826983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826972.201587:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343474b40 with x1874672134245120 ext(1027604480->1031798783) 00002000:00010000:3.0:1787826972.201592:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343474b40 00000100:00100000:3.0:1787826972.201625:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 281 00000100:00100000:3.0:1787826972.201635:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134245120:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826972.214835:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134245120:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13194us (13409us total) trans 30064771286 rc 0/0 00000100:00100000:2.0:1787826972.214847:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 281 00002000:00100000:2.0:1787826972.214867:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1027604480->1031798783) req@ffff8d5343474b40 x1874672134245120/t30064771286(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/448 e 0 to 0 dl 1787826983 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826972.214895:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343474b40 with x1874672134245120 ext(1027604480->1031798783) 00002000:00010000:2.0:1787826972.214902:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343474b40 00000100:00100000:0.0:1787826972.241413:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826972.241438:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143756288:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.241439:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143756032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.241449:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143756416:0@lo:400:kworker.0 00000100:00100000:0.0:1787826972.241520:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826972.241527:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143756160:0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.241527:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826972.241547:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756288 00000100:00100000:2.0:1787826972.241555:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756288 00000100:00100000:1.0:1787826972.241568:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826972.241588:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143755904:0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.241596:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143756928:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.241601:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349266580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143756672:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.241610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787826972.241618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826972.241623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143756288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.241648:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826972.241649:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143756800:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.241656:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826972.241684:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143757440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.241688:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143757184:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.241694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143756288:12345-0@lo:400:kworker.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826972.241703:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826972.241707:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787826972.241727:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826972.241730:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756928 00000100:00100000:1.0:1787826972.241735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826972.241736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756928 00000100:00100000:0.0:1787826972.241737:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143757312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.241765:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826972.241774:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756416 00000100:00100000:1.0:1787826972.241775:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143756544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.241780:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756416 00000100:00100000:2.0:1787826972.241781:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756800 00000100:00100000:2.0:1787826972.241786:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756800 00000100:00100000:0.0:1787826972.241792:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826972.241810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757440 00000100:00100000:2.0:1787826972.241815:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757440 00000100:00100000:3.0:1787826972.241822:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756160 00000100:00100000:1.0:1787826972.241828:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826972.241829:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143756288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.241836:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757312 00000100:00100000:3.0:1787826972.241836:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756160 00000100:00100000:2.0:1787826972.241842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757312 00000100:00100000:1.0:1787826972.241859:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143757056:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.241868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787826972.241873:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143755904 00000100:00100000:0.0:1787826972.241879:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143755904 00000100:00100000:2.0:1787826972.241882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143756928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.241882:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787826972.241891:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826972.241897:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143756416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826972.241920:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1787826972.241931:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143755904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.241937:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787826972.241939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143756928:12345-0@lo:400:kworker.0 Request processed in 62us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826972.241950:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787826972.241955:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143756160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.241955:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143756416:12345-0@lo:400:kworker.0 Request processed in 57us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826972.241976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787826972.241977:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787826972.241978:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143755904:12345-0@lo:400:kworker.0 Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826972.241989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143756800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826972.241990:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1787826972.242011:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787826972.242017:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143756160:12345-0@lo:400:kworker.0 Request processed in 69us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826972.242025:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143757440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.242037:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787826972.242042:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143756800:12345-0@lo:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826972.242050:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143756800:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.242064:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787826972.242072:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143755904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.242073:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787826972.242085:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143757440:12345-0@lo:400:kworker.0 Request processed in 62us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826972.242089:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143757312:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826972.242089:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826972.242096:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826972.242106:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787826972.242123:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756672 00000100:00100000:0.0:1787826972.242129:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756672 00000100:00100000:3.0:1787826972.242135:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757184 00000100:00100000:3.0:1787826972.242141:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757184 00000100:00100000:2.0:1787826972.242146:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756544 00000100:00100000:2.0:1787826972.242151:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756544 00000100:00100000:1.0:1787826972.242153:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143757312:12345-0@lo:400:kworker.0 Request processed in 69us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826972.242162:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787826972.242166:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757056 00000100:00100000:0.0:1787826972.242171:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757056 00000100:00100000:3.0:1787826972.242185:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787826972.242198:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787826972.242200:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143756672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.242211:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143757184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.242233:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787826972.242241:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787826972.242244:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143756544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826972.242255:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143757056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.242272:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143756672:12345-0@lo:400:kworker.0 Request processed in 77us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826972.242280:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787826972.242308:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143756544:12345-0@lo:400:kworker.0 Request processed in 67us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826972.242315:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143757056:12345-0@lo:400:kworker.0 Request processed in 62us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826972.242318:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143757184:12345-0@lo:400:kworker.0 Request processed in 108us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826972.242334:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00010000:00080000:3.0:1787826972.242334:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dd680 x1874672143756928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826972.242349:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787826972.242350:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143756928:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.242358:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00080000:3.0:1787826972.242371:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534355cf00 x1874672143757440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826972.242372:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826972.242384:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143757440:0@lo:400:kworker.0 00000100:00100000:0.0:1787826972.242385:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826972.242404:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143756544:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.242409:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143756032 00000100:00100000:2.0:1787826972.242414:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143756032 00000100:00100000:1.0:1787826972.242424:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143757056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826972.242438:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143756416:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.242446:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143756160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826972.242452:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143757312:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.242452:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787826972.242478:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143756032:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826972.242480:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5349266580 x1874672143756672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826972.242493:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349266580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143756672:0@lo:400:kworker.0 00010000:00080000:1.0:1787826972.242510:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e12c0 x1874672143757184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826972.242519:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143756032:12345-0@lo:400:kworker.0 Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826972.242523:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143757184:0@lo:400:kworker.0 00000100:00100000:2.0:1787826972.242528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787826972.242544:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143756032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826972.425477:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826972.425539:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134245248 00000100:00100000:2.0:1787826972.425547:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134245248 00002000:00100000:2.0:1787826972.425599:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1031798784->1035993087) req@ffff8d547fbe0f00 x1874672134245248/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/0 e 0 to 0 dl 1787826983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826972.425611:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe0f00 with x1874672134245248 ext(1031798784->1035993087) 00002000:00010000:2.0:1787826972.425617:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe0f00 00000100:00100000:2.0:1787826972.425645:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 282 00000100:00100000:2.0:1787826972.425660:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134245248:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826972.440946:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134245248:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15286us (15480us total) trans 30064771287 rc 0/0 00000100:00100000:1.0:1787826972.440971:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 282 00002000:00100000:1.0:1787826972.440984:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1031798784->1035993087) req@ffff8d547fbe0f00 x1874672134245248/t30064771287(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/448 e 0 to 0 dl 1787826983 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826972.440993:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe0f00 with x1874672134245248 ext(1031798784->1035993087) 00002000:00010000:1.0:1787826972.440998:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe0f00 00000100:00100000:0.0:1787826972.649687:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826972.649801:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134245376 00000100:00100000:3.0:1787826972.649813:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134245376 00002000:00100000:3.0:1787826972.649874:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1035993088->1040187391) req@ffff8d547f9e12c0 x1874672134245376/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/0 e 0 to 0 dl 1787826983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826972.649884:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e12c0 with x1874672134245376 ext(1035993088->1040187391) 00002000:00010000:3.0:1787826972.649889:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e12c0 00000100:00100000:3.0:1787826972.649927:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 283 00000100:00100000:3.0:1787826972.649934:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134245376:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826972.662450:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134245376:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12503us (12764us total) trans 30064771288 rc 0/0 00000100:00100000:2.0:1787826972.662477:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 283 00002000:00100000:2.0:1787826972.662494:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1035993088->1040187391) req@ffff8d547f9e12c0 x1874672134245376/t30064771288(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/448 e 0 to 0 dl 1787826983 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826972.662507:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e12c0 with x1874672134245376 ext(1035993088->1040187391) 00002000:00010000:2.0:1787826972.662514:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e12c0 00000100:00100000:1.0:1787826972.753447:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143757568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826972.753555:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826972.753610:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757568 00000100:00100000:3.0:1787826972.753621:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757568 00000100:00100000:3.0:1787826972.753694:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787826972.753706:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143757568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826972.753751:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826972.753821:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143757568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826972.753830:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787826972.753927:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143757568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826972.880719:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826972.880829:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134245504 00000100:00100000:1.0:1787826972.880846:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134245504 00002000:00100000:1.0:1787826972.880923:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (1040187392->1044381695) req@ffff8d547f9e2940 x1874672134245504/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/0 e 0 to 0 dl 1787826983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826972.880936:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e2940 with x1874672134245504 ext(1040187392->1044381695) 00002000:00010000:1.0:1787826972.880950:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e2940 00000100:00100000:1.0:1787826972.880998:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 284 00000100:00100000:1.0:1787826972.881011:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134245504:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787826972.881330:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826972.895822:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134245504:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14792us (15090us total) trans 30064771289 rc 0/0 00000100:00100000:1.0:1787826972.895845:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 284 00002000:00100000:1.0:1787826972.895865:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (1040187392->1044381695) req@ffff8d547f9e2940 x1874672134245504/t30064771289(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:573/0 lens 488/448 e 0 to 0 dl 1787826983 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826972.895879:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e2940 with x1874672134245504 ext(1040187392->1044381695) 00002000:00010000:1.0:1787826972.895903:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e2940 00000100:00100000:0.0:1787826973.101847:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826973.101920:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134245632 00000100:00100000:2.0:1787826973.101932:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134245632 00000100:00080000:0.0:1787826973.101993:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826973.102013:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (1044381696->1048575999) req@ffff8d5344bd7480 x1874672134245632/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/0 e 0 to 0 dl 1787826984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826973.102026:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd7480 with x1874672134245632 ext(1044381696->1048575999) 00002000:00010000:2.0:1787826973.102031:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd7480 00000100:00100000:2.0:1787826973.102078:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 285 00000100:00100000:2.0:1787826973.102091:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134245632:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826973.120315:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134245632:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18213us (18470us total) trans 30064771290 rc 0/0 00000100:00100000:1.0:1787826973.120331:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 285 00002000:00100000:1.0:1787826973.120345:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (1044381696->1048575999) req@ffff8d5344bd7480 x1874672134245632/t30064771290(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/448 e 0 to 0 dl 1787826984 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826973.120355:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd7480 with x1874672134245632 ext(1044381696->1048575999) 00002000:00010000:1.0:1787826973.120362:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd7480 00000100:00100000:2.0:1787826973.332883:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826973.332946:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134245760 00000100:00100000:1.0:1787826973.332957:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134245760 00002000:00100000:1.0:1787826973.333009:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1048576000->1052770303) req@ffff8d534355c3c0 x1874672134245760/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/0 e 0 to 0 dl 1787826984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826973.333017:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355c3c0 with x1874672134245760 ext(1048576000->1052770303) 00002000:00010000:1.0:1787826973.333023:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355c3c0 00000100:00100000:1.0:1787826973.333052:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 286 00000100:00100000:1.0:1787826973.333060:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134245760:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826973.347106:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134245760:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14035us (14222us total) trans 30064771291 rc 0/0 00000100:00100000:1.0:1787826973.347123:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 286 00002000:00100000:1.0:1787826973.347138:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1048576000->1052770303) req@ffff8d534355c3c0 x1874672134245760/t30064771291(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/448 e 0 to 0 dl 1787826984 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826973.347149:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355c3c0 with x1874672134245760 ext(1048576000->1052770303) 00002000:00010000:1.0:1787826973.347156:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355c3c0 00000100:00100000:2.0:1787826973.556554:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826973.556615:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134245888 00000100:00100000:1.0:1787826973.556634:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134245888 00002000:00100000:1.0:1787826973.556693:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1052770304->1056964607) req@ffff8d534355e940 x1874672134245888/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/0 e 0 to 0 dl 1787826984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826973.556704:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355e940 with x1874672134245888 ext(1052770304->1056964607) 00002000:00010000:1.0:1787826973.556709:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355e940 00000100:00100000:1.0:1787826973.556734:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 287 00000100:00100000:1.0:1787826973.556744:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2390:x1874672134245888:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826973.569090:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2390:x1874672134245888:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12338us (12535us total) trans 30064771292 rc 0/0 00000100:00100000:2.0:1787826973.569103:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 287 00002000:00100000:2.0:1787826973.569113:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1052770304->1056964607) req@ffff8d534355e940 x1874672134245888/t30064771292(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/448 e 0 to 0 dl 1787826984 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826973.569132:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355e940 with x1874672134245888 ext(1052770304->1056964607) 00002000:00010000:2.0:1787826973.569137:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355e940 00000100:00100000:2.0:1787826973.774831:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826973.774948:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134246016 00000100:00100000:0.0:1787826973.774962:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134246016 00002000:00100000:0.0:1787826973.775016:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1056964608->1061158911) req@ffff8d534355e1c0 x1874672134246016/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/0 e 0 to 0 dl 1787826984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826973.775025:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355e1c0 with x1874672134246016 ext(1056964608->1061158911) 00002000:00010000:0.0:1787826973.775031:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355e1c0 00000100:00100000:0.0:1787826973.775065:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 288 00000100:00100000:0.0:1787826973.775075:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2391:x1874672134246016:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826973.791066:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2391:x1874672134246016:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15983us (16241us total) trans 30064771293 rc 0/0 00000100:00100000:1.0:1787826973.791080:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 288 00002000:00100000:1.0:1787826973.791093:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1056964608->1061158911) req@ffff8d534355e1c0 x1874672134246016/t30064771293(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:574/0 lens 488/448 e 0 to 0 dl 1787826984 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826973.791104:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355e1c0 with x1874672134246016 ext(1056964608->1061158911) 00002000:00010000:1.0:1787826973.791111:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355e1c0 00010000:00010000:2.0:1787826973.905436:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826974.000975:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826974.001036:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134246144 00000100:00100000:2.0:1787826974.001044:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134246144 00002000:00100000:2.0:1787826974.001086:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1061158912->1065353215) req@ffff8d5344bd5a40 x1874672134246144/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/0 e 0 to 0 dl 1787826985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826974.001098:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd5a40 with x1874672134246144 ext(1061158912->1065353215) 00002000:00010000:2.0:1787826974.001103:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd5a40 00000100:00100000:2.0:1787826974.001134:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 289 00000100:00100000:2.0:1787826974.001144:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2390:x1874672134246144:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826974.012456:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2390:x1874672134246144:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11296us (11472us total) trans 30064771294 rc 0/0 00000100:00100000:3.0:1787826974.012469:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 289 00002000:00100000:3.0:1787826974.012479:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1061158912->1065353215) req@ffff8d5344bd5a40 x1874672134246144/t30064771294(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/448 e 0 to 0 dl 1787826985 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826974.012486:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd5a40 with x1874672134246144 ext(1061158912->1065353215) 00002000:00010000:3.0:1787826974.012490:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd5a40 00000100:00100000:0.0:1787826974.238279:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826974.238355:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134246272 00000100:00100000:2.0:1787826974.238376:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134246272 00002000:00100000:2.0:1787826974.238425:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1065353216->1069547519) req@ffff8d5344bd6580 x1874672134246272/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/0 e 0 to 0 dl 1787826985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826974.238437:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd6580 with x1874672134246272 ext(1065353216->1069547519) 00002000:00010000:2.0:1787826974.238441:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd6580 00000100:00100000:2.0:1787826974.238488:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 290 00000100:00100000:2.0:1787826974.238498:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2391:x1874672134246272:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826974.252127:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2391:x1874672134246272:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13620us (13846us total) trans 30064771295 rc 0/0 00000100:00100000:1.0:1787826974.252140:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 290 00002000:00100000:1.0:1787826974.252153:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1065353216->1069547519) req@ffff8d5344bd6580 x1874672134246272/t30064771295(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/448 e 0 to 0 dl 1787826985 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826974.252162:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5344bd6580 with x1874672134246272 ext(1065353216->1069547519) 00002000:00010000:1.0:1787826974.252168:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5344bd6580 00000100:00100000:3.0:1787826974.289381:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826974.289382:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349266580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143757824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826974.289410:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143757696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826974.289469:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826974.289527:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757824 00000100:00100000:3.0:1787826974.289536:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757824 00000100:00080000:2.0:1787826974.289588:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826974.289611:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787826974.289612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826974.289631:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143757824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826974.289676:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4198400 granted 560481728 pending 71364608 free 2879070208 avail 2647547904 00000100:00100000:1.0:1787826974.289704:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757696 00000100:00100000:1.0:1787826974.289709:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757696 00000100:00080000:2.0:1787826974.289727:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826974.289733:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143757824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826974.289740:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787826974.289745:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 3 min 2 max 16 00000100:00100000:1.0:1787826974.289749:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349265680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143757696:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826974.289751:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787826974.289759:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_003' 00002000:00000024:1.0:1787826974.289762:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4198400 granted 560481728 pending 71364608 free 2879070208 avail 2647547904 00000100:00100000:0.0:1787826974.289827:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349266580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143757824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826974.289965:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349265680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143757696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 213us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826974.289972:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787826974.290015:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143757696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826974.474868:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826974.474922:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826974.474965:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134246528 00000100:00100000:1.0:1787826974.474978:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134246528 00000100:00100000:3.0:1787826974.475000:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134246400 00000100:00100000:3.0:1787826974.475010:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134246400 00002000:00100000:1.0:1787826974.475037:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1010884608->1015021567) req@ffff8d534355e580 x1874672134246528/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/0 e 0 to 0 dl 1787826985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826974.475046:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355e580 with x1874672134246528 ext(1010884608->1015021567) 00002000:00010000:1.0:1787826974.475050:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355e580 00002000:00100000:3.0:1787826974.475057:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1069547520->1073741823) req@ffff8d534355c000 x1874672134246400/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/0 e 0 to 0 dl 1787826985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826974.475074:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355c000 with x1874672134246400 ext(1069547520->1073741823) 00002000:00010000:3.0:1787826974.475081:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355c000 00000100:00100000:1.0:1787826974.475098:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 291 00000100:00100000:1.0:1787826974.475112:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+47:2391:x1874672134246528:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826974.475121:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 292 00000100:00100000:3.0:1787826974.475131:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+47:2390:x1874672134246400:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826974.490112:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2391:x1874672134246528:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14997us (15247us total) trans 30064771296 rc 0/0 00000100:00100000:1.0:1787826974.490126:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 291 00002000:00100000:1.0:1787826974.490136:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1010884608->1015021567) req@ffff8d534355e580 x1874672134246528/t30064771296(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/448 e 0 to 0 dl 1787826985 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826974.490144:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355e580 with x1874672134246528 ext(1010884608->1015021567) 00002000:00010000:1.0:1787826974.490149:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355e580 00000100:00100000:3.0:1787826974.493244:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2390:x1874672134246400:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18108us (18316us total) trans 30064771297 rc 0/0 00000100:00100000:3.0:1787826974.493255:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 292 00002000:00100000:3.0:1787826974.493264:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1069547520->1073741823) req@ffff8d534355c000 x1874672134246400/t30064771297(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/448 e 0 to 0 dl 1787826985 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826974.493271:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534355c000 with x1874672134246400 ext(1069547520->1073741823) 00002000:00010000:3.0:1787826974.493275:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534355c000 00000100:00100000:2.0:1787826974.495161:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826974.495195:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134246656 00000100:00100000:3.0:1787826974.495202:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134246656 00000100:00100000:3.0:1787826974.495257:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 195 00000100:00100000:1.0:1787826974.495308:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134246656:12345-192.168.203.6@tcp:16:iozone.0 00000001:00080000:3.0:1787826974.496007:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771297 is committed 00000100:00100000:1.0:1787826974.496163:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134246656:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 897us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826974.496170:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 195 00000100:00100000:0.0:1787826974.501798:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826974.501852:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134246912 00000100:00100000:2.0:1787826974.501860:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134246912 00000100:00080000:0.0:1787826974.501909:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826974.501916:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 138 00000100:00100000:2.0:1787826974.501924:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349266580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:18296:x1874672134246912:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:2.0:1787826974.501939:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826974.501981:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a79542ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675bc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502050:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502061:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502070:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502098:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502106:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502114:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502250:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79542e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502276:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79542e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502292:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79542e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826974.502303:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 0 00010000:00010000:2.0:1787826974.502395:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502404:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502410:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502414:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826974.502416:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502421:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502430:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787826974.502432:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826974.502435:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502439:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2000/0xc0fefc09a79542d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502463:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502479:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502484:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502488:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787826974.502491:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502497:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502505:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428e3000) 00010000:00010000:2.0:1787826974.502507:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826974.502510:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502515:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a79542dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502552:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a79542ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675bc expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502564:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79542e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675bc expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826974.502571:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:2.0:1787826974.502574:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826974.502582:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2400, rc 0) 00000100:00100000:2.0:1787826974.502648:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349266580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:18296:x1874672134246912:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 719us (851us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1787826974.502656:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 138 00000100:00100000:2.0:1787826974.503880:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826974.503920:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134247168 00000100:00100000:0.0:1787826974.503926:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134247168 00000100:00100000:0.0:1787826974.503961:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:0.0:1787826974.503969:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:18296:x1874672134247168:12345-192.168.203.6@tcp:35:iozone.0 00000001:00080000:0.0:1787826974.504102:0:16787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1787826974.504177:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:18296:x1874672134247168:12345-192.168.203.6@tcp:35:iozone.0 Request processed in 208us (297us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787826974.504185:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 38 00000020:00080000:0.0:1787826974.504197:0:16787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826974.505195:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826974.505257:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134247296 00000100:00100000:2.0:1787826974.505264:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134247296 00000100:00100000:2.0:1787826974.505300:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 196 00000100:00100000:2.0:1787826974.505305:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134247296:12345-192.168.203.6@tcp:16:iozone.0 00000100:00100000:2.0:1787826974.505355:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134247296:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826974.505361:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 196 00000100:00100000:1.0:1787826974.716598:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826974.716658:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134247424 00000100:00100000:2.0:1787826974.716668:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134247424 00002000:00100000:2.0:1787826974.716715:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (0->4194303) req@ffff8d547fbe2940 x1874672134247424/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/0 e 0 to 0 dl 1787826985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826974.716723:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe2940 with x1874672134247424 ext(0->4194303) 00002000:00010000:2.0:1787826974.716728:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe2940 00000100:00100000:2.0:1787826974.716753:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 293 00000100:00100000:2.0:1787826974.716761:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134247424:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826974.729190:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134247424:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12412us (12581us total) trans 30064771298 rc 0/0 00000100:00100000:2.0:1787826974.729204:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 293 00002000:00100000:2.0:1787826974.729238:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (0->4194303) req@ffff8d547fbe2940 x1874672134247424/t30064771298(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/448 e 0 to 0 dl 1787826985 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826974.729285:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe2940 with x1874672134247424 ext(0->4194303) 00002000:00010000:2.0:1787826974.729291:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe2940 00010000:00010000:2.0:1787826974.929504:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826974.942865:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826974.943052:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134247552 00000100:00100000:1.0:1787826974.943061:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134247552 00002000:00100000:1.0:1787826974.943105:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (4194304->8388607) req@ffff8d547fa6bc00 x1874672134247552/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/0 e 0 to 0 dl 1787826985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826974.943116:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6bc00 with x1874672134247552 ext(4194304->8388607) 00002000:00010000:1.0:1787826974.943122:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6bc00 00000100:00100000:1.0:1787826974.943156:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 294 00000100:00100000:1.0:1787826974.943166:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134247552:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826974.966828:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134247552:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23654us (23962us total) trans 30064771299 rc 0/0 00000100:00100000:2.0:1787826974.966851:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 294 00002000:00100000:2.0:1787826974.966865:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (4194304->8388607) req@ffff8d547fa6bc00 x1874672134247552/t30064771299(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:575/0 lens 488/448 e 0 to 0 dl 1787826985 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826974.966875:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa6bc00 with x1874672134247552 ext(4194304->8388607) 00002000:00010000:2.0:1787826974.966880:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa6bc00 00000100:00100000:3.0:1787826975.178546:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826975.178618:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134247680 00000100:00100000:2.0:1787826975.178628:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134247680 00002000:00100000:2.0:1787826975.178695:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (8388608->12582911) req@ffff8d5343b5a580 x1874672134247680/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/0 e 0 to 0 dl 1787826986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826975.178706:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5a580 with x1874672134247680 ext(8388608->12582911) 00002000:00010000:2.0:1787826975.178712:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5a580 00000100:00100000:2.0:1787826975.178744:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 295 00000100:00100000:2.0:1787826975.178754:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134247680:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:0.0:1787826975.178816:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826975.192937:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134247680:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14174us (14394us total) trans 30064771300 rc 0/0 00000100:00100000:2.0:1787826975.192951:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 295 00002000:00100000:2.0:1787826975.192969:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (8388608->12582911) req@ffff8d5343b5a580 x1874672134247680/t30064771300(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/448 e 0 to 0 dl 1787826986 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826975.192993:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b5a580 with x1874672134247680 ext(8388608->12582911) 00002000:00010000:2.0:1787826975.192997:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b5a580 00000100:00100000:1.0:1787826975.396129:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826975.396278:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134247808 00000100:00100000:2.0:1787826975.396292:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134247808 00002000:00100000:2.0:1787826975.396345:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (12582912->16777215) req@ffff8d547fbe1680 x1874672134247808/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/0 e 0 to 0 dl 1787826986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826975.396373:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe1680 with x1874672134247808 ext(12582912->16777215) 00002000:00010000:2.0:1787826975.396379:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe1680 00000100:00100000:2.0:1787826975.396413:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 296 00000100:00100000:2.0:1787826975.396427:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134247808:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826975.414605:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134247808:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18173us (18476us total) trans 30064771301 rc 0/0 00000100:00100000:2.0:1787826975.414619:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 296 00002000:00100000:2.0:1787826975.414632:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (12582912->16777215) req@ffff8d547fbe1680 x1874672134247808/t30064771301(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/448 e 0 to 0 dl 1787826986 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826975.414650:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe1680 with x1874672134247808 ext(12582912->16777215) 00002000:00010000:2.0:1787826975.414657:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe1680 00000100:00100000:1.0:1787826975.636851:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826975.636912:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134247936 00000100:00100000:3.0:1787826975.636921:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134247936 00002000:00100000:3.0:1787826975.636967:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (16777216->20971519) req@ffff8d547fbe1e00 x1874672134247936/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/0 e 0 to 0 dl 1787826986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826975.636979:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe1e00 with x1874672134247936 ext(16777216->20971519) 00002000:00010000:3.0:1787826975.636983:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe1e00 00000100:00100000:3.0:1787826975.637013:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 297 00000100:00100000:3.0:1787826975.637024:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134247936:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826975.651050:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134247936:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14021us (14200us total) trans 30064771302 rc 0/0 00000100:00100000:2.0:1787826975.651062:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 297 00002000:00100000:2.0:1787826975.651073:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (16777216->20971519) req@ffff8d547fbe1e00 x1874672134247936/t30064771302(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/448 e 0 to 0 dl 1787826986 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826975.651100:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe1e00 with x1874672134247936 ext(16777216->20971519) 00002000:00010000:2.0:1787826975.651107:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe1e00 00000100:00100000:1.0:1787826975.868309:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826975.868430:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248064 00000100:00100000:2.0:1787826975.868450:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248064 00002000:00100000:2.0:1787826975.868494:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (20971520->25165823) req@ffff8d547fbe3c00 x1874672134248064/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/0 e 0 to 0 dl 1787826986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826975.868504:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe3c00 with x1874672134248064 ext(20971520->25165823) 00002000:00010000:2.0:1787826975.868509:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe3c00 00000100:00100000:1.0:1787826975.868681:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 298 00000100:00100000:1.0:1787826975.868694:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134248064:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826975.881347:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134248064:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12648us (13037us total) trans 30064771303 rc 0/0 00000100:00100000:2.0:1787826975.881361:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 298 00002000:00100000:2.0:1787826975.881378:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (20971520->25165823) req@ffff8d547fbe3c00 x1874672134248064/t30064771303(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:576/0 lens 488/448 e 0 to 0 dl 1787826986 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826975.881390:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe3c00 with x1874672134248064 ext(20971520->25165823) 00002000:00010000:2.0:1787826975.881404:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe3c00 00010000:00010000:0.0:1787826975.953400:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826976.097581:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826976.097651:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248192 00000100:00100000:1.0:1787826976.097666:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248192 00002000:00100000:1.0:1787826976.097734:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (25165824->29360127) req@ffff8d547d36e940 x1874672134248192/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/0 e 0 to 0 dl 1787826987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826976.097744:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d36e940 with x1874672134248192 ext(25165824->29360127) 00002000:00010000:1.0:1787826976.097749:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d36e940 00000100:00100000:1.0:1787826976.097783:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 299 00000100:00100000:1.0:1787826976.097806:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134248192:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826976.111263:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134248192:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13445us (13686us total) trans 30064771304 rc 0/0 00000100:00100000:2.0:1787826976.111282:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 299 00002000:00100000:2.0:1787826976.111296:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (25165824->29360127) req@ffff8d547d36e940 x1874672134248192/t30064771304(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/448 e 0 to 0 dl 1787826987 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.111307:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d36e940 with x1874672134248192 ext(25165824->29360127) 00002000:00010000:2.0:1787826976.111313:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d36e940 00000100:00100000:1.0:1787826976.145376:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826976.145419:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826976.145486:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248448 00000100:00100000:3.0:1787826976.145501:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248448 00000100:00100000:2.0:1787826976.145556:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248320 00000100:00080000:0.0:1787826976.145567:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826976.145575:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826976.145579:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248320 00000100:00100000:3.0:1787826976.145609:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248576 00000100:00100000:3.0:1787826976.145617:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248576 00000100:00100000:0.0:1787826976.145623:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 360 00000100:00100000:0.0:1787826976.145643:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134248448:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826976.145646:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 513 00000100:00100000:2.0:1787826976.145667:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134248320:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787826976.145683:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826976.145690:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 361 00000100:00100000:3.0:1787826976.145705:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134248576:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826976.145737:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134248320:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 71us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826976.145743:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134248448:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826976.145752:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 513 00000100:00100000:0.0:1787826976.145756:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 360 00000100:00100000:3.0:1787826976.145784:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134248576:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826976.145794:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 361 00000100:00100000:3.0:1787826976.315303:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826976.315363:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248704 00000100:00100000:2.0:1787826976.315371:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248704 00002000:00100000:2.0:1787826976.315409:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (29360128->33554431) req@ffff8d53477dd680 x1874672134248704/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/0 e 0 to 0 dl 1787826987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.315418:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dd680 with x1874672134248704 ext(29360128->33554431) 00002000:00010000:2.0:1787826976.315422:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dd680 00000100:00100000:2.0:1787826976.315458:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 300 00000100:00100000:2.0:1787826976.315465:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134248704:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826976.326300:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2390:x1874672134248704:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10827us (10997us total) trans 30064771305 rc 0/0 00000100:00100000:2.0:1787826976.326310:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 300 00002000:00100000:2.0:1787826976.326319:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (29360128->33554431) req@ffff8d53477dd680 x1874672134248704/t30064771305(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/448 e 0 to 0 dl 1787826987 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.326326:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dd680 with x1874672134248704 ext(29360128->33554431) 00002000:00010000:2.0:1787826976.326330:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dd680 00000100:00100000:1.0:1787826976.530236:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826976.530307:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248832 00000100:00100000:2.0:1787826976.530316:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248832 00002000:00100000:2.0:1787826976.530362:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (33554432->37748735) req@ffff8d547fbe21c0 x1874672134248832/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/0 e 0 to 0 dl 1787826987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.530393:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe21c0 with x1874672134248832 ext(33554432->37748735) 00002000:00010000:2.0:1787826976.530399:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe21c0 00000100:00100000:2.0:1787826976.530443:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 301 00000100:00100000:2.0:1787826976.530454:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2391:x1874672134248832:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826976.541563:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2391:x1874672134248832:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11103us (11348us total) trans 30064771306 rc 0/0 00000100:00100000:2.0:1787826976.541573:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 301 00002000:00100000:2.0:1787826976.541584:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (33554432->37748735) req@ffff8d547fbe21c0 x1874672134248832/t30064771306(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/448 e 0 to 0 dl 1787826987 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.541592:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe21c0 with x1874672134248832 ext(33554432->37748735) 00002000:00010000:2.0:1787826976.541596:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe21c0 00000100:00100000:1.0:1787826976.730899:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826976.730960:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134248960 00000100:00100000:2.0:1787826976.730970:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134248960 00002000:00100000:2.0:1787826976.731020:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (37748736->41943039) req@ffff8d547fbe12c0 x1874672134248960/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/0 e 0 to 0 dl 1787826987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.731028:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe12c0 with x1874672134248960 ext(37748736->41943039) 00002000:00010000:2.0:1787826976.731032:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe12c0 00000100:00100000:2.0:1787826976.731057:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 302 00000100:00100000:2.0:1787826976.731064:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2390:x1874672134248960:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826976.742809:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2390:x1874672134248960:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11735us (11907us total) trans 30064771307 rc 0/0 00000100:00100000:2.0:1787826976.742830:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 302 00002000:00100000:2.0:1787826976.742854:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (37748736->41943039) req@ffff8d547fbe12c0 x1874672134248960/t30064771307(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/448 e 0 to 0 dl 1787826987 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.742865:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe12c0 with x1874672134248960 ext(37748736->41943039) 00002000:00010000:2.0:1787826976.742871:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe12c0 00000100:00100000:0.0:1787826976.849404:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826976.849411:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826976.849425:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143758080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826976.849438:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143757952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826976.849481:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826976.849495:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143758208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826976.849521:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826976.849531:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826976.849566:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758080 00000100:00100000:3.0:1787826976.849587:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758080 00000100:00100000:2.0:1787826976.849588:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758208 00000100:00100000:2.0:1787826976.849595:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758208 00000100:00100000:0.0:1787826976.849628:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826976.849630:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826976.849644:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143757952 00000100:00100000:2.0:1787826976.849649:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787826976.849649:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143757952 00000100:00100000:1.0:1787826976.849664:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787826976.849664:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143758208:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826976.849679:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143758080:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826976.849696:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000004:00000024:2.0:1787826976.849697:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:1.0:1787826976.849700:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826976.849709:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143757952:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787826976.849719:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787826976.849724:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787826976.849779:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143758080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826976.849780:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143758208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826976.849792:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143757952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826976.849796:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787826976.849798:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787826976.849809:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143758208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826976.849809:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00080000:2.0:1787826976.849845:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c6d00 x1874672143757952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826976.849856:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386cb40 x1874672143758080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826976.849859:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143757952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826976.849877:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143758080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826976.944409:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826976.944559:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249088 00000100:00100000:2.0:1787826976.944571:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249088 00002000:00100000:2.0:1787826976.944633:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (41943040->46137343) req@ffff8d53492c4780 x1874672134249088/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/0 e 0 to 0 dl 1787826987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.944645:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4780 with x1874672134249088 ext(41943040->46137343) 00002000:00010000:2.0:1787826976.944652:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4780 00000100:00100000:2.0:1787826976.944691:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 303 00000100:00100000:2.0:1787826976.944701:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134249088:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826976.955865:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134249088:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11158us (11459us total) trans 30064771308 rc 0/0 00000100:00100000:2.0:1787826976.955889:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 303 00002000:00100000:2.0:1787826976.955899:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (41943040->46137343) req@ffff8d53492c4780 x1874672134249088/t30064771308(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:577/0 lens 488/448 e 0 to 0 dl 1787826987 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826976.955908:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4780 with x1874672134249088 ext(41943040->46137343) 00002000:00010000:2.0:1787826976.955913:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4780 00010000:00010000:2.0:1787826976.977377:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826977.143983:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826977.144048:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249216 00000100:00100000:1.0:1787826977.144057:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249216 00002000:00100000:1.0:1787826977.144119:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (46137344->50331647) req@ffff8d547f9c03c0 x1874672134249216/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/0 e 0 to 0 dl 1787826988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826977.144131:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c03c0 with x1874672134249216 ext(46137344->50331647) 00002000:00010000:1.0:1787826977.144148:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c03c0 00000100:00080000:0.0:1787826977.144149:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826977.144190:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 304 00000100:00100000:1.0:1787826977.144201:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134249216:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826977.158140:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2391:x1874672134249216:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13929us (14153us total) trans 30064771309 rc 0/0 00000100:00100000:2.0:1787826977.158154:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 304 00002000:00100000:2.0:1787826977.158169:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (46137344->50331647) req@ffff8d547f9c03c0 x1874672134249216/t30064771309(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/448 e 0 to 0 dl 1787826988 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826977.158180:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c03c0 with x1874672134249216 ext(46137344->50331647) 00002000:00010000:2.0:1787826977.158186:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c03c0 00000100:00100000:1.0:1787826977.358735:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826977.358793:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249344 00000100:00100000:3.0:1787826977.358802:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249344 00002000:00100000:3.0:1787826977.358845:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (50331648->54525951) req@ffff8d547fbe0b40 x1874672134249344/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/0 e 0 to 0 dl 1787826988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826977.358855:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe0b40 with x1874672134249344 ext(50331648->54525951) 00002000:00010000:3.0:1787826977.358860:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe0b40 00000100:00100000:3.0:1787826977.358889:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 305 00000100:00100000:3.0:1787826977.358898:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134249344:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826977.361401:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143758336:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.361475:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.361511:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143758720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.361536:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143758848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.361549:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826977.361574:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.361578:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143759232:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.361601:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143759360:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.361608:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.361648:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143759744:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.361657:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826977.361659:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143758592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.361686:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143759872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.361693:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.361747:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758720 00000100:00100000:2.0:1787826977.361748:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826977.361755:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.361756:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758720 00000100:00100000:2.0:1787826977.361786:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826977.361795:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143758464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.361799:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143759232 00000100:00100000:1.0:1787826977.361804:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143759232 00000100:00100000:0.0:1787826977.361810:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143759104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.361833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143759360 00000100:00100000:1.0:1787826977.361837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143759360 00000100:00100000:2.0:1787826977.361840:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.361856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143759744 00000100:00100000:1.0:1787826977.361860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143759744 00000100:00100000:2.0:1787826977.361868:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143758976:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.361874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143759872 00000100:00100000:1.0:1787826977.361877:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143759872 00000100:00100000:1.0:1787826977.361890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758464 00000100:00100000:1.0:1787826977.361892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758464 00000100:00100000:2.0:1787826977.361904:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758336 00000100:00100000:2.0:1787826977.361908:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758336 00000100:00100000:1.0:1787826977.361909:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787826977.361920:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143758720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.361938:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1787826977.361946:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143758336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.361980:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143758720:12345-0@lo:400:kworker.0 Request processed in 61us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826977.361987:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143758336:12345-0@lo:400:kworker.0 Request processed in 42us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826977.361990:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.361992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787826977.361997:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1787826977.362023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787826977.362026:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143759616:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362032:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787826977.362034:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143759232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362042:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826977.362059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.362070:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143759232:12345-0@lo:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826977.362077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787826977.362093:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143759360:12345-0@lo:400:kworker.0 Request processed in 51us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826977.362095:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787826977.362105:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787826977.362105:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143759744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826977.362117:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143759872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143759744:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826977.362140:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143759872:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826977.362273:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787826977.362279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787826977.362284:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787826977.362293:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787826977.362303:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143758464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826977.362309:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758848 00000100:00100000:0.0:1787826977.362315:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758848 00000100:00100000:1.0:1787826977.362325:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143758720:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362338:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143759232:0@lo:400:kworker.0 00000100:00100000:0.0:1787826977.362342:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758592 00000100:00100000:0.0:1787826977.362344:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758592 00000100:00100000:2.0:1787826977.362349:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143758464:12345-0@lo:400:kworker.0 Request processed in 47us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826977.362353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143759744:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362360:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787826977.362365:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787826977.362374:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143758848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362396:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787826977.362408:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143758592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362409:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143759104 00000100:00100000:1.0:1787826977.362414:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143759104 00000100:00100000:0.0:1787826977.362415:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143758848:12345-0@lo:400:kworker.0 Request processed in 41us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826977.362422:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787826977.362459:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143759616 00000100:00100000:1.0:1787826977.362462:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143759616 00000100:00100000:2.0:1787826977.362473:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143758592:12345-0@lo:400:kworker.0 Request processed in 69us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826977.362479:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787826977.362488:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143758592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362491:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787826977.362498:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143759104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826977.362517:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787826977.362525:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143759616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362538:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826977.362540:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143759104:12345-0@lo:400:kworker.0 Request processed in 41us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826977.362549:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787826977.362552:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143759616:12345-0@lo:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826977.362558:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787826977.362561:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143758976 00000100:00100000:1.0:1787826977.362564:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143758976 00000100:00100000:2.0:1787826977.362577:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143759488:0@lo:400:kworker.0 00010000:00080000:0.0:1787826977.362587:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe8f00 x1874672143759104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826977.362589:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787826977.362597:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143758976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826977.362598:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143759104:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362608:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787826977.362612:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe9680 x1874672143759616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826977.362622:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143759616:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362642:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143758848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362649:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143758976:12345-0@lo:400:kworker.0 Request processed in 52us (112us total) trans 0 rc 0/0 00010000:00080000:2.0:1787826977.362657:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe83c0 x1874672143759360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826977.362659:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787826977.362671:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143759360:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362674:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143759488 00000100:00100000:1.0:1787826977.362678:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143759488 00010000:00080000:2.0:1787826977.362684:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbebc00 x1874672143759872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826977.362699:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143759872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362704:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787826977.362713:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143759488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362717:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143758336:0@lo:400:kworker.0 00000100:00080000:0.0:1787826977.362743:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826977.362748:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826977.362751:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826977.362751:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143759488:12345-0@lo:400:kworker.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826977.362755:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143758464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826977.362760:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787826977.362775:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143758976:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.362789:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143759488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826977.375402:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134249344:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16494us (16663us total) trans 30064771310 rc 0/0 00000100:00100000:2.0:1787826977.375415:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 305 00002000:00100000:2.0:1787826977.375436:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (50331648->54525951) req@ffff8d547fbe0b40 x1874672134249344/t30064771310(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/448 e 0 to 0 dl 1787826988 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826977.375444:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe0b40 with x1874672134249344 ext(50331648->54525951) 00002000:00010000:2.0:1787826977.375449:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe0b40 00000100:00100000:3.0:1787826977.566926:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826977.566998:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249472 00000100:00100000:1.0:1787826977.567008:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249472 00002000:00100000:1.0:1787826977.567053:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (54525952->58720255) req@ffff8d53492c43c0 x1874672134249472/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/0 e 0 to 0 dl 1787826988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826977.567061:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c43c0 with x1874672134249472 ext(54525952->58720255) 00002000:00010000:1.0:1787826977.567065:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c43c0 00000100:00100000:1.0:1787826977.567103:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 306 00000100:00100000:1.0:1787826977.567113:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134249472:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826977.580770:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134249472:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13645us (13838us total) trans 30064771311 rc 0/0 00000100:00100000:1.0:1787826977.580783:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 306 00002000:00100000:1.0:1787826977.580795:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (54525952->58720255) req@ffff8d53492c43c0 x1874672134249472/t30064771311(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/448 e 0 to 0 dl 1787826988 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826977.580804:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c43c0 with x1874672134249472 ext(54525952->58720255) 00002000:00010000:1.0:1787826977.580826:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c43c0 00000100:00100000:3.0:1787826977.772779:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826977.772841:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249600 00000100:00100000:1.0:1787826977.772851:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249600 00002000:00100000:1.0:1787826977.772897:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (58720256->62914559) req@ffff8d53492c5e00 x1874672134249600/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/0 e 0 to 0 dl 1787826988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826977.772909:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c5e00 with x1874672134249600 ext(58720256->62914559) 00002000:00010000:1.0:1787826977.772915:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c5e00 00000100:00100000:1.0:1787826977.772947:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 307 00000100:00100000:1.0:1787826977.772958:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134249600:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826977.783820:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134249600:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10852us (11037us total) trans 30064771312 rc 0/0 00000100:00100000:2.0:1787826977.783848:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 307 00002000:00100000:2.0:1787826977.783862:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (58720256->62914559) req@ffff8d53492c5e00 x1874672134249600/t30064771312(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/448 e 0 to 0 dl 1787826988 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826977.783873:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c5e00 with x1874672134249600 ext(58720256->62914559) 00002000:00010000:2.0:1787826977.783879:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c5e00 00000100:00100000:3.0:1787826977.873466:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143760000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826977.873530:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826977.873576:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760000 00000100:00100000:0.0:1787826977.873582:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760000 00000100:00100000:0.0:1787826977.873639:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787826977.873650:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143760000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826977.873679:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826977.873739:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143760000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826977.873744:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787826977.873790:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143760000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826977.999529:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826977.999588:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249728 00000100:00100000:2.0:1787826977.999600:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249728 00002000:00100000:2.0:1787826977.999648:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (62914560->67108863) req@ffff8d547f9c3840 x1874672134249728/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/0 e 0 to 0 dl 1787826988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826977.999660:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3840 with x1874672134249728 ext(62914560->67108863) 00002000:00010000:2.0:1787826977.999665:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3840 00000100:00100000:2.0:1787826977.999693:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 308 00000100:00100000:2.0:1787826977.999701:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134249728:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787826978.001558:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826978.014858:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134249728:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15150us (15330us total) trans 30064771313 rc 0/0 00000100:00100000:2.0:1787826978.014869:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 308 00002000:00100000:2.0:1787826978.014880:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (62914560->67108863) req@ffff8d547f9c3840 x1874672134249728/t30064771313(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:578/0 lens 488/448 e 0 to 0 dl 1787826988 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826978.014887:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3840 with x1874672134249728 ext(62914560->67108863) 00002000:00010000:2.0:1787826978.014892:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3840 00000100:00100000:1.0:1787826978.240433:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826978.240502:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249856 00000100:00100000:2.0:1787826978.240511:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249856 00002000:00100000:2.0:1787826978.240568:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (67108864->71303167) req@ffff8d547fbe9e00 x1874672134249856/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/0 e 0 to 0 dl 1787826989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826978.240580:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9e00 with x1874672134249856 ext(67108864->71303167) 00002000:00010000:2.0:1787826978.240585:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9e00 00000100:00100000:2.0:1787826978.240608:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 309 00000100:00100000:2.0:1787826978.240615:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134249856:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826978.258444:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134249856:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17819us (18022us total) trans 30064771314 rc 0/0 00000100:00100000:1.0:1787826978.258461:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 309 00002000:00100000:1.0:1787826978.258474:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (67108864->71303167) req@ffff8d547fbe9e00 x1874672134249856/t30064771314(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/448 e 0 to 0 dl 1787826989 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826978.258484:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9e00 with x1874672134249856 ext(67108864->71303167) 00002000:00010000:1.0:1787826978.258490:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9e00 00000100:00100000:2.0:1787826978.470162:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826978.470270:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134249984 00000100:00100000:1.0:1787826978.470279:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134249984 00002000:00100000:1.0:1787826978.470325:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (71303168->75497471) req@ffff8d547fbec3c0 x1874672134249984/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/0 e 0 to 0 dl 1787826989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826978.470337:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbec3c0 with x1874672134249984 ext(71303168->75497471) 00002000:00010000:1.0:1787826978.470342:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbec3c0 00000100:00100000:1.0:1787826978.470408:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 310 00000100:00100000:1.0:1787826978.470424:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134249984:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826978.482451:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134249984:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12025us (12288us total) trans 30064771315 rc 0/0 00000100:00100000:1.0:1787826978.482473:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 310 00002000:00100000:1.0:1787826978.482486:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (71303168->75497471) req@ffff8d547fbec3c0 x1874672134249984/t30064771315(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/448 e 0 to 0 dl 1787826989 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826978.482499:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbec3c0 with x1874672134249984 ext(71303168->75497471) 00002000:00010000:1.0:1787826978.482505:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbec3c0 00000100:00100000:2.0:1787826978.690340:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826978.690409:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134250112 00000100:00100000:1.0:1787826978.690430:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134250112 00002000:00100000:1.0:1787826978.690477:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (75497472->79691775) req@ffff8d547fbee940 x1874672134250112/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/0 e 0 to 0 dl 1787826989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826978.690485:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee940 with x1874672134250112 ext(75497472->79691775) 00002000:00010000:1.0:1787826978.690489:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee940 00000100:00100000:1.0:1787826978.690512:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 311 00000100:00100000:1.0:1787826978.690519:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134250112:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826978.701632:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134250112:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11103us (11290us total) trans 30064771316 rc 0/0 00000100:00100000:1.0:1787826978.701644:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 311 00002000:00100000:1.0:1787826978.701654:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (75497472->79691775) req@ffff8d547fbee940 x1874672134250112/t30064771316(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/448 e 0 to 0 dl 1787826989 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826978.701662:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee940 with x1874672134250112 ext(75497472->79691775) 00002000:00010000:1.0:1787826978.701667:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee940 00000100:00100000:0.0:1787826978.887452:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826978.887521:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134250240 00000100:00100000:1.0:1787826978.887541:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134250240 00002000:00100000:1.0:1787826978.887586:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (79691776->83886079) req@ffff8d547f9c2580 x1874672134250240/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/0 e 0 to 0 dl 1787826989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826978.887597:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c2580 with x1874672134250240 ext(79691776->83886079) 00002000:00010000:1.0:1787826978.887602:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c2580 00000100:00100000:1.0:1787826978.887643:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 312 00000100:00100000:1.0:1787826978.887657:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134250240:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826978.900033:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134250240:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12367us (12575us total) trans 30064771317 rc 0/0 00000100:00100000:1.0:1787826978.900047:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 312 00002000:00100000:1.0:1787826978.900060:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (79691776->83886079) req@ffff8d547f9c2580 x1874672134250240/t30064771317(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:579/0 lens 488/448 e 0 to 0 dl 1787826989 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826978.900071:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c2580 with x1874672134250240 ext(79691776->83886079) 00002000:00010000:1.0:1787826978.900078:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c2580 00010000:00010000:2.0:1787826979.025386:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826979.103792:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826979.103840:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134250368 00000100:00100000:3.0:1787826979.103848:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134250368 00000100:00080000:0.0:1787826979.103888:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787826979.103911:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (83886080->88080383) req@ffff8d547f9c21c0 x1874672134250368/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/0 e 0 to 0 dl 1787826990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826979.103936:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c21c0 with x1874672134250368 ext(83886080->88080383) 00002000:00010000:3.0:1787826979.103940:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c21c0 00000100:00100000:3.0:1787826979.103976:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 313 00000100:00100000:3.0:1787826979.103987:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134250368:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826979.116993:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134250368:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12998us (13196us total) trans 30064771318 rc 0/0 00000100:00100000:3.0:1787826979.117008:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 313 00002000:00100000:3.0:1787826979.117030:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (83886080->88080383) req@ffff8d547f9c21c0 x1874672134250368/t30064771318(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/448 e 0 to 0 dl 1787826990 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826979.117042:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c21c0 with x1874672134250368 ext(83886080->88080383) 00002000:00010000:3.0:1787826979.117048:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c21c0 00000100:00100000:2.0:1787826979.349295:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826979.349368:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134250496 00000100:00100000:1.0:1787826979.349379:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134250496 00002000:00100000:1.0:1787826979.349438:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (88080384->92274687) req@ffff8d547fbed680 x1874672134250496/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/0 e 0 to 0 dl 1787826990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826979.349449:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbed680 with x1874672134250496 ext(88080384->92274687) 00002000:00010000:1.0:1787826979.349455:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbed680 00000100:00100000:1.0:1787826979.349483:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 314 00000100:00100000:1.0:1787826979.349493:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134250496:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826979.360642:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134250496:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11139us (11344us total) trans 30064771319 rc 0/0 00000100:00100000:1.0:1787826979.360669:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 314 00002000:00100000:1.0:1787826979.360684:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (88080384->92274687) req@ffff8d547fbed680 x1874672134250496/t30064771319(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/448 e 0 to 0 dl 1787826990 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826979.360695:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbed680 with x1874672134250496 ext(88080384->92274687) 00002000:00010000:1.0:1787826979.360701:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbed680 00000100:00100000:2.0:1787826979.409505:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143760128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826979.409578:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826979.409678:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826979.409685:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143760256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826979.409707:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826979.409834:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760128 00000100:00100000:3.0:1787826979.409835:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760256 00000100:00100000:0.0:1787826979.409843:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760128 00000100:00100000:3.0:1787826979.409843:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760256 00000100:00100000:0.0:1787826979.409915:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787826979.409923:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787826979.409928:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143760128:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826979.409936:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143760256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826979.409961:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 36864 granted 577770944 pending 92815360 free 2849767424 avail 2618245120 00002000:00000024:3.0:1787826979.409961:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 36864 granted 577770944 pending 92815360 free 2849767424 avail 2618245120 00000100:00100000:0.0:1787826979.410031:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143760128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826979.410033:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143760256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826979.410046:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787826979.410053:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787826979.410074:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143760256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826979.410094:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143760128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787826979.410246:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826979.572209:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826979.572329:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134250624 00000100:00100000:1.0:1787826979.572338:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134250624 00002000:00100000:1.0:1787826979.572382:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (92274688->96468991) req@ffff8d547fbef840 x1874672134250624/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/0 e 0 to 0 dl 1787826990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826979.572394:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef840 with x1874672134250624 ext(92274688->96468991) 00002000:00010000:1.0:1787826979.572400:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef840 00000100:00100000:1.0:1787826979.572480:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 315 00000100:00100000:1.0:1787826979.572490:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134250624:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826979.585986:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134250624:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13488us (13776us total) trans 30064771320 rc 0/0 00000100:00100000:1.0:1787826979.586002:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 315 00002000:00100000:1.0:1787826979.586015:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (92274688->96468991) req@ffff8d547fbef840 x1874672134250624/t30064771320(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/448 e 0 to 0 dl 1787826990 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826979.586027:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef840 with x1874672134250624 ext(92274688->96468991) 00002000:00010000:1.0:1787826979.586033:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef840 00000100:00100000:2.0:1787826979.782607:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826979.782703:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134250752 00000100:00100000:0.0:1787826979.782717:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134250752 00002000:00100000:0.0:1787826979.782769:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (96468992->100663295) req@ffff8d547fbee580 x1874672134250752/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/0 e 0 to 0 dl 1787826990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826979.782799:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee580 with x1874672134250752 ext(96468992->100663295) 00002000:00010000:0.0:1787826979.782805:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee580 00000100:00100000:0.0:1787826979.782845:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 316 00000100:00100000:0.0:1787826979.782855:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134250752:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826979.796148:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134250752:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13285us (13545us total) trans 30064771321 rc 0/0 00000100:00100000:2.0:1787826979.796168:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 316 00002000:00100000:2.0:1787826979.796186:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (96468992->100663295) req@ffff8d547fbee580 x1874672134250752/t30064771321(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/448 e 0 to 0 dl 1787826990 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826979.796210:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee580 with x1874672134250752 ext(96468992->100663295) 00002000:00010000:2.0:1787826979.796242:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee580 00000001:00080000:3.0:1787826979.798731:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771321 is committed 00000001:00080000:0.0:1787826979.922516:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967388 is committed 00000100:00100000:0.0:1787826979.997302:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826979.997341:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134250880 00000100:00100000:1.0:1787826979.997349:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134250880 00002000:00100000:1.0:1787826979.997395:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (100663296->104857599) req@ffff8d547f9c3480 x1874672134250880/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/0 e 0 to 0 dl 1787826990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826979.997401:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3480 with x1874672134250880 ext(100663296->104857599) 00002000:00010000:1.0:1787826979.997416:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3480 00000100:00100000:1.0:1787826979.997438:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 317 00000100:00100000:1.0:1787826979.997446:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134250880:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826980.008722:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134250880:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11267us (11420us total) trans 30064771322 rc 0/0 00000100:00100000:1.0:1787826980.008737:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 317 00002000:00100000:1.0:1787826980.008747:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (100663296->104857599) req@ffff8d547f9c3480 x1874672134250880/t30064771322(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:580/0 lens 488/448 e 0 to 0 dl 1787826990 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826980.008754:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3480 with x1874672134250880 ext(100663296->104857599) 00002000:00010000:1.0:1787826980.008759:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3480 00010000:00010000:0.0:1787826980.049426:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826980.219947:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826980.220052:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251008 00000100:00100000:1.0:1787826980.220061:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251008 00002000:00100000:1.0:1787826980.220106:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (104857600->109051903) req@ffff8d547fbee1c0 x1874672134251008/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/0 e 0 to 0 dl 1787826991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826980.220117:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee1c0 with x1874672134251008 ext(104857600->109051903) 00002000:00010000:1.0:1787826980.220122:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee1c0 00000100:00100000:1.0:1787826980.220188:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 318 00000100:00100000:1.0:1787826980.220198:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134251008:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826980.238162:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134251008:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17947us (18204us total) trans 30064771323 rc 0/0 00000100:00100000:3.0:1787826980.238177:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 318 00002000:00100000:3.0:1787826980.238200:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (104857600->109051903) req@ffff8d547fbee1c0 x1874672134251008/t30064771323(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/448 e 0 to 0 dl 1787826991 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826980.238210:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee1c0 with x1874672134251008 ext(104857600->109051903) 00002000:00010000:3.0:1787826980.238240:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee1c0 00000100:00100000:1.0:1787826980.438605:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826980.438675:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251136 00000100:00100000:2.0:1787826980.438685:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251136 00002000:00100000:2.0:1787826980.438733:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (109051904->113246207) req@ffff8d547fbe8780 x1874672134251136/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/0 e 0 to 0 dl 1787826991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826980.438745:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8780 with x1874672134251136 ext(109051904->113246207) 00002000:00010000:2.0:1787826980.438751:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8780 00000100:00100000:2.0:1787826980.438782:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 319 00000100:00100000:2.0:1787826980.438794:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134251136:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826980.450681:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134251136:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11883us (12077us total) trans 30064771324 rc 0/0 00000100:00100000:2.0:1787826980.450691:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 319 00002000:00100000:2.0:1787826980.450701:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (109051904->113246207) req@ffff8d547fbe8780 x1874672134251136/t30064771324(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/448 e 0 to 0 dl 1787826991 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826980.450709:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8780 with x1874672134251136 ext(109051904->113246207) 00002000:00010000:2.0:1787826980.450714:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8780 00000100:00100000:0.0:1787826980.658754:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826980.658845:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251264 00000100:00100000:1.0:1787826980.658855:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251264 00002000:00100000:1.0:1787826980.658930:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (113246208->117440511) req@ffff8d547f9c0b40 x1874672134251264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/0 e 0 to 0 dl 1787826991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826980.658941:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c0b40 with x1874672134251264 ext(113246208->117440511) 00002000:00010000:1.0:1787826980.658947:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c0b40 00000100:00100000:1.0:1787826980.658974:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 320 00000100:00100000:1.0:1787826980.658985:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2391:x1874672134251264:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826980.669697:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2391:x1874672134251264:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10704us (10951us total) trans 30064771325 rc 0/0 00000100:00100000:1.0:1787826980.669713:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 320 00002000:00100000:1.0:1787826980.669726:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (113246208->117440511) req@ffff8d547f9c0b40 x1874672134251264/t30064771325(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/448 e 0 to 0 dl 1787826991 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826980.669737:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c0b40 with x1874672134251264 ext(113246208->117440511) 00002000:00010000:1.0:1787826980.669743:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c0b40 00000100:00100000:2.0:1787826980.892633:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826980.892690:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251392 00000100:00100000:3.0:1787826980.892700:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251392 00002000:00100000:3.0:1787826980.892744:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (117440512->121634815) req@ffff8d547fbed2c0 x1874672134251392/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/0 e 0 to 0 dl 1787826991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826980.892754:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbed2c0 with x1874672134251392 ext(117440512->121634815) 00002000:00010000:3.0:1787826980.892760:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbed2c0 00000100:00100000:3.0:1787826980.892790:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 321 00000100:00100000:3.0:1787826980.892798:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134251392:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826980.903147:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134251392:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10342us (10528us total) trans 30064771326 rc 0/0 00000100:00100000:2.0:1787826980.903160:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 321 00002000:00100000:2.0:1787826980.903172:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (117440512->121634815) req@ffff8d547fbed2c0 x1874672134251392/t30064771326(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:581/0 lens 488/448 e 0 to 0 dl 1787826991 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826980.903191:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbed2c0 with x1874672134251392 ext(117440512->121634815) 00002000:00010000:2.0:1787826980.903197:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbed2c0 00010000:00010000:2.0:1787826981.073457:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826981.102984:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826981.103048:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251520 00000100:00100000:2.0:1787826981.103057:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251520 00002000:00100000:2.0:1787826981.103110:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (121634816->125829119) req@ffff8d53492c7840 x1874672134251520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/0 e 0 to 0 dl 1787826992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826981.103111:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826981.103120:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7840 with x1874672134251520 ext(121634816->125829119) 00002000:00010000:2.0:1787826981.103125:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7840 00000100:00100000:2.0:1787826981.103151:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 322 00000100:00100000:2.0:1787826981.103161:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134251520:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826981.116708:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134251520:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13539us (13725us total) trans 30064771327 rc 0/0 00000100:00100000:2.0:1787826981.116723:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 322 00002000:00100000:2.0:1787826981.116736:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (121634816->125829119) req@ffff8d53492c7840 x1874672134251520/t30064771327(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/448 e 0 to 0 dl 1787826992 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826981.116747:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7840 with x1874672134251520 ext(121634816->125829119) 00002000:00010000:2.0:1787826981.116753:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7840 00000100:00100000:3.0:1787826981.265165:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826981.265206:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826981.265270:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251648 00000100:00100000:1.0:1787826981.265280:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251648 00000100:00100000:2.0:1787826981.265282:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251904 00000100:00100000:2.0:1787826981.265289:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251904 00000100:00100000:3.0:1787826981.265318:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826981.265344:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134251776 00000100:00100000:3.0:1787826981.265349:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134251776 00000100:00100000:1.0:1787826981.265354:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 515 00000100:00100000:2.0:1787826981.265354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 368 00000100:00100000:1.0:1787826981.265373:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134251648:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826981.265374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134251904:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826981.265389:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 369 00000100:00100000:3.0:1787826981.265412:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134251776:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787826981.265460:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134251648:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826981.265461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134251904:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826981.265472:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 515 00000100:00100000:2.0:1787826981.265486:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 368 00000100:00080000:2.0:1787826981.265514:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826981.265519:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826981.265722:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134251776:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 324us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826981.265735:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 369 00000100:00100000:2.0:1787826981.308475:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826981.308547:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252032 00000100:00100000:1.0:1787826981.308557:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252032 00002000:00100000:1.0:1787826981.308603:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (125829120->130023423) req@ffff8d547fbef480 x1874672134252032/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/0 e 0 to 0 dl 1787826992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826981.308632:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef480 with x1874672134252032 ext(125829120->130023423) 00002000:00010000:1.0:1787826981.308645:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef480 00000100:00100000:1.0:1787826981.308679:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 323 00000100:00100000:1.0:1787826981.308690:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134252032:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826981.320371:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134252032:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11674us (11895us total) trans 30064771328 rc 0/0 00000100:00100000:1.0:1787826981.320386:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 323 00002000:00100000:1.0:1787826981.320407:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (125829120->130023423) req@ffff8d547fbef480 x1874672134252032/t30064771328(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/448 e 0 to 0 dl 1787826992 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826981.320416:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef480 with x1874672134252032 ext(125829120->130023423) 00002000:00010000:1.0:1787826981.320421:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef480 00000100:00100000:0.0:1787826981.508447:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826981.508511:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252160 00000100:00100000:2.0:1787826981.508520:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252160 00002000:00100000:2.0:1787826981.508565:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (130023424->134217727) req@ffff8d547f9c30c0 x1874672134252160/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/0 e 0 to 0 dl 1787826992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826981.508574:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c30c0 with x1874672134252160 ext(130023424->134217727) 00002000:00010000:2.0:1787826981.508579:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c30c0 00000100:00100000:2.0:1787826981.508604:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 324 00000100:00100000:2.0:1787826981.508611:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134252160:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826981.523175:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134252160:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14553us (14727us total) trans 30064771329 rc 0/0 00000100:00100000:2.0:1787826981.523190:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 324 00002000:00100000:2.0:1787826981.523203:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (130023424->134217727) req@ffff8d547f9c30c0 x1874672134252160/t30064771329(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/448 e 0 to 0 dl 1787826992 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826981.523246:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c30c0 with x1874672134252160 ext(130023424->134217727) 00002000:00010000:2.0:1787826981.523259:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c30c0 00000100:00100000:0.0:1787826981.721099:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826981.721171:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252288 00000100:00100000:1.0:1787826981.721181:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252288 00002000:00100000:1.0:1787826981.721258:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (134217728->138412031) req@ffff8d547f9c0000 x1874672134252288/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/0 e 0 to 0 dl 1787826992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826981.721268:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c0000 with x1874672134252288 ext(134217728->138412031) 00002000:00010000:1.0:1787826981.721274:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c0000 00000100:00100000:1.0:1787826981.721303:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 325 00000100:00100000:1.0:1787826981.721313:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134252288:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826981.731538:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134252288:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10220us (10440us total) trans 30064771330 rc 0/0 00000100:00100000:3.0:1787826981.731559:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 325 00002000:00100000:3.0:1787826981.731570:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (134217728->138412031) req@ffff8d547f9c0000 x1874672134252288/t30064771330(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/448 e 0 to 0 dl 1787826992 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826981.731578:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c0000 with x1874672134252288 ext(134217728->138412031) 00002000:00010000:3.0:1787826981.731582:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c0000 00000100:00100000:2.0:1787826981.939951:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826981.940014:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252416 00000100:00100000:3.0:1787826981.940035:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252416 00002000:00100000:3.0:1787826981.940092:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (138412032->142606335) req@ffff8d547fbecb40 x1874672134252416/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/0 e 0 to 0 dl 1787826992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826981.940103:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbecb40 with x1874672134252416 ext(138412032->142606335) 00002000:00010000:3.0:1787826981.940109:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbecb40 00000100:00100000:3.0:1787826981.940139:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 326 00000100:00100000:3.0:1787826981.940149:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134252416:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826981.959814:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134252416:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19659us (19862us total) trans 30064771331 rc 0/0 00000100:00100000:3.0:1787826981.959827:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 326 00002000:00100000:3.0:1787826981.959839:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (138412032->142606335) req@ffff8d547fbecb40 x1874672134252416/t30064771331(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:582/0 lens 488/448 e 0 to 0 dl 1787826992 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826981.959849:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbecb40 with x1874672134252416 ext(138412032->142606335) 00002000:00010000:3.0:1787826981.959855:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbecb40 00000100:00100000:1.0:1787826981.969413:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143760512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826981.969475:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826981.969535:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760512 00000100:00100000:3.0:1787826981.969543:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760512 00000100:00100000:1.0:1787826981.969544:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143760640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826981.969589:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826981.969593:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143760384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826981.969618:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760640 00000100:00100000:3.0:1787826981.969637:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760640 00000100:00100000:0.0:1787826981.969642:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826981.969648:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1787826981.969660:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826981.969662:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143760512:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826981.969685:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787826981.969689:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760384 00002000:00000024:2.0:1787826981.969691:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826981.969694:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760384 00000100:00100000:3.0:1787826981.969698:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143760640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826981.969714:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826981.969727:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787826981.969735:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143760384:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826981.969739:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143760512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826981.969754:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000004:00000024:0.0:1787826981.969758:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826981.969761:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143760640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826981.969772:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00080000:1.0:1787826981.969773:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c1a40 x1874672143760512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826981.969794:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143760512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826981.969812:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143760384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (172us total) trans 0 rc 0/0 00010000:00080000:1.0:1787826981.969815:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e156580 x1874672143760640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826981.969823:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143760384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826981.969828:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787826981.969842:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143760640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787826982.097425:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826982.165290:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826982.165374:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252544 00000100:00100000:1.0:1787826982.165384:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252544 00002000:00100000:1.0:1787826982.165459:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (142606336->146800639) req@ffff8d547fbef0c0 x1874672134252544/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/0 e 0 to 0 dl 1787826993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826982.165471:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef0c0 with x1874672134252544 ext(142606336->146800639) 00002000:00010000:1.0:1787826982.165477:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef0c0 00000100:00100000:1.0:1787826982.165520:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 327 00000100:00100000:1.0:1787826982.165530:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134252544:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826982.183811:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134252544:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18273us (18521us total) trans 30064771332 rc 0/0 00000100:00100000:3.0:1787826982.183825:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 327 00002000:00100000:3.0:1787826982.183839:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (142606336->146800639) req@ffff8d547fbef0c0 x1874672134252544/t30064771332(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/448 e 0 to 0 dl 1787826993 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826982.183850:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef0c0 with x1874672134252544 ext(142606336->146800639) 00002000:00010000:3.0:1787826982.183856:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef0c0 00000100:00100000:2.0:1787826982.381245:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826982.381307:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252672 00000100:00100000:1.0:1787826982.381318:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252672 00002000:00100000:1.0:1787826982.381369:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (146800640->150994943) req@ffff8d547fbec000 x1874672134252672/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/0 e 0 to 0 dl 1787826993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826982.381402:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbec000 with x1874672134252672 ext(146800640->150994943) 00002000:00010000:1.0:1787826982.381408:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbec000 00000100:00100000:1.0:1787826982.381439:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 328 00000100:00100000:1.0:1787826982.381451:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134252672:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826982.392767:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134252672:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11311us (11555us total) trans 30064771333 rc 0/0 00000100:00100000:3.0:1787826982.392778:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 328 00002000:00100000:3.0:1787826982.392787:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (146800640->150994943) req@ffff8d547fbec000 x1874672134252672/t30064771333(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/448 e 0 to 0 dl 1787826993 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826982.392795:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbec000 with x1874672134252672 ext(146800640->150994943) 00002000:00010000:3.0:1787826982.392800:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbec000 00000100:00100000:2.0:1787826982.481375:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143760768:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481404:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143760896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826982.481427:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143761152:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.481473:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826982.481475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826982.481518:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760768 00000100:00100000:3.0:1787826982.481526:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760768 00000100:00100000:1.0:1787826982.481531:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143761024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481540:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143761408:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.481540:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143761280:0@lo:400:kworker.0 00000100:00100000:1.0:1787826982.481576:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826982.481591:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1787826982.481592:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826982.481598:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143760896 00000100:00100000:2.0:1787826982.481603:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143760896 00000100:00100000:3.0:1787826982.481605:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143760768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826982.481611:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143761536:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481636:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143761920:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.481643:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787826982.481649:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826982.481656:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143760896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826982.481686:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143760768:12345-0@lo:400:kworker.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826982.481687:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143762048:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481695:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826982.481704:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1787826982.481706:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143760896:12345-0@lo:400:kworker.0 Request processed in 51us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826982.481716:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787826982.481727:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826982.481753:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143760896:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.481753:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761024 00000100:00100000:2.0:1787826982.481759:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761024 00000100:00100000:3.0:1787826982.481759:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826982.481762:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826982.481773:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143761664:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481792:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761408 00000100:00100000:2.0:1787826982.481797:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787826982.481800:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761408 00000100:00100000:1.0:1787826982.481806:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826982.481809:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143761024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826982.481825:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761152 00000100:00100000:3.0:1787826982.481830:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761152 00000100:00100000:1.0:1787826982.481834:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143762176:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481849:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761536 00000100:00100000:0.0:1787826982.481854:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761536 00000100:00100000:2.0:1787826982.481861:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143761024:12345-0@lo:400:kworker.0 Request processed in 54us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826982.481864:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761664 00000100:00100000:3.0:1787826982.481870:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761664 00000100:00100000:1.0:1787826982.481871:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826982.481874:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787826982.481885:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761920 00000100:00100000:0.0:1787826982.481891:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761920 00000100:00100000:3.0:1787826982.481900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762176 00000100:00100000:3.0:1787826982.481905:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762176 00000100:00100000:2.0:1787826982.481910:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787826982.481911:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143761024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481922:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762048 00000100:00100000:2.0:1787826982.481924:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143761152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.481926:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762048 00000100:00100000:3.0:1787826982.481933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787826982.481944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143761664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826982.481950:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787826982.481962:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787826982.481964:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143761408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.481982:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143761152:12345-0@lo:400:kworker.0 Request processed in 60us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826982.481983:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143761536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.481998:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787826982.482002:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143761664:12345-0@lo:400:kworker.0 Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826982.482010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787826982.482024:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143761408:12345-0@lo:400:kworker.0 Request processed in 63us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826982.482024:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787826982.482034:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143761536:12345-0@lo:400:kworker.0 Request processed in 56us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826982.482039:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787826982.482039:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143762176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.482048:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787826982.482062:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826982.482068:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787826982.482074:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787826982.482080:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143761920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.482085:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143762048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.482094:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143762176:12345-0@lo:400:kworker.0 Request processed in 60us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826982.482095:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143761792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.482108:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787826982.482145:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143761920:12345-0@lo:400:kworker.0 Request processed in 68us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826982.482149:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143762048:12345-0@lo:400:kworker.0 Request processed in 64us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826982.482149:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143761152:0@lo:400:kworker.0 00000100:00100000:3.0:1787826982.482152:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826982.482162:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787826982.482168:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787826982.482191:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143762304:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.482198:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761280 00000100:00100000:1.0:1787826982.482200:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143761792 00000100:00100000:2.0:1787826982.482204:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761280 00000100:00100000:1.0:1787826982.482206:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143761792 00000100:00100000:0.0:1787826982.482247:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143761408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826982.482255:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826982.482267:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787826982.482268:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143761920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826982.482273:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762304 00000100:00100000:1.0:1787826982.482278:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762304 00000100:00100000:2.0:1787826982.482280:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143761280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826982.482301:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143760768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826982.482311:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00080000:0.0:1787826982.482316:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826982.482322:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826982.482324:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143761792:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826982.482327:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826982.482330:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143761280:12345-0@lo:400:kworker.0 Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826982.482333:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143761280:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.482344:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787826982.482366:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1787826982.482380:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143761792:12345-0@lo:400:kworker.0 Request processed in 59us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826982.482384:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143762304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826982.482404:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787826982.482420:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143761664:0@lo:400:kworker.0 00010000:00080000:3.0:1787826982.482436:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe9680 x1874672143761792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826982.482443:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143762176:0@lo:400:kworker.0 00000100:00100000:0.0:1787826982.482445:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143762304:12345-0@lo:400:kworker.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826982.482459:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00010000:00080000:2.0:1787826982.482464:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbebc00 x1874672143761536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826982.482487:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143761792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.482488:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143761536:0@lo:400:kworker.0 00010000:00080000:3.0:1787826982.482513:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c4000 x1874672143762304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826982.482518:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9bde00 x1874672143762048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826982.482534:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143762304:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.482535:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143762048:0@lo:400:kworker.0 00000100:00100000:2.0:1787826982.590691:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826982.590758:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252800 00000100:00100000:3.0:1787826982.590766:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252800 00002000:00100000:3.0:1787826982.590805:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (150994944->155189247) req@ffff8d547fbeda40 x1874672134252800/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/0 e 0 to 0 dl 1787826993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826982.590813:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbeda40 with x1874672134252800 ext(150994944->155189247) 00002000:00010000:3.0:1787826982.590816:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbeda40 00000100:00100000:3.0:1787826982.590842:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 329 00000100:00100000:3.0:1787826982.590848:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2390:x1874672134252800:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826982.602340:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134252800:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11481us (11655us total) trans 30064771334 rc 0/0 00000100:00100000:2.0:1787826982.602354:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 329 00002000:00100000:2.0:1787826982.602366:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (150994944->155189247) req@ffff8d547fbeda40 x1874672134252800/t30064771334(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/448 e 0 to 0 dl 1787826993 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826982.602376:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbeda40 with x1874672134252800 ext(150994944->155189247) 00002000:00010000:2.0:1787826982.602381:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbeda40 00000100:00100000:1.0:1787826982.794807:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826982.794871:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134252928 00000100:00100000:2.0:1787826982.794878:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134252928 00002000:00100000:2.0:1787826982.794923:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (155189248->159383551) req@ffff8d547f9c6940 x1874672134252928/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/0 e 0 to 0 dl 1787826993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826982.794933:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6940 with x1874672134252928 ext(155189248->159383551) 00002000:00010000:2.0:1787826982.794938:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6940 00000100:00100000:2.0:1787826982.794969:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 330 00000100:00100000:2.0:1787826982.794979:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134252928:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826982.810951:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134252928:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15962us (16139us total) trans 30064771335 rc 0/0 00000100:00100000:2.0:1787826982.810965:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 330 00002000:00100000:2.0:1787826982.810976:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (155189248->159383551) req@ffff8d547f9c6940 x1874672134252928/t30064771335(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:583/0 lens 488/448 e 0 to 0 dl 1787826993 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826982.810984:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6940 with x1874672134252928 ext(155189248->159383551) 00002000:00010000:2.0:1787826982.810988:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6940 00000100:00100000:2.0:1787826982.993443:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143762432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826982.993527:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826982.993670:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762432 00000100:00100000:0.0:1787826982.993677:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762432 00000100:00100000:0.0:1787826982.993717:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787826982.993724:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143762432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826982.993751:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826982.993797:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143762432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826982.993804:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787826982.993836:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143762432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826983.032979:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826983.033042:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253056 00000100:00100000:2.0:1787826983.033050:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253056 00002000:00100000:2.0:1787826983.033101:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (159383552->163577855) req@ffff8d547f9c5680 x1874672134253056/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/0 e 0 to 0 dl 1787826994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826983.033109:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c5680 with x1874672134253056 ext(159383552->163577855) 00002000:00010000:2.0:1787826983.033113:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c5680 00000100:00080000:0.0:1787826983.033118:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826983.033136:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 331 00000100:00100000:2.0:1787826983.033142:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134253056:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826983.042899:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134253056:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 9747us (9918us total) trans 30064771336 rc 0/0 00000100:00100000:2.0:1787826983.042914:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 331 00002000:00100000:2.0:1787826983.042927:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (159383552->163577855) req@ffff8d547f9c5680 x1874672134253056/t30064771336(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/448 e 0 to 0 dl 1787826994 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826983.042938:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c5680 with x1874672134253056 ext(159383552->163577855) 00002000:00010000:2.0:1787826983.042944:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c5680 00010000:00010000:2.0:1787826983.121405:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826983.236980:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826983.237036:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253184 00000100:00100000:2.0:1787826983.237045:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253184 00002000:00100000:2.0:1787826983.237082:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (163577856->167772159) req@ffff8d547fbe9680 x1874672134253184/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/0 e 0 to 0 dl 1787826994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826983.237091:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9680 with x1874672134253184 ext(163577856->167772159) 00002000:00010000:2.0:1787826983.237095:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9680 00000100:00100000:2.0:1787826983.237137:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 332 00000100:00100000:2.0:1787826983.237147:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134253184:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826983.248087:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134253184:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10931us (11104us total) trans 30064771337 rc 0/0 00000100:00100000:2.0:1787826983.248102:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 332 00002000:00100000:2.0:1787826983.248117:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (163577856->167772159) req@ffff8d547fbe9680 x1874672134253184/t30064771337(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/448 e 0 to 0 dl 1787826994 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826983.248129:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9680 with x1874672134253184 ext(163577856->167772159) 00002000:00010000:2.0:1787826983.248135:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9680 00000100:00100000:0.0:1787826983.446695:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826983.446757:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253312 00000100:00100000:1.0:1787826983.446767:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253312 00002000:00100000:1.0:1787826983.446814:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (167772160->171966463) req@ffff8d547fbe83c0 x1874672134253312/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/0 e 0 to 0 dl 1787826994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826983.446826:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe83c0 with x1874672134253312 ext(167772160->171966463) 00002000:00010000:1.0:1787826983.446831:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe83c0 00000100:00100000:1.0:1787826983.446868:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 333 00000100:00100000:1.0:1787826983.446879:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134253312:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826983.457963:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134253312:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11075us (11266us total) trans 30064771338 rc 0/0 00000100:00100000:3.0:1787826983.457977:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 333 00002000:00100000:3.0:1787826983.457988:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (167772160->171966463) req@ffff8d547fbe83c0 x1874672134253312/t30064771338(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/448 e 0 to 0 dl 1787826994 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826983.457998:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe83c0 with x1874672134253312 ext(167772160->171966463) 00002000:00010000:3.0:1787826983.458004:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe83c0 00000100:00100000:0.0:1787826983.668557:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826983.668610:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253440 00000100:00100000:3.0:1787826983.668619:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253440 00002000:00100000:3.0:1787826983.668668:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (171966464->176160767) req@ffff8d547fbea940 x1874672134253440/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/0 e 0 to 0 dl 1787826994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826983.668695:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbea940 with x1874672134253440 ext(171966464->176160767) 00002000:00010000:3.0:1787826983.668700:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbea940 00000100:00100000:3.0:1787826983.668727:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 334 00000100:00100000:3.0:1787826983.668738:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134253440:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826983.679824:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134253440:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11066us (11251us total) trans 30064771339 rc 0/0 00000100:00100000:2.0:1787826983.679839:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 334 00002000:00100000:2.0:1787826983.679853:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (171966464->176160767) req@ffff8d547fbea940 x1874672134253440/t30064771339(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/448 e 0 to 0 dl 1787826994 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826983.679864:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbea940 with x1874672134253440 ext(171966464->176160767) 00002000:00010000:2.0:1787826983.679871:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbea940 00000100:00100000:1.0:1787826983.879536:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826983.879588:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253568 00000100:00100000:3.0:1787826983.879597:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253568 00002000:00100000:3.0:1787826983.879641:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (176160768->180355071) req@ffff8d547f9c5e00 x1874672134253568/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/0 e 0 to 0 dl 1787826994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826983.879653:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c5e00 with x1874672134253568 ext(176160768->180355071) 00002000:00010000:3.0:1787826983.879658:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c5e00 00000100:00100000:3.0:1787826983.879692:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 335 00000100:00100000:3.0:1787826983.879701:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2391:x1874672134253568:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826983.892060:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2391:x1874672134253568:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12343us (12513us total) trans 30064771340 rc 0/0 00000100:00100000:3.0:1787826983.892078:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 335 00002000:00100000:3.0:1787826983.892095:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (176160768->180355071) req@ffff8d547f9c5e00 x1874672134253568/t30064771340(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:584/0 lens 488/448 e 0 to 0 dl 1787826994 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826983.892107:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c5e00 with x1874672134253568 ext(176160768->180355071) 00002000:00010000:3.0:1787826983.892116:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c5e00 00000100:00100000:1.0:1787826984.092425:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826984.092480:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253696 00000100:00100000:3.0:1787826984.092491:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253696 00002000:00100000:3.0:1787826984.092538:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (180355072->184549375) req@ffff8d547f9c7c00 x1874672134253696/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/0 e 0 to 0 dl 1787826995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826984.092566:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7c00 with x1874672134253696 ext(180355072->184549375) 00002000:00010000:3.0:1787826984.092572:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7c00 00000100:00100000:3.0:1787826984.092608:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 336 00000100:00100000:3.0:1787826984.092618:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2390:x1874672134253696:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826984.109174:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2390:x1874672134253696:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16548us (16752us total) trans 30064771341 rc 0/0 00000100:00100000:2.0:1787826984.109188:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 336 00002000:00100000:2.0:1787826984.109201:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (180355072->184549375) req@ffff8d547f9c7c00 x1874672134253696/t30064771341(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/448 e 0 to 0 dl 1787826995 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.109211:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7c00 with x1874672134253696 ext(180355072->184549375) 00002000:00010000:2.0:1787826984.109291:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7c00 00010000:00010000:0.0:1787826984.145389:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826984.315718:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826984.315788:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253824 00000100:00100000:2.0:1787826984.315798:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253824 00002000:00100000:2.0:1787826984.315855:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (184549376->188743679) req@ffff8d547fa612c0 x1874672134253824/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/0 e 0 to 0 dl 1787826995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.315868:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa612c0 with x1874672134253824 ext(184549376->188743679) 00002000:00010000:2.0:1787826984.315874:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa612c0 00000100:00100000:2.0:1787826984.315910:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 337 00000100:00100000:2.0:1787826984.315920:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2391:x1874672134253824:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826984.333168:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2391:x1874672134253824:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17233us (17443us total) trans 30064771342 rc 0/0 00000100:00100000:2.0:1787826984.333183:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 337 00002000:00100000:2.0:1787826984.333197:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (184549376->188743679) req@ffff8d547fa612c0 x1874672134253824/t30064771342(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/448 e 0 to 0 dl 1787826995 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.333209:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa612c0 with x1874672134253824 ext(184549376->188743679) 00002000:00010000:2.0:1787826984.333253:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa612c0 00000100:00100000:2.0:1787826984.529461:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143762560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826984.529466:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143762688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826984.529543:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826984.529593:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762560 00000100:00100000:1.0:1787826984.529599:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762560 00000100:00100000:3.0:1787826984.529607:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826984.529660:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762688 00000100:00100000:1.0:1787826984.529665:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787826984.529667:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762688 00000100:00080000:3.0:1787826984.529668:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826984.529678:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143762560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826984.529699:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 573515200 pending 88596480 free 2849767424 avail 2618245120 00000100:00080000:3.0:1787826984.529713:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826984.529718:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787826984.529731:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143762688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826984.529746:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 573515200 pending 88596480 free 2849767424 avail 2618245120 00000100:00100000:1.0:1787826984.529751:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143762560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826984.529772:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143762560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826984.529773:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787826984.529807:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143762688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826984.529816:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787826984.529837:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143762688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826984.543438:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826984.543530:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134253952 00000100:00100000:2.0:1787826984.543540:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134253952 00002000:00100000:2.0:1787826984.543586:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (188743680->192937983) req@ffff8d547fa630c0 x1874672134253952/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/0 e 0 to 0 dl 1787826995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.543598:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa630c0 with x1874672134253952 ext(188743680->192937983) 00002000:00010000:2.0:1787826984.543603:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa630c0 00000100:00100000:2.0:1787826984.543705:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 338 00000100:00100000:2.0:1787826984.543716:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2390:x1874672134253952:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826984.557601:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2390:x1874672134253952:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13878us (14163us total) trans 30064771343 rc 0/0 00000100:00100000:2.0:1787826984.557616:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 338 00002000:00100000:2.0:1787826984.557629:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (188743680->192937983) req@ffff8d547fa630c0 x1874672134253952/t30064771343(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/448 e 0 to 0 dl 1787826995 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.557639:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa630c0 with x1874672134253952 ext(188743680->192937983) 00002000:00010000:2.0:1787826984.557646:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa630c0 00000100:00100000:0.0:1787826984.773977:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826984.774038:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254080 00000100:00100000:2.0:1787826984.774047:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254080 00002000:00100000:2.0:1787826984.774094:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (192937984->197132287) req@ffff8d547fbe8f00 x1874672134254080/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/0 e 0 to 0 dl 1787826995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.774106:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8f00 with x1874672134254080 ext(192937984->197132287) 00002000:00010000:2.0:1787826984.774112:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8f00 00000100:00100000:2.0:1787826984.774139:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 339 00000100:00100000:2.0:1787826984.774147:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2391:x1874672134254080:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826984.785021:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2391:x1874672134254080:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10867us (11045us total) trans 30064771344 rc 0/0 00000100:00100000:2.0:1787826984.785032:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 339 00002000:00100000:2.0:1787826984.785045:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (192937984->197132287) req@ffff8d547fbe8f00 x1874672134254080/t30064771344(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/448 e 0 to 0 dl 1787826995 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.785056:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8f00 with x1874672134254080 ext(192937984->197132287) 00002000:00010000:2.0:1787826984.785071:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8f00 00000100:00100000:1.0:1787826984.998245:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826984.998318:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254208 00000100:00100000:2.0:1787826984.998327:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254208 00002000:00100000:2.0:1787826984.998383:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (197132288->201326591) req@ffff8d547f9c7840 x1874672134254208/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/0 e 0 to 0 dl 1787826995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826984.998395:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7840 with x1874672134254208 ext(197132288->201326591) 00002000:00010000:2.0:1787826984.998400:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7840 00000100:00100000:2.0:1787826984.998435:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 340 00000100:00100000:2.0:1787826984.998446:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134254208:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826985.022076:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134254208:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23619us (23858us total) trans 30064771345 rc 0/0 00000100:00100000:2.0:1787826985.022091:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 340 00002000:00100000:2.0:1787826985.022104:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (197132288->201326591) req@ffff8d547f9c7840 x1874672134254208/t30064771345(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:585/0 lens 488/448 e 0 to 0 dl 1787826995 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826985.022114:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7840 with x1874672134254208 ext(197132288->201326591) 00002000:00010000:2.0:1787826985.022120:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7840 00000001:00080000:3.0:1787826985.023270:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771345 is committed 00010000:00010000:2.0:1787826985.169673:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826985.230812:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826985.230938:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254336 00000100:00100000:3.0:1787826985.230948:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254336 00002000:00100000:3.0:1787826985.231017:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (201326592->205520895) req@ffff8d547f9c6580 x1874672134254336/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/0 e 0 to 0 dl 1787826996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826985.231028:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6580 with x1874672134254336 ext(201326592->205520895) 00002000:00010000:3.0:1787826985.231033:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6580 00000100:00080000:1.0:1787826985.231067:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826985.231071:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 341 00000100:00100000:3.0:1787826985.231084:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134254336:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826985.250028:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134254336:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18938us (19216us total) trans 30064771346 rc 0/0 00000100:00100000:3.0:1787826985.250042:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 341 00002000:00100000:3.0:1787826985.250060:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (201326592->205520895) req@ffff8d547f9c6580 x1874672134254336/t30064771346(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/448 e 0 to 0 dl 1787826996 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826985.250079:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6580 with x1874672134254336 ext(201326592->205520895) 00002000:00010000:3.0:1787826985.250085:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6580 00000100:00100000:0.0:1787826985.467152:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826985.467264:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254464 00000100:00100000:1.0:1787826985.467281:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254464 00002000:00100000:1.0:1787826985.467331:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (205520896->209715199) req@ffff8d547fbead00 x1874672134254464/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/0 e 0 to 0 dl 1787826996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826985.467344:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbead00 with x1874672134254464 ext(205520896->209715199) 00002000:00010000:1.0:1787826985.467350:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbead00 00000100:00100000:1.0:1787826985.467394:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 342 00000100:00100000:1.0:1787826985.467401:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134254464:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826985.482139:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134254464:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14727us (14997us total) trans 30064771347 rc 0/0 00000100:00100000:2.0:1787826985.482153:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 342 00002000:00100000:2.0:1787826985.482167:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (205520896->209715199) req@ffff8d547fbead00 x1874672134254464/t30064771347(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/448 e 0 to 0 dl 1787826996 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826985.482176:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbead00 with x1874672134254464 ext(205520896->209715199) 00002000:00010000:2.0:1787826985.482182:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbead00 00000100:00100000:0.0:1787826985.703281:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826985.704099:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254592 00000100:00100000:3.0:1787826985.704110:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254592 00002000:00100000:3.0:1787826985.704160:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (209715200->213909503) req@ffff8d547fbe9a40 x1874672134254592/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/0 e 0 to 0 dl 1787826996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826985.704172:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9a40 with x1874672134254592 ext(209715200->213909503) 00002000:00010000:3.0:1787826985.704178:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9a40 00000100:00100000:3.0:1787826985.704210:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 343 00000100:00100000:3.0:1787826985.704250:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134254592:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826985.719569:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134254592:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15311us (16344us total) trans 30064771348 rc 0/0 00000100:00100000:3.0:1787826985.719584:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 343 00002000:00100000:3.0:1787826985.719598:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (209715200->213909503) req@ffff8d547fbe9a40 x1874672134254592/t30064771348(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/448 e 0 to 0 dl 1787826996 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826985.719606:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9a40 with x1874672134254592 ext(209715200->213909503) 00002000:00010000:3.0:1787826985.719612:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9a40 00000100:00100000:2.0:1787826985.923778:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826985.923867:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254720 00000100:00100000:3.0:1787826985.923881:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254720 00002000:00100000:3.0:1787826985.923931:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (213909504->218103807) req@ffff8d547fbe30c0 x1874672134254720/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/0 e 0 to 0 dl 1787826996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826985.923944:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe30c0 with x1874672134254720 ext(213909504->218103807) 00002000:00010000:3.0:1787826985.923949:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe30c0 00000100:00100000:3.0:1787826985.924004:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 344 00000100:00100000:3.0:1787826985.924017:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134254720:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826985.936175:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134254720:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12153us (12402us total) trans 30064771349 rc 0/0 00000100:00100000:3.0:1787826985.936191:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 344 00002000:00100000:3.0:1787826985.936204:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (213909504->218103807) req@ffff8d547fbe30c0 x1874672134254720/t30064771349(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:586/0 lens 488/448 e 0 to 0 dl 1787826996 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826985.936238:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe30c0 with x1874672134254720 ext(213909504->218103807) 00002000:00010000:3.0:1787826985.936245:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe30c0 00000100:00100000:1.0:1787826986.158673:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826986.158747:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254848 00000100:00100000:2.0:1787826986.158757:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254848 00002000:00100000:2.0:1787826986.158803:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (218103808->222298111) req@ffff8d547f9c61c0 x1874672134254848/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/0 e 0 to 0 dl 1787826997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826986.158813:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c61c0 with x1874672134254848 ext(218103808->222298111) 00002000:00010000:2.0:1787826986.158818:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c61c0 00000100:00100000:2.0:1787826986.158849:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 345 00000100:00100000:2.0:1787826986.158857:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134254848:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826986.183263:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134254848:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24397us (24590us total) trans 30064771350 rc 0/0 00000100:00100000:2.0:1787826986.183277:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 345 00002000:00100000:2.0:1787826986.183289:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (218103808->222298111) req@ffff8d547f9c61c0 x1874672134254848/t30064771350(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/448 e 0 to 0 dl 1787826997 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826986.183300:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c61c0 with x1874672134254848 ext(218103808->222298111) 00002000:00010000:2.0:1787826986.183305:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c61c0 00010000:00010000:2.0:1787826986.193426:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826986.388766:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826986.388817:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826986.388838:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134254976 00000100:00100000:0.0:1787826986.388848:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134254976 00000100:00100000:3.0:1787826986.388865:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134255232 00000100:00100000:3.0:1787826986.388870:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134255232 00000100:00100000:1.0:1787826986.388876:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826986.388896:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 517 00000100:00080000:1.0:1787826986.388903:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826986.388908:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134254976:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826986.388917:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134255104 00000100:00100000:3.0:1787826986.388921:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134255104 00000100:00080000:1.0:1787826986.388938:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826986.388949:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 376 00000100:00100000:1.0:1787826986.388960:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 377 00000100:00100000:3.0:1787826986.388962:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134255232:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826986.388966:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134254976:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 61us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826986.388975:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134255104:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826986.388981:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 517 00000100:00100000:3.0:1787826986.389008:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134255232:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826986.389016:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134255104:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826986.389018:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 376 00000100:00100000:1.0:1787826986.389029:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 377 00000100:00100000:0.0:1787826986.409065:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826986.409413:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134255360 00000100:00100000:2.0:1787826986.409423:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134255360 00002000:00100000:2.0:1787826986.409468:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (222298112->226492415) req@ffff8d547fbe8000 x1874672134255360/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/0 e 0 to 0 dl 1787826997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826986.409480:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8000 with x1874672134255360 ext(222298112->226492415) 00002000:00010000:2.0:1787826986.409485:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8000 00000100:00100000:2.0:1787826986.409516:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 346 00000100:00100000:2.0:1787826986.409524:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134255360:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826986.428923:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134255360:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19389us (19855us total) trans 30064771351 rc 0/0 00000100:00100000:1.0:1787826986.428950:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 346 00002000:00100000:1.0:1787826986.428964:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (222298112->226492415) req@ffff8d547fbe8000 x1874672134255360/t30064771351(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/448 e 0 to 0 dl 1787826997 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826986.428974:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8000 with x1874672134255360 ext(222298112->226492415) 00002000:00010000:1.0:1787826986.428981:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8000 00000100:00100000:2.0:1787826986.644812:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826986.644914:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134255488 00000100:00100000:1.0:1787826986.644925:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134255488 00002000:00100000:1.0:1787826986.644980:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (226492416->230686719) req@ffff8d53492bd2c0 x1874672134255488/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/0 e 0 to 0 dl 1787826997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826986.644992:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bd2c0 with x1874672134255488 ext(226492416->230686719) 00002000:00010000:1.0:1787826986.644996:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bd2c0 00000100:00100000:1.0:1787826986.645022:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 347 00000100:00100000:1.0:1787826986.645036:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2391:x1874672134255488:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826986.665830:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2391:x1874672134255488:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20786us (21014us total) trans 30064771352 rc 0/0 00000100:00100000:1.0:1787826986.665851:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 347 00002000:00100000:1.0:1787826986.665865:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (226492416->230686719) req@ffff8d53492bd2c0 x1874672134255488/t30064771352(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/448 e 0 to 0 dl 1787826997 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826986.665876:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bd2c0 with x1874672134255488 ext(226492416->230686719) 00002000:00010000:1.0:1787826986.665882:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bd2c0 00000100:00100000:2.0:1787826986.880613:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826986.880663:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134255616 00000100:00100000:0.0:1787826986.880673:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134255616 00002000:00100000:0.0:1787826986.880720:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (230686720->234881023) req@ffff8d547fbf4f00 x1874672134255616/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/0 e 0 to 0 dl 1787826997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826986.880733:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4f00 with x1874672134255616 ext(230686720->234881023) 00002000:00010000:0.0:1787826986.880738:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4f00 00000100:00100000:0.0:1787826986.880777:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 348 00000100:00100000:0.0:1787826986.880786:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134255616:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826986.896689:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2390:x1874672134255616:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15759us (15940us total) trans 30064771353 rc 0/0 00000100:00100000:0.0:1787826986.896711:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 348 00002000:00100000:0.0:1787826986.896726:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (230686720->234881023) req@ffff8d547fbf4f00 x1874672134255616/t30064771353(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:587/0 lens 488/448 e 0 to 0 dl 1787826997 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826986.896737:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4f00 with x1874672134255616 ext(230686720->234881023) 00002000:00010000:0.0:1787826986.896742:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4f00 00000100:00100000:3.0:1787826987.089523:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826987.089552:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143763072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826987.089621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826987.089690:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763072 00000100:00100000:3.0:1787826987.089698:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763072 00000100:00100000:3.0:1787826987.089750:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787826987.089760:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143763072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826987.089802:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826987.089845:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143763072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826987.089853:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00080000:3.0:1787826987.089892:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa60000 x1874672143763072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826987.089909:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143763072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826987.089983:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143762944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826987.089985:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143762816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826987.090026:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826987.090035:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826987.090087:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826987.090178:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762816 00000100:00100000:3.0:1787826987.090196:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143762944 00000100:00100000:0.0:1787826987.090199:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762816 00000100:00100000:3.0:1787826987.090202:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143762944 00000100:00080000:1.0:1787826987.090251:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826987.090256:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787826987.090266:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143762816:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826987.090275:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787826987.090284:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143762944:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:0.0:1787826987.090289:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:3.0:1787826987.090297:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787826987.090343:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143762944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826987.090346:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143762816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826987.090366:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787826987.090373:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787826987.090391:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143762816:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1787826987.090422:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbeb0c0 x1874672143762944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826987.090436:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143762944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826987.117199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826987.117262:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134255744 00000100:00100000:3.0:1787826987.117271:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134255744 00002000:00100000:3.0:1787826987.117329:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (234881024->239075327) req@ffff8d547f9c4000 x1874672134255744/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/0 e 0 to 0 dl 1787826998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826987.117337:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c4000 with x1874672134255744 ext(234881024->239075327) 00002000:00010000:3.0:1787826987.117342:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c4000 00000100:00100000:3.0:1787826987.117382:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 349 00000100:00100000:3.0:1787826987.117390:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2391:x1874672134255744:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:1.0:1787826987.117392:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826987.131590:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2391:x1874672134255744:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14190us (14389us total) trans 30064771354 rc 0/0 00000100:00100000:3.0:1787826987.131616:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 349 00002000:00100000:3.0:1787826987.131627:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (234881024->239075327) req@ffff8d547f9c4000 x1874672134255744/t30064771354(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/448 e 0 to 0 dl 1787826998 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826987.131634:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c4000 with x1874672134255744 ext(234881024->239075327) 00002000:00010000:3.0:1787826987.131639:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c4000 00010000:00010000:2.0:1787826987.217381:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826987.355615:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826987.355791:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134255872 00000100:00100000:1.0:1787826987.355808:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134255872 00002000:00100000:1.0:1787826987.355884:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (239075328->243269631) req@ffff8d547fbf6940 x1874672134255872/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/0 e 0 to 0 dl 1787826998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826987.355897:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6940 with x1874672134255872 ext(239075328->243269631) 00002000:00010000:1.0:1787826987.355904:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6940 00000100:00100000:1.0:1787826987.355946:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 350 00000100:00100000:1.0:1787826987.355956:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2390:x1874672134255872:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826987.378034:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2390:x1874672134255872:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22068us (22422us total) trans 30064771355 rc 0/0 00000100:00100000:2.0:1787826987.378046:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 350 00002000:00100000:2.0:1787826987.378056:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (239075328->243269631) req@ffff8d547fbf6940 x1874672134255872/t30064771355(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/448 e 0 to 0 dl 1787826998 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826987.378064:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6940 with x1874672134255872 ext(239075328->243269631) 00002000:00010000:2.0:1787826987.378069:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6940 00000100:00100000:1.0:1787826987.592743:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826987.592827:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256000 00000100:00100000:3.0:1787826987.592836:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256000 00002000:00100000:3.0:1787826987.592874:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (243269632->247463935) req@ffff8d547f9c70c0 x1874672134256000/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/0 e 0 to 0 dl 1787826998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826987.592882:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c70c0 with x1874672134256000 ext(243269632->247463935) 00002000:00010000:3.0:1787826987.592886:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c70c0 00000100:00100000:3.0:1787826987.592915:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 351 00000100:00100000:3.0:1787826987.592922:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134256000:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826987.601393:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143763200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.601419:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143763584:0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.601505:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826987.601511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826987.601515:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143763456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.601531:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143763328:0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.601560:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826987.601569:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826987.601588:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143763712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.601590:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143763968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.601591:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143763840:0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.601591:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143764096:0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.601657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826987.601658:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826987.601662:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826987.601663:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763584 00000100:00100000:1.0:1787826987.601671:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763584 00000100:00100000:3.0:1787826987.601693:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143764480:0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.601701:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143764608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.601705:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143764224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.601714:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763328 00000100:00100000:1.0:1787826987.601719:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763328 00000100:00100000:3.0:1787826987.601723:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826987.601740:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764096 00000100:00100000:1.0:1787826987.601743:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764096 00000100:00100000:2.0:1787826987.601748:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826987.601766:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763200 00000100:00100000:0.0:1787826987.601771:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763200 00000100:00100000:3.0:1787826987.601773:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763456 00000100:00100000:1.0:1787826987.601777:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764608 00000100:00100000:1.0:1787826987.601779:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764608 00000100:00100000:3.0:1787826987.601779:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763456 00000100:00100000:2.0:1787826987.601805:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787826987.601814:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787826987.601819:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143763584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.601824:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763712 00000100:00100000:0.0:1787826987.601828:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1787826987.601829:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143763328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.601829:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763712 00000100:00100000:0.0:1787826987.601842:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143763200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.601855:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787826987.601869:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143763456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.601886:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143763584:12345-0@lo:400:kworker.0 Request processed in 70us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826987.601893:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143763328:12345-0@lo:400:kworker.0 Request processed in 69us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826987.601900:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787826987.601910:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143763200:12345-0@lo:400:kworker.0 Request processed in 71us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826987.601916:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1787826987.601918:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143763456:12345-0@lo:400:kworker.0 Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826987.601926:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1787826987.601931:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787826987.601936:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787826987.601948:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143764096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.601952:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787826987.601952:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787826987.601964:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143764608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.601964:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143763712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.601981:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763968 00000100:00100000:0.0:1787826987.601987:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763968 00000100:00100000:2.0:1787826987.602003:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143764096:12345-0@lo:400:kworker.0 Request processed in 57us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826987.602011:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143764608:12345-0@lo:400:kworker.0 Request processed in 49us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826987.602013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787826987.602024:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787826987.602024:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143763712:12345-0@lo:400:kworker.0 Request processed in 63us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826987.602027:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764480 00000100:00100000:3.0:1787826987.602032:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787826987.602039:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764480 00000100:00100000:2.0:1787826987.602053:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826987.602063:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787826987.602072:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143763968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.602072:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143763456:0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.602085:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787826987.602095:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143764736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.602098:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143764480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.602117:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143764096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.602131:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143764608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.602133:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143763968:12345-0@lo:400:kworker.0 Request processed in 63us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826987.602142:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787826987.602144:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143763584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.602152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826987.602158:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143764480:12345-0@lo:400:kworker.0 Request processed in 61us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826987.602167:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787826987.602170:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764224 00000100:00100000:1.0:1787826987.602175:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764224 00000100:00100000:3.0:1787826987.602175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764736 00000100:00100000:3.0:1787826987.602178:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764736 00000100:00100000:2.0:1787826987.602195:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143763200:0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.602207:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787826987.602212:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787826987.602235:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143764224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.602242:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143764736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.602248:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143763712:0@lo:400:kworker.0 00000100:00080000:0.0:1787826987.602270:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826987.602272:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143764224:12345-0@lo:400:kworker.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826987.602273:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143764736:12345-0@lo:400:kworker.0 Request processed in 31us (132us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826987.602276:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826987.602283:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00080000:2.0:1787826987.602284:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa63c00 x1874672143764224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826987.602289:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787826987.602301:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826987.602306:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143764224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.602317:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143763840 00000100:00100000:1.0:1787826987.602321:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143763840 00010000:00080000:2.0:1787826987.602326:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe29a40 x1874672143764736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826987.602332:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa61680 x1874672143763968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826987.602338:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143764352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.602342:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143764736:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.602366:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787826987.602371:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143763968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.602375:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143763840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.602387:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826987.602402:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2b0c0 x1874672143764480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826987.602412:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143764480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826987.602416:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143763840:12345-0@lo:400:kworker.0 Request processed in 44us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826987.602424:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764352 00000100:00100000:2.0:1787826987.602431:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764352 00000100:00100000:1.0:1787826987.602434:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787826987.602440:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143763328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826987.602459:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143763840:0@lo:400:kworker.0 00000100:00080000:1.0:1787826987.602467:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826987.602476:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787826987.602486:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143764352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826987.602563:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143764352:12345-0@lo:400:kworker.0 Request processed in 79us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826987.602572:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787826987.602597:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143764352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826987.603834:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134256000:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10909us (11095us total) trans 30064771356 rc 0/0 00000100:00100000:3.0:1787826987.603844:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 351 00002000:00100000:3.0:1787826987.603861:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (243269632->247463935) req@ffff8d547f9c70c0 x1874672134256000/t30064771356(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/448 e 0 to 0 dl 1787826998 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826987.603871:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c70c0 with x1874672134256000 ext(243269632->247463935) 00002000:00010000:3.0:1787826987.603877:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c70c0 00000100:00100000:0.0:1787826987.807870:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826987.807927:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256128 00000100:00100000:3.0:1787826987.807936:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256128 00002000:00100000:3.0:1787826987.807994:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (247463936->251658239) req@ffff8d534386cb40 x1874672134256128/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/0 e 0 to 0 dl 1787826998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826987.808004:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386cb40 with x1874672134256128 ext(247463936->251658239) 00002000:00010000:3.0:1787826987.808008:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386cb40 00000100:00100000:3.0:1787826987.808035:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 352 00000100:00100000:3.0:1787826987.808045:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134256128:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826987.817648:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134256128:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 9595us (9777us total) trans 30064771357 rc 0/0 00000100:00100000:3.0:1787826987.817660:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 352 00002000:00100000:3.0:1787826987.817679:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (247463936->251658239) req@ffff8d534386cb40 x1874672134256128/t30064771357(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:588/0 lens 488/448 e 0 to 0 dl 1787826998 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826987.817686:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386cb40 with x1874672134256128 ext(247463936->251658239) 00002000:00010000:3.0:1787826987.817691:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386cb40 00000100:00100000:1.0:1787826988.032127:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826988.032209:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256256 00000100:00100000:2.0:1787826988.032263:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256256 00002000:00100000:2.0:1787826988.032323:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (251658240->255852543) req@ffff8d547fe2e940 x1874672134256256/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/0 e 0 to 0 dl 1787826999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826988.032374:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2e940 with x1874672134256256 ext(251658240->255852543) 00002000:00010000:2.0:1787826988.032382:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2e940 00000100:00100000:2.0:1787826988.032415:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 353 00000100:00100000:2.0:1787826988.032426:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134256256:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826988.043976:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134256256:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11541us (11849us total) trans 30064771358 rc 0/0 00000100:00100000:2.0:1787826988.043989:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 353 00002000:00100000:2.0:1787826988.044001:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (251658240->255852543) req@ffff8d547fe2e940 x1874672134256256/t30064771358(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/448 e 0 to 0 dl 1787826999 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826988.044011:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2e940 with x1874672134256256 ext(251658240->255852543) 00002000:00010000:2.0:1787826988.044017:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2e940 00000100:00100000:1.0:1787826988.113525:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143764864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826988.113606:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826988.113670:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764864 00000100:00100000:0.0:1787826988.113682:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764864 00000100:00100000:0.0:1787826988.113759:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787826988.113770:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143764864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826988.113817:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787826988.113898:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143764864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826988.113905:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787826988.113972:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143764864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826988.241452:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826988.265308:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826988.266698:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256384 00000100:00100000:2.0:1787826988.266710:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256384 00002000:00100000:2.0:1787826988.266760:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (255852544->260046847) req@ffff8d547fe2de00 x1874672134256384/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/0 e 0 to 0 dl 1787826999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826988.266771:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2de00 with x1874672134256384 ext(255852544->260046847) 00002000:00010000:2.0:1787826988.266777:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2de00 00000100:00100000:2.0:1787826988.266809:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 354 00000100:00100000:2.0:1787826988.266820:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134256384:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826988.282852:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134256384:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16019us (17539us total) trans 30064771359 rc 0/0 00000100:00100000:2.0:1787826988.282867:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 354 00002000:00100000:2.0:1787826988.282892:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (255852544->260046847) req@ffff8d547fe2de00 x1874672134256384/t30064771359(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/448 e 0 to 0 dl 1787826999 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826988.282902:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2de00 with x1874672134256384 ext(255852544->260046847) 00002000:00010000:2.0:1787826988.282910:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2de00 00000100:00100000:3.0:1787826988.485069:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826988.485153:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256512 00000100:00100000:1.0:1787826988.485163:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256512 00002000:00100000:1.0:1787826988.485245:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (260046848->264241151) req@ffff8d547fe2b0c0 x1874672134256512/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/0 e 0 to 0 dl 1787826999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826988.485255:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2b0c0 with x1874672134256512 ext(260046848->264241151) 00002000:00010000:1.0:1787826988.485261:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2b0c0 00000100:00100000:1.0:1787826988.485297:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 355 00000100:00100000:1.0:1787826988.485308:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134256512:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826988.497451:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134256512:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12135us (12381us total) trans 30064771360 rc 0/0 00000100:00100000:1.0:1787826988.497468:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 355 00002000:00100000:1.0:1787826988.497482:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (260046848->264241151) req@ffff8d547fe2b0c0 x1874672134256512/t30064771360(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/448 e 0 to 0 dl 1787826999 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826988.497492:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2b0c0 with x1874672134256512 ext(260046848->264241151) 00002000:00010000:1.0:1787826988.497498:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2b0c0 00000100:00100000:2.0:1787826988.747910:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826988.748034:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256640 00000100:00100000:0.0:1787826988.748044:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256640 00002000:00100000:0.0:1787826988.748105:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (264241152->268435455) req@ffff8d547fbf61c0 x1874672134256640/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/0 e 0 to 0 dl 1787826999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826988.748116:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf61c0 with x1874672134256640 ext(264241152->268435455) 00002000:00010000:0.0:1787826988.748122:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf61c0 00000100:00100000:0.0:1787826988.748153:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 356 00000100:00100000:0.0:1787826988.748164:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134256640:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826988.770977:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134256640:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22804us (23070us total) trans 30064771361 rc 0/0 00000100:00100000:1.0:1787826988.770998:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 356 00002000:00100000:1.0:1787826988.771012:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (264241152->268435455) req@ffff8d547fbf61c0 x1874672134256640/t30064771361(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/448 e 0 to 0 dl 1787826999 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826988.771022:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf61c0 with x1874672134256640 ext(264241152->268435455) 00002000:00010000:1.0:1787826988.771028:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf61c0 00000100:00100000:3.0:1787826988.973611:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826988.973711:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256768 00000100:00100000:1.0:1787826988.973719:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256768 00002000:00100000:1.0:1787826988.973756:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (268435456->272629759) req@ffff8d547fe28000 x1874672134256768/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/0 e 0 to 0 dl 1787826999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826988.973764:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe28000 with x1874672134256768 ext(268435456->272629759) 00002000:00010000:1.0:1787826988.973767:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe28000 00000100:00100000:1.0:1787826988.973795:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 357 00000100:00100000:1.0:1787826988.973804:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134256768:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826988.985678:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134256768:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11866us (12066us total) trans 30064771362 rc 0/0 00000100:00100000:1.0:1787826988.985689:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 357 00002000:00100000:1.0:1787826988.985700:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (268435456->272629759) req@ffff8d547fe28000 x1874672134256768/t30064771362(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:589/0 lens 488/448 e 0 to 0 dl 1787826999 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826988.985708:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe28000 with x1874672134256768 ext(268435456->272629759) 00002000:00010000:1.0:1787826988.985712:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe28000 00000100:00100000:3.0:1787826989.186099:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826989.186157:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134256896 00000100:00100000:1.0:1787826989.186167:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134256896 00000100:00080000:0.0:1787826989.186230:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787826989.186252:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (272629760->276824063) req@ffff8d547fe283c0 x1874672134256896/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/0 e 0 to 0 dl 1787827000 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826989.186276:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe283c0 with x1874672134256896 ext(272629760->276824063) 00002000:00010000:1.0:1787826989.186281:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe283c0 00000100:00100000:1.0:1787826989.186316:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 358 00000100:00100000:1.0:1787826989.186328:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134256896:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826989.197312:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134256896:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10980us (11214us total) trans 30064771363 rc 0/0 00000100:00100000:1.0:1787826989.197323:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 358 00002000:00100000:1.0:1787826989.197333:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (272629760->276824063) req@ffff8d547fe283c0 x1874672134256896/t30064771363(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/448 e 0 to 0 dl 1787827000 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826989.197353:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe283c0 with x1874672134256896 ext(272629760->276824063) 00002000:00010000:1.0:1787826989.197358:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe283c0 00010000:00010000:2.0:1787826989.265416:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826989.401609:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826989.401687:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257024 00000100:00100000:3.0:1787826989.401704:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257024 00002000:00100000:3.0:1787826989.401800:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (276824064->281018367) req@ffff8d547fbf52c0 x1874672134257024/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/0 e 0 to 0 dl 1787827000 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826989.401816:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf52c0 with x1874672134257024 ext(276824064->281018367) 00002000:00010000:3.0:1787826989.401823:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf52c0 00000100:00100000:3.0:1787826989.401873:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 359 00000100:00100000:3.0:1787826989.401885:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134257024:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826989.417312:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134257024:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15417us (15713us total) trans 30064771364 rc 0/0 00000100:00100000:1.0:1787826989.417327:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 359 00002000:00100000:1.0:1787826989.417337:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (276824064->281018367) req@ffff8d547fbf52c0 x1874672134257024/t30064771364(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/448 e 0 to 0 dl 1787827000 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826989.417358:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf52c0 with x1874672134257024 ext(276824064->281018367) 00002000:00010000:1.0:1787826989.417364:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf52c0 00000100:00100000:0.0:1787826989.636827:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826989.636917:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257152 00000100:00100000:3.0:1787826989.636932:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257152 00002000:00100000:3.0:1787826989.637000:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (281018368->285212671) req@ffff8d547fb44b40 x1874672134257152/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/0 e 0 to 0 dl 1787827000 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826989.637014:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44b40 with x1874672134257152 ext(281018368->285212671) 00002000:00010000:3.0:1787826989.637025:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44b40 00000100:00100000:3.0:1787826989.637057:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 360 00000100:00100000:3.0:1787826989.637066:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134257152:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826989.649017:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134257152:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11935us (12182us total) trans 30064771365 rc 0/0 00000100:00100000:0.0:1787826989.649036:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 360 00002000:00100000:0.0:1787826989.649054:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (281018368->285212671) req@ffff8d547fb44b40 x1874672134257152/t30064771365(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/448 e 0 to 0 dl 1787827000 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826989.649067:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44b40 with x1874672134257152 ext(281018368->285212671) 00002000:00010000:0.0:1787826989.649075:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44b40 00000100:00100000:1.0:1787826989.649971:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143764992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826989.649989:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143765120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826989.650043:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826989.650104:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143764992 00000100:00100000:2.0:1787826989.650115:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143764992 00000100:00100000:0.0:1787826989.650127:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826989.650181:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143765120 00000100:00100000:3.0:1787826989.650201:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143765120 00000100:00080000:1.0:1787826989.650209:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826989.650248:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787826989.650265:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143764992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826989.650292:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 40960 granted 569337280 pending 84377600 free 2849767424 avail 2618245120 00000100:00100000:3.0:1787826989.650300:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787826989.650316:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143765120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826989.650352:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 40960 granted 569337280 pending 84377600 free 2849767424 avail 2618245120 00000100:00100000:2.0:1787826989.650371:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143764992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826989.650380:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787826989.650432:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143765120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826989.650443:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143764992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826989.650445:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787826989.650477:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143765120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826989.857929:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826989.858281:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257280 00000100:00100000:0.0:1787826989.858294:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257280 00002000:00100000:0.0:1787826989.858368:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (285212672->289406975) req@ffff8d547fbf7480 x1874672134257280/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/0 e 0 to 0 dl 1787827000 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826989.858391:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf7480 with x1874672134257280 ext(285212672->289406975) 00002000:00010000:0.0:1787826989.858398:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf7480 00000100:00100000:0.0:1787826989.858437:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 361 00000100:00100000:0.0:1787826989.858465:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134257280:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826989.872602:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134257280:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14129us (14680us total) trans 30064771366 rc 0/0 00000100:00100000:0.0:1787826989.872616:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 361 00002000:00100000:0.0:1787826989.872630:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (285212672->289406975) req@ffff8d547fbf7480 x1874672134257280/t30064771366(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:590/0 lens 488/448 e 0 to 0 dl 1787827000 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826989.872642:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf7480 with x1874672134257280 ext(285212672->289406975) 00002000:00010000:0.0:1787826989.872648:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf7480 00000100:00100000:2.0:1787826990.089195:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826990.089253:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257408 00000100:00100000:1.0:1787826990.089262:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257408 00002000:00100000:1.0:1787826990.089307:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (289406976->293601279) req@ffff8d547fbf4b40 x1874672134257408/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/0 e 0 to 0 dl 1787827001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.089317:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4b40 with x1874672134257408 ext(289406976->293601279) 00002000:00010000:1.0:1787826990.089323:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4b40 00000100:00100000:1.0:1787826990.089361:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 362 00000100:00100000:1.0:1787826990.089373:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134257408:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826990.103003:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134257408:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13623us (13805us total) trans 30064771367 rc 0/0 00000100:00100000:3.0:1787826990.103016:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 362 00002000:00100000:3.0:1787826990.103028:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (289406976->293601279) req@ffff8d547fbf4b40 x1874672134257408/t30064771367(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/448 e 0 to 0 dl 1787827001 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826990.103038:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4b40 with x1874672134257408 ext(289406976->293601279) 00002000:00010000:3.0:1787826990.103043:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4b40 00010000:00010000:2.0:1787826990.289392:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826990.313478:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826990.313569:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257536 00000100:00100000:1.0:1787826990.313581:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257536 00002000:00100000:1.0:1787826990.313628:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (293601280->297795583) req@ffff8d547fbf70c0 x1874672134257536/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/0 e 0 to 0 dl 1787827001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.313639:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf70c0 with x1874672134257536 ext(293601280->297795583) 00002000:00010000:1.0:1787826990.313646:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf70c0 00000100:00100000:1.0:1787826990.313682:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 363 00000100:00100000:1.0:1787826990.313691:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2391:x1874672134257536:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826990.327150:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2391:x1874672134257536:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13449us (13676us total) trans 30064771368 rc 0/0 00000100:00100000:1.0:1787826990.327165:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 363 00002000:00100000:1.0:1787826990.327179:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (293601280->297795583) req@ffff8d547fbf70c0 x1874672134257536/t30064771368(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/448 e 0 to 0 dl 1787827001 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.327190:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf70c0 with x1874672134257536 ext(293601280->297795583) 00002000:00010000:1.0:1787826990.327196:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf70c0 00000001:00080000:2.0:1787826990.328031:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771368 is committed 00000100:00100000:0.0:1787826990.533322:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826990.533486:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257664 00000100:00100000:1.0:1787826990.533496:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257664 00002000:00100000:1.0:1787826990.533556:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (297795584->301989887) req@ffff8d547fb470c0 x1874672134257664/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/0 e 0 to 0 dl 1787827001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.533567:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb470c0 with x1874672134257664 ext(297795584->301989887) 00002000:00010000:1.0:1787826990.533573:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb470c0 00000100:00100000:1.0:1787826990.533602:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 364 00000100:00100000:1.0:1787826990.533612:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134257664:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826990.550753:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134257664:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17133us (17432us total) trans 30064771369 rc 0/0 00000100:00100000:1.0:1787826990.550767:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 364 00002000:00100000:1.0:1787826990.550779:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (297795584->301989887) req@ffff8d547fb470c0 x1874672134257664/t30064771369(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/448 e 0 to 0 dl 1787827001 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.550789:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb470c0 with x1874672134257664 ext(297795584->301989887) 00002000:00010000:1.0:1787826990.550794:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb470c0 00000100:00100000:0.0:1787826990.762681:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826990.762812:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257792 00000100:00100000:1.0:1787826990.762826:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257792 00002000:00100000:1.0:1787826990.762874:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (301989888->306184191) req@ffff8d547fb45a40 x1874672134257792/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/0 e 0 to 0 dl 1787827001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.762885:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb45a40 with x1874672134257792 ext(301989888->306184191) 00002000:00010000:1.0:1787826990.762890:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb45a40 00000100:00100000:1.0:1787826990.762922:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 365 00000100:00100000:1.0:1787826990.762932:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134257792:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826990.777663:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134257792:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14723us (14988us total) trans 30064771370 rc 0/0 00000100:00100000:1.0:1787826990.777689:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 365 00002000:00100000:1.0:1787826990.777701:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (301989888->306184191) req@ffff8d547fb45a40 x1874672134257792/t30064771370(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/448 e 0 to 0 dl 1787827001 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.777712:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb45a40 with x1874672134257792 ext(301989888->306184191) 00002000:00010000:1.0:1787826990.777719:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb45a40 00000100:00100000:0.0:1787826990.977535:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826990.977594:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134257920 00000100:00100000:2.0:1787826990.977601:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134257920 00002000:00100000:2.0:1787826990.977645:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (306184192->310378495) req@ffff8d547fb46d00 x1874672134257920/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/0 e 0 to 0 dl 1787827001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826990.977656:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb46d00 with x1874672134257920 ext(306184192->310378495) 00002000:00010000:2.0:1787826990.977674:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb46d00 00000100:00100000:2.0:1787826990.977701:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 366 00000100:00100000:2.0:1787826990.977709:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134257920:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826990.992585:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134257920:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14865us (15048us total) trans 30064771371 rc 0/0 00000100:00100000:1.0:1787826990.992599:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 366 00002000:00100000:1.0:1787826990.992612:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (306184192->310378495) req@ffff8d547fb46d00 x1874672134257920/t30064771371(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:591/0 lens 488/448 e 0 to 0 dl 1787827001 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826990.992622:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb46d00 with x1874672134257920 ext(306184192->310378495) 00002000:00010000:1.0:1787826990.992629:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb46d00 00000100:00100000:3.0:1787826991.217167:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826991.217247:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258048 00000100:00100000:1.0:1787826991.217256:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258048 00002000:00100000:1.0:1787826991.217315:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (310378496->314572799) req@ffff8d547fe29680 x1874672134258048/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/0 e 0 to 0 dl 1787827002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826991.217341:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe29680 with x1874672134258048 ext(310378496->314572799) 00000100:00080000:0.0:1787826991.217343:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787826991.217348:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe29680 00000100:00100000:1.0:1787826991.217381:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 367 00000100:00100000:1.0:1787826991.217392:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134258048:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826991.229421:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134258048:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12023us (12254us total) trans 30064771372 rc 0/0 00000100:00100000:1.0:1787826991.229436:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 367 00002000:00100000:1.0:1787826991.229458:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (310378496->314572799) req@ffff8d547fe29680 x1874672134258048/t30064771372(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/448 e 0 to 0 dl 1787827002 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826991.229469:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe29680 with x1874672134258048 ext(310378496->314572799) 00002000:00010000:1.0:1787826991.229476:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe29680 00010000:00010000:2.0:1787826991.313411:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826991.437466:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826991.437604:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258176 00000100:00100000:0.0:1787826991.437613:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258176 00002000:00100000:0.0:1787826991.437658:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (314572800->318767103) req@ffff8d547fbf4000 x1874672134258176/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/0 e 0 to 0 dl 1787827002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826991.437669:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4000 with x1874672134258176 ext(314572800->318767103) 00002000:00010000:0.0:1787826991.437675:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4000 00000100:00100000:0.0:1787826991.437714:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 368 00000100:00100000:0.0:1787826991.437722:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134258176:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826991.453199:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134258176:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15460us (15724us total) trans 30064771373 rc 0/0 00000100:00100000:0.0:1787826991.453253:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 368 00002000:00100000:0.0:1787826991.453268:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (314572800->318767103) req@ffff8d547fbf4000 x1874672134258176/t30064771373(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/448 e 0 to 0 dl 1787827002 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826991.453290:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4000 with x1874672134258176 ext(314572800->318767103) 00002000:00010000:0.0:1787826991.453297:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4000 00000100:00100000:3.0:1787826991.505099:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826991.505145:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826991.505172:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258432 00000100:00100000:0.0:1787826991.505181:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258432 00000100:00100000:2.0:1787826991.505205:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258304 00000100:00100000:2.0:1787826991.505211:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258304 00000100:00080000:1.0:1787826991.505252:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826991.505282:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 519 00000100:00100000:0.0:1787826991.505284:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 384 00000100:00100000:2.0:1787826991.505297:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134258304:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826991.505298:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134258432:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787826991.505386:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134258432:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826991.505386:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134258304:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826991.505403:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 384 00000100:00100000:2.0:1787826991.505403:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 519 00000100:00100000:2.0:1787826991.505876:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826991.505959:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258560 00000100:00100000:3.0:1787826991.505964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258560 00000100:00100000:3.0:1787826991.506105:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 385 00000100:00100000:3.0:1787826991.506114:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134258560:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826991.506159:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134258560:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00080000:1.0:1787826991.506165:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826991.506168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 385 00000100:00100000:3.0:1787826991.677709:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826991.677801:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258688 00000100:00100000:0.0:1787826991.677811:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258688 00002000:00100000:0.0:1787826991.677862:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (318767104->322961407) req@ffff8d547fe2bc00 x1874672134258688/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/0 e 0 to 0 dl 1787827002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826991.677873:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2bc00 with x1874672134258688 ext(318767104->322961407) 00002000:00010000:0.0:1787826991.677879:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2bc00 00000100:00100000:0.0:1787826991.677908:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 369 00000100:00100000:0.0:1787826991.677918:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2390:x1874672134258688:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826991.695592:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134258688:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17666us (17883us total) trans 30064771374 rc 0/0 00000100:00100000:2.0:1787826991.695606:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 369 00002000:00100000:2.0:1787826991.695619:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (318767104->322961407) req@ffff8d547fe2bc00 x1874672134258688/t30064771374(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/448 e 0 to 0 dl 1787827002 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826991.695630:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2bc00 with x1874672134258688 ext(318767104->322961407) 00002000:00010000:2.0:1787826991.695647:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2bc00 00000100:00100000:2.0:1787826991.899686:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826991.899778:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258816 00000100:00100000:3.0:1787826991.899800:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258816 00002000:00100000:3.0:1787826991.899859:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (322961408->327155711) req@ffff8d547fbf6d00 x1874672134258816/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/0 e 0 to 0 dl 1787827002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826991.899871:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6d00 with x1874672134258816 ext(322961408->327155711) 00002000:00010000:3.0:1787826991.899876:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6d00 00000100:00100000:3.0:1787826991.899909:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 370 00000100:00100000:3.0:1787826991.899919:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2391:x1874672134258816:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826991.919676:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2391:x1874672134258816:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19748us (19989us total) trans 30064771375 rc 0/0 00000100:00100000:1.0:1787826991.919690:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 370 00002000:00100000:1.0:1787826991.919706:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (322961408->327155711) req@ffff8d547fbf6d00 x1874672134258816/t30064771375(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:592/0 lens 488/448 e 0 to 0 dl 1787827002 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826991.919717:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6d00 with x1874672134258816 ext(322961408->327155711) 00002000:00010000:1.0:1787826991.919724:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6d00 00000100:00100000:3.0:1787826992.154969:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826992.155043:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134258944 00000100:00100000:2.0:1787826992.155053:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134258944 00002000:00100000:2.0:1787826992.155098:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (327155712->331350015) req@ffff8d547fe2b840 x1874672134258944/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/0 e 0 to 0 dl 1787827003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826992.155122:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2b840 with x1874672134258944 ext(327155712->331350015) 00002000:00010000:2.0:1787826992.155127:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2b840 00000100:00100000:2.0:1787826992.155160:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 371 00000100:00100000:2.0:1787826992.155171:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134258944:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826992.174890:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134258944:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19710us (19923us total) trans 30064771376 rc 0/0 00000100:00100000:2.0:1787826992.174904:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 371 00002000:00100000:2.0:1787826992.174917:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (327155712->331350015) req@ffff8d547fe2b840 x1874672134258944/t30064771376(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/448 e 0 to 0 dl 1787827003 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826992.174929:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2b840 with x1874672134258944 ext(327155712->331350015) 00002000:00010000:2.0:1787826992.174935:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2b840 00000100:00100000:3.0:1787826992.209401:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826992.209451:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143765504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826992.209458:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143765376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826992.209521:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826992.209614:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826992.209621:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143765504 00000100:00100000:0.0:1787826992.209630:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143765504 00000100:00100000:2.0:1787826992.209639:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143765248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826992.209650:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143765376 00000100:00100000:3.0:1787826992.209655:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143765376 00000100:00100000:2.0:1787826992.209662:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826992.209693:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143765248 00000100:00100000:2.0:1787826992.209697:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143765248 00000100:00100000:3.0:1787826992.209702:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787826992.209703:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787826992.209718:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143765504:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826992.209724:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787826992.209726:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143765376:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826992.209732:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143765248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826992.209747:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787826992.209747:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787826992.209748:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00080000:1.0:1787826992.209832:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787826992.209859:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb44f00 x1874672143765504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826992.209887:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143765504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826992.209907:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143765248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826992.209915:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787826992.209950:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143765376:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787826992.209978:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2a580 x1874672143765248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826992.209991:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143765248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826992.210078:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143765376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 364us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826992.210083:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143765504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 368us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826992.210089:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787826992.210104:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00010000:0.0:1787826992.337380:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826992.409034:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826992.409094:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259072 00000100:00100000:1.0:1787826992.409102:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259072 00002000:00100000:1.0:1787826992.409141:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (331350016->335544319) req@ffff8d547fb44780 x1874672134259072/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/0 e 0 to 0 dl 1787827003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826992.409149:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44780 with x1874672134259072 ext(331350016->335544319) 00002000:00010000:1.0:1787826992.409164:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44780 00000100:00100000:1.0:1787826992.409193:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 372 00000100:00100000:1.0:1787826992.409202:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134259072:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826992.421643:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134259072:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12433us (12609us total) trans 30064771377 rc 0/0 00000100:00100000:1.0:1787826992.421658:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 372 00002000:00100000:1.0:1787826992.421672:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (331350016->335544319) req@ffff8d547fb44780 x1874672134259072/t30064771377(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/448 e 0 to 0 dl 1787827003 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826992.421683:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44780 with x1874672134259072 ext(331350016->335544319) 00002000:00010000:1.0:1787826992.421690:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44780 00000100:00100000:0.0:1787826992.651596:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826992.651657:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259200 00000100:00100000:1.0:1787826992.651668:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259200 00002000:00100000:1.0:1787826992.651714:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (335544320->339738623) req@ffff8d547fb443c0 x1874672134259200/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/0 e 0 to 0 dl 1787827003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826992.651726:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb443c0 with x1874672134259200 ext(335544320->339738623) 00002000:00010000:1.0:1787826992.651732:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb443c0 00000100:00100000:1.0:1787826992.651764:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 373 00000100:00100000:1.0:1787826992.651774:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134259200:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826992.667118:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134259200:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15333us (15515us total) trans 30064771378 rc 0/0 00000100:00100000:1.0:1787826992.667133:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 373 00002000:00100000:1.0:1787826992.667155:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (335544320->339738623) req@ffff8d547fb443c0 x1874672134259200/t30064771378(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/448 e 0 to 0 dl 1787827003 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826992.667184:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb443c0 with x1874672134259200 ext(335544320->339738623) 00002000:00010000:1.0:1787826992.667190:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb443c0 00000100:00100000:3.0:1787826992.722511:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143765760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.722574:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143765888:0@lo:400:kworker.0 00000100:00100000:3.0:1787826992.722591:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826992.722625:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826992.722657:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143766016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.722660:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143766400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826992.722664:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143766272:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.722711:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826992.722719:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826992.722737:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143766528:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.722762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826992.722782:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143765632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.722822:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766528 00000100:00100000:0.0:1787826992.722829:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766528 00000100:00100000:1.0:1787826992.722834:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826992.722862:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143766144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.722883:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787826992.722890:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826992.722895:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143766528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826992.722912:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143766656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.722956:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143766528:12345-0@lo:400:kworker.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826992.722963:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787826992.722977:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766144 00000100:00100000:0.0:1787826992.722980:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766144 00000100:00100000:0.0:1787826992.723002:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787826992.723008:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143766144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826992.723043:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143765760 00000100:00100000:3.0:1787826992.723048:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143765760 00000100:00100000:1.0:1787826992.723077:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143765888 00000100:00100000:3.0:1787826992.723080:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766400 00000100:00100000:1.0:1787826992.723083:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143765888 00000100:00100000:3.0:1787826992.723085:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766400 00000100:00100000:3.0:1787826992.723127:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787826992.723146:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1787826992.723155:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143765888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826992.723162:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143765760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.723238:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143766144:12345-0@lo:400:kworker.0 Request processed in 204us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826992.723246:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787826992.723264:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766016 00000100:00100000:2.0:1787826992.723269:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766016 00000100:00100000:0.0:1787826992.723271:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143765632 00000100:00100000:0.0:1787826992.723276:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143765632 00000100:00100000:0.0:1787826992.723308:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1787826992.723315:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143765632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.723328:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787826992.723338:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143766016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.723380:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143765632:12345-0@lo:400:kworker.0 Request processed in 65us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826992.723391:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1787826992.723392:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143766016:12345-0@lo:400:kworker.0 Request processed in 54us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826992.723402:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:0.0:1787826992.723421:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826992.723427:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826992.723432:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787826992.723441:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143766400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.723465:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143766016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.723477:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143766528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.723485:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143766400:12345-0@lo:400:kworker.0 Request processed in 44us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826992.723498:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787826992.723528:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826992.723547:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143766784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.723571:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826992.723595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766272 00000100:00100000:0.0:1787826992.723600:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766272 00000100:00100000:2.0:1787826992.723611:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766784 00000100:00100000:2.0:1787826992.723617:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766784 00000100:00100000:0.0:1787826992.723629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787826992.723639:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143766272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.723644:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1787826992.723659:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1787826992.723681:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143766272:12345-0@lo:400:kworker.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826992.723688:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787826992.723700:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1787826992.723707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143766784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.723738:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143766784:12345-0@lo:400:kworker.0 Request processed in 32us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826992.723745:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00080000:0.0:1787826992.723765:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787826992.723767:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfe1c0 x1874672143766400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826992.723769:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826992.723782:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143766400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.723783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826992.723815:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143766272:0@lo:400:kworker.0 00010000:00080000:2.0:1787826992.723829:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfcb40 x1874672143766784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826992.723837:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143765632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.723841:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143766784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.723859:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143766144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.723878:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766656 00000100:00100000:2.0:1787826992.723882:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766656 00000100:00080000:0.0:1787826992.723906:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826992.723919:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787826992.723926:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1787826992.723927:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143766656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.723968:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143766656:12345-0@lo:400:kworker.0 Request processed in 43us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826992.723974:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787826992.723995:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143766656:0@lo:400:kworker.0 00000100:00100000:1.0:1787826992.724163:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143765888:12345-0@lo:400:kworker.0 Request processed in 1008us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826992.724171:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787826992.724184:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143765760:12345-0@lo:400:kworker.0 Request processed in 1026us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826992.724194:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787826992.724255:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143765760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826992.724269:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143765888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826992.877939:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826992.879445:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259328 00000100:00100000:1.0:1787826992.879456:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259328 00002000:00100000:1.0:1787826992.879505:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (339738624->343932927) req@ffff8d547fb47c00 x1874672134259328/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/0 e 0 to 0 dl 1787827003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826992.879516:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb47c00 with x1874672134259328 ext(339738624->343932927) 00002000:00010000:1.0:1787826992.879521:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb47c00 00000100:00100000:1.0:1787826992.879555:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 374 00000100:00100000:1.0:1787826992.879565:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134259328:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826992.897012:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134259328:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17438us (19072us total) trans 30064771379 rc 0/0 00000100:00100000:2.0:1787826992.897027:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 374 00002000:00100000:2.0:1787826992.897041:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (339738624->343932927) req@ffff8d547fb47c00 x1874672134259328/t30064771379(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:593/0 lens 488/448 e 0 to 0 dl 1787827003 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826992.897052:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb47c00 with x1874672134259328 ext(339738624->343932927) 00002000:00010000:2.0:1787826992.897059:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb47c00 00000100:00100000:0.0:1787826993.117868:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826993.117927:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259456 00000100:00100000:1.0:1787826993.117945:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259456 00000100:00080000:0.0:1787826993.117997:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787826993.118006:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (343932928->348127231) req@ffff8d547fb47840 x1874672134259456/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/0 e 0 to 0 dl 1787827004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826993.118018:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb47840 with x1874672134259456 ext(343932928->348127231) 00002000:00010000:1.0:1787826993.118024:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb47840 00000100:00100000:1.0:1787826993.118050:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 375 00000100:00100000:1.0:1787826993.118058:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2390:x1874672134259456:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826993.134382:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2390:x1874672134259456:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16051us (16250us total) trans 30064771380 rc 0/0 00000100:00100000:1.0:1787826993.134397:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 375 00002000:00100000:1.0:1787826993.134409:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (343932928->348127231) req@ffff8d547fb47840 x1874672134259456/t30064771380(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/448 e 0 to 0 dl 1787827004 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826993.134420:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb47840 with x1874672134259456 ext(343932928->348127231) 00002000:00010000:1.0:1787826993.134425:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb47840 00000100:00100000:0.0:1787826993.233537:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826993.233558:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143766912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826993.233621:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826993.233949:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143766912 00000100:00100000:3.0:1787826993.233964:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143766912 00000100:00100000:3.0:1787826993.234063:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787826993.234075:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143766912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826993.234121:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787826993.234255:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143766912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826993.234263:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787826993.234302:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143766912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826993.350887:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826993.351074:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259584 00000100:00100000:3.0:1787826993.351092:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259584 00002000:00100000:3.0:1787826993.351141:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (348127232->352321535) req@ffff8d547fb452c0 x1874672134259584/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/0 e 0 to 0 dl 1787827004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826993.351153:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb452c0 with x1874672134259584 ext(348127232->352321535) 00002000:00010000:3.0:1787826993.351158:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb452c0 00000100:00100000:3.0:1787826993.351194:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 376 00000100:00100000:3.0:1787826993.351203:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134259584:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787826993.361435:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826993.371766:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134259584:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20549us (20872us total) trans 30064771381 rc 0/0 00000100:00100000:2.0:1787826993.371791:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 376 00002000:00100000:2.0:1787826993.371805:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (348127232->352321535) req@ffff8d547fb452c0 x1874672134259584/t30064771381(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/448 e 0 to 0 dl 1787827004 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826993.371816:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb452c0 with x1874672134259584 ext(348127232->352321535) 00002000:00010000:2.0:1787826993.371822:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb452c0 00000100:00100000:2.0:1787826993.584269:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826993.584382:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259712 00000100:00100000:0.0:1787826993.584393:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259712 00002000:00100000:0.0:1787826993.584438:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (352321536->356515839) req@ffff8d547fbfde00 x1874672134259712/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/0 e 0 to 0 dl 1787827004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826993.584446:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfde00 with x1874672134259712 ext(352321536->356515839) 00002000:00010000:0.0:1787826993.584450:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfde00 00000100:00100000:0.0:1787826993.584476:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 377 00000100:00100000:0.0:1787826993.584482:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134259712:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826993.595741:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134259712:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11249us (11478us total) trans 30064771382 rc 0/0 00000100:00100000:1.0:1787826993.595755:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 377 00002000:00100000:1.0:1787826993.595776:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (352321536->356515839) req@ffff8d547fbfde00 x1874672134259712/t30064771382(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/448 e 0 to 0 dl 1787827004 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826993.595787:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfde00 with x1874672134259712 ext(352321536->356515839) 00002000:00010000:1.0:1787826993.595793:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfde00 00000100:00100000:0.0:1787826993.820877:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826993.820975:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259840 00000100:00100000:3.0:1787826993.820984:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259840 00002000:00100000:3.0:1787826993.821044:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (356515840->360710143) req@ffff8d547fb46580 x1874672134259840/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/0 e 0 to 0 dl 1787827004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826993.821064:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb46580 with x1874672134259840 ext(356515840->360710143) 00002000:00010000:3.0:1787826993.821086:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb46580 00000100:00100000:3.0:1787826993.821119:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 378 00000100:00100000:3.0:1787826993.821127:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134259840:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826993.834469:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134259840:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13333us (13591us total) trans 30064771383 rc 0/0 00000100:00100000:3.0:1787826993.834482:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 378 00002000:00100000:3.0:1787826993.834493:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (356515840->360710143) req@ffff8d547fb46580 x1874672134259840/t30064771383(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:594/0 lens 488/448 e 0 to 0 dl 1787827004 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826993.834504:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb46580 with x1874672134259840 ext(356515840->360710143) 00002000:00010000:3.0:1787826993.834510:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb46580 00000100:00100000:2.0:1787826994.032274:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826994.032344:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134259968 00000100:00100000:1.0:1787826994.032366:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134259968 00002000:00100000:1.0:1787826994.032411:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (360710144->364904447) req@ffff8d547fbfcb40 x1874672134259968/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/0 e 0 to 0 dl 1787827005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826994.032422:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfcb40 with x1874672134259968 ext(360710144->364904447) 00002000:00010000:1.0:1787826994.032438:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfcb40 00000100:00100000:1.0:1787826994.032467:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 379 00000100:00100000:1.0:1787826994.032478:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134259968:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826994.045494:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134259968:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13009us (13219us total) trans 30064771384 rc 0/0 00000100:00100000:1.0:1787826994.045508:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 379 00002000:00100000:1.0:1787826994.045520:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (360710144->364904447) req@ffff8d547fbfcb40 x1874672134259968/t30064771384(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/448 e 0 to 0 dl 1787827005 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826994.045530:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfcb40 with x1874672134259968 ext(360710144->364904447) 00002000:00010000:1.0:1787826994.045536:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfcb40 00000100:00100000:2.0:1787826994.255123:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826994.255178:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260096 00000100:00100000:1.0:1787826994.255195:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260096 00002000:00100000:1.0:1787826994.255275:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (364904448->369098751) req@ffff8d547fbfe580 x1874672134260096/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/0 e 0 to 0 dl 1787827005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826994.255286:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfe580 with x1874672134260096 ext(364904448->369098751) 00002000:00010000:1.0:1787826994.255292:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfe580 00000100:00100000:1.0:1787826994.255332:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 380 00000100:00100000:1.0:1787826994.255341:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134260096:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826994.271211:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134260096:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15861us (16085us total) trans 30064771385 rc 0/0 00000100:00100000:2.0:1787826994.271250:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 380 00002000:00100000:2.0:1787826994.271332:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (364904448->369098751) req@ffff8d547fbfe580 x1874672134260096/t30064771385(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/448 e 0 to 0 dl 1787827005 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826994.271343:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfe580 with x1874672134260096 ext(364904448->369098751) 00002000:00010000:2.0:1787826994.271350:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfe580 00010000:00010000:2.0:1787826994.385382:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826994.503375:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826994.503479:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260224 00000100:00100000:1.0:1787826994.503501:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260224 00002000:00100000:1.0:1787826994.503568:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (369098752->373293055) req@ffff8d547fb44f00 x1874672134260224/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/0 e 0 to 0 dl 1787827005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826994.503579:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44f00 with x1874672134260224 ext(369098752->373293055) 00002000:00010000:1.0:1787826994.503584:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44f00 00000100:00100000:1.0:1787826994.503619:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 381 00000100:00100000:1.0:1787826994.503634:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134260224:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826994.515390:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134260224:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11736us (12004us total) trans 30064771386 rc 0/0 00000100:00100000:2.0:1787826994.515409:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 381 00002000:00100000:2.0:1787826994.515428:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (369098752->373293055) req@ffff8d547fb44f00 x1874672134260224/t30064771386(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/448 e 0 to 0 dl 1787827005 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826994.515440:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44f00 with x1874672134260224 ext(369098752->373293055) 00002000:00010000:2.0:1787826994.515463:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44f00 00000100:00100000:2.0:1787826994.743296:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826994.743386:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260352 00000100:00100000:1.0:1787826994.743396:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260352 00002000:00100000:1.0:1787826994.743444:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (373293056->377487359) req@ffff8d547fbfe1c0 x1874672134260352/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/0 e 0 to 0 dl 1787827005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826994.743456:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfe1c0 with x1874672134260352 ext(373293056->377487359) 00002000:00010000:1.0:1787826994.743461:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfe1c0 00000100:00100000:1.0:1787826994.743493:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 382 00000100:00100000:1.0:1787826994.743502:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134260352:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826994.755107:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134260352:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11599us (11815us total) trans 30064771387 rc 0/0 00000100:00100000:1.0:1787826994.755117:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 382 00002000:00100000:1.0:1787826994.755127:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (373293056->377487359) req@ffff8d547fbfe1c0 x1874672134260352/t30064771387(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/448 e 0 to 0 dl 1787827005 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826994.755136:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfe1c0 with x1874672134260352 ext(373293056->377487359) 00002000:00010000:1.0:1787826994.755141:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfe1c0 00000100:00100000:3.0:1787826994.769440:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826994.769462:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143767040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826994.769521:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826994.769568:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143767168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826994.769573:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767040 00000100:00100000:1.0:1787826994.769581:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767040 00000100:00100000:3.0:1787826994.769590:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826994.769638:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826994.769648:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767168 00000100:00100000:1.0:1787826994.769663:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767168 00000100:00100000:0.0:1787826994.769701:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787826994.769714:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787826994.769734:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143767040:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826994.769737:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143767168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826994.769772:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 565077440 pending 80158720 free 2849767424 avail 2618245120 00002000:00000024:0.0:1787826994.769776:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 565077440 pending 80158720 free 2849767424 avail 2618245120 00000100:00100000:1.0:1787826994.769831:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143767168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826994.769841:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787826994.769852:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143767040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826994.769870:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787826994.769881:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143767040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787826994.769883:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826994.769906:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143767168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826994.969173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826994.969240:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260480 00000100:00100000:3.0:1787826994.969249:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260480 00002000:00100000:3.0:1787826994.969296:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (377487360->381681663) req@ffff8d547fb47480 x1874672134260480/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/0 e 0 to 0 dl 1787827005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826994.969315:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb47480 with x1874672134260480 ext(377487360->381681663) 00002000:00010000:3.0:1787826994.969323:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb47480 00000100:00100000:3.0:1787826994.969361:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 383 00000100:00100000:3.0:1787826994.969372:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134260480:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826994.980898:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134260480:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11519us (11721us total) trans 30064771388 rc 0/0 00000100:00100000:3.0:1787826994.980911:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 383 00002000:00100000:3.0:1787826994.980925:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (377487360->381681663) req@ffff8d547fb47480 x1874672134260480/t30064771388(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:595/0 lens 488/448 e 0 to 0 dl 1787827005 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826994.980935:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb47480 with x1874672134260480 ext(377487360->381681663) 00002000:00010000:3.0:1787826994.980941:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb47480 00000100:00100000:0.0:1787826995.190256:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826995.190342:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260608 00000100:00100000:2.0:1787826995.190357:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260608 00002000:00100000:2.0:1787826995.190415:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (381681664->385875967) req@ffff8d547fe0de00 x1874672134260608/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/0 e 0 to 0 dl 1787827006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826995.190423:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787826995.190436:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0de00 with x1874672134260608 ext(381681664->385875967) 00002000:00010000:2.0:1787826995.190444:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0de00 00000100:00100000:2.0:1787826995.190474:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 384 00000100:00100000:2.0:1787826995.190484:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134260608:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826995.202259:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134260608:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11768us (12035us total) trans 30064771389 rc 0/0 00000100:00100000:2.0:1787826995.202274:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 384 00002000:00100000:2.0:1787826995.202288:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (381681664->385875967) req@ffff8d547fe0de00 x1874672134260608/t30064771389(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/448 e 0 to 0 dl 1787827006 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826995.202299:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0de00 with x1874672134260608 ext(381681664->385875967) 00002000:00010000:2.0:1787826995.202320:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0de00 00010000:00010000:2.0:1787826995.410090:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826995.416750:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826995.416879:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260736 00000100:00100000:0.0:1787826995.416889:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260736 00002000:00100000:0.0:1787826995.416949:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (385875968->390070271) req@ffff8d547fe2d2c0 x1874672134260736/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/0 e 0 to 0 dl 1787827006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826995.416960:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2d2c0 with x1874672134260736 ext(385875968->390070271) 00002000:00010000:0.0:1787826995.416965:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2d2c0 00000100:00100000:0.0:1787826995.416996:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 385 00000100:00100000:0.0:1787826995.417003:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134260736:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826995.433321:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134260736:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16297us (16558us total) trans 30064771390 rc 0/0 00000100:00100000:1.0:1787826995.433360:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 385 00002000:00100000:1.0:1787826995.433373:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (385875968->390070271) req@ffff8d547fe2d2c0 x1874672134260736/t30064771390(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/448 e 0 to 0 dl 1787827006 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826995.433385:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2d2c0 with x1874672134260736 ext(385875968->390070271) 00002000:00010000:1.0:1787826995.433391:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2d2c0 00000100:00100000:0.0:1787826995.645278:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826995.645422:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260864 00000100:00100000:3.0:1787826995.645431:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260864 00002000:00100000:3.0:1787826995.645487:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (390070272->394264575) req@ffff8d547fe0fc00 x1874672134260864/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/0 e 0 to 0 dl 1787827006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826995.645497:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0fc00 with x1874672134260864 ext(390070272->394264575) 00002000:00010000:3.0:1787826995.645503:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0fc00 00000100:00100000:3.0:1787826995.645539:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 386 00000100:00100000:3.0:1787826995.645556:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2391:x1874672134260864:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826995.659317:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2391:x1874672134260864:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13750us (14030us total) trans 30064771391 rc 0/0 00000100:00100000:3.0:1787826995.659330:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 386 00002000:00100000:3.0:1787826995.659342:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (390070272->394264575) req@ffff8d547fe0fc00 x1874672134260864/t30064771391(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/448 e 0 to 0 dl 1787827006 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826995.659354:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0fc00 with x1874672134260864 ext(390070272->394264575) 00002000:00010000:3.0:1787826995.659366:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0fc00 00000001:00080000:2.0:1787826995.659761:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771391 is committed 00000100:00100000:1.0:1787826995.877317:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826995.877452:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134260992 00000100:00100000:2.0:1787826995.877461:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134260992 00002000:00100000:2.0:1787826995.877498:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (394264576->398458879) req@ffff8d547fe2f480 x1874672134260992/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/0 e 0 to 0 dl 1787827006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826995.877506:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2f480 with x1874672134260992 ext(394264576->398458879) 00002000:00010000:2.0:1787826995.877510:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2f480 00000100:00100000:2.0:1787826995.877558:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 387 00000100:00100000:2.0:1787826995.877570:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134260992:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826995.896252:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134260992:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18676us (18948us total) trans 30064771392 rc 0/0 00000100:00100000:2.0:1787826995.896266:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 387 00002000:00100000:2.0:1787826995.896278:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (394264576->398458879) req@ffff8d547fe2f480 x1874672134260992/t30064771392(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:596/0 lens 488/448 e 0 to 0 dl 1787827006 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826995.896290:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2f480 with x1874672134260992 ext(394264576->398458879) 00002000:00010000:2.0:1787826995.896306:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2f480 00000100:00100000:0.0:1787826996.104262:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826996.105363:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134261120 00000100:00100000:1.0:1787826996.105375:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134261120 00002000:00100000:1.0:1787826996.105424:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (398458880->402653183) req@ffff8d547fe0f840 x1874672134261120/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/0 e 0 to 0 dl 1787827007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826996.105436:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0f840 with x1874672134261120 ext(398458880->402653183) 00002000:00010000:1.0:1787826996.105442:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0f840 00000100:00100000:1.0:1787826996.105480:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 388 00000100:00100000:1.0:1787826996.105490:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134261120:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826996.122256:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134261120:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16760us (18038us total) trans 30064771393 rc 0/0 00000100:00100000:2.0:1787826996.122272:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 388 00002000:00100000:2.0:1787826996.122285:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (398458880->402653183) req@ffff8d547fe0f840 x1874672134261120/t30064771393(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/448 e 0 to 0 dl 1787827007 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826996.122311:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0f840 with x1874672134261120 ext(398458880->402653183) 00002000:00010000:2.0:1787826996.122318:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0f840 00000100:00100000:1.0:1787826996.338573:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826996.338639:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134261248 00000100:00100000:2.0:1787826996.338648:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134261248 00002000:00100000:2.0:1787826996.338691:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (402653184->406847487) req@ffff8d547fe2cb40 x1874672134261248/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/0 e 0 to 0 dl 1787827007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826996.338703:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2cb40 with x1874672134261248 ext(402653184->406847487) 00002000:00010000:2.0:1787826996.338709:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2cb40 00000100:00100000:1.0:1787826996.339019:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 389 00000100:00100000:1.0:1787826996.339031:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134261248:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826996.354973:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134261248:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15934us (16398us total) trans 30064771394 rc 0/0 00000100:00100000:2.0:1787826996.355003:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 389 00002000:00100000:2.0:1787826996.355015:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (402653184->406847487) req@ffff8d547fe2cb40 x1874672134261248/t30064771394(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/448 e 0 to 0 dl 1787827007 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826996.355025:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2cb40 with x1874672134261248 ext(402653184->406847487) 00002000:00010000:2.0:1787826996.355030:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2cb40 00010000:00010000:0.0:1787826996.433527:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826996.580789:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826996.580971:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134261376 00000100:00100000:2.0:1787826996.580980:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134261376 00002000:00100000:2.0:1787826996.581029:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (406847488->411041791) req@ffff8d547fe2f0c0 x1874672134261376/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/0 e 0 to 0 dl 1787827007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826996.581040:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2f0c0 with x1874672134261376 ext(406847488->411041791) 00002000:00010000:2.0:1787826996.581046:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2f0c0 00000100:00100000:2.0:1787826996.581079:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 390 00000100:00100000:2.0:1787826996.581089:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134261376:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826996.604279:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134261376:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23181us (23486us total) trans 30064771395 rc 0/0 00000100:00100000:2.0:1787826996.604305:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 390 00002000:00100000:2.0:1787826996.604318:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (406847488->411041791) req@ffff8d547fe2f0c0 x1874672134261376/t30064771395(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/448 e 0 to 0 dl 1787827007 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826996.604329:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2f0c0 with x1874672134261376 ext(406847488->411041791) 00002000:00010000:2.0:1787826996.604335:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2f0c0 00000100:00100000:0.0:1787826996.625126:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826996.625164:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826996.625190:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134261504 00000100:00100000:1.0:1787826996.625200:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134261504 00000100:00100000:0.0:1787826996.625209:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826996.625248:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134261760 00000100:00100000:2.0:1787826996.625254:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134261760 00000100:00100000:3.0:1787826996.625285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134261632 00000100:00100000:3.0:1787826996.625301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134261632 00000100:00100000:1.0:1787826996.625320:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 521 00000100:00080000:0.0:1787826996.625322:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826996.625328:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826996.625333:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 392 00000100:00100000:1.0:1787826996.625335:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134261504:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826996.625354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 393 00000100:00100000:2.0:1787826996.625355:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134261760:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787826996.625369:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134261632:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787826996.625417:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134261760:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 61us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826996.625420:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134261504:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826996.625420:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2393:x1874672134261632:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826996.625427:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 392 00000100:00100000:1.0:1787826996.625438:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 521 00000100:00100000:3.0:1787826996.625456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 393 00000100:00100000:3.0:1787826996.820715:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826996.820799:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134261888 00000100:00100000:1.0:1787826996.820809:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134261888 00002000:00100000:1.0:1787826996.820852:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (411041792->415236095) req@ffff8d547fe292c0 x1874672134261888/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/0 e 0 to 0 dl 1787827007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826996.820863:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe292c0 with x1874672134261888 ext(411041792->415236095) 00002000:00010000:1.0:1787826996.820869:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe292c0 00000100:00100000:1.0:1787826996.820904:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 391 00000100:00100000:1.0:1787826996.820913:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134261888:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826996.838094:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134261888:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17167us (17371us total) trans 30064771396 rc 0/0 00000100:00100000:1.0:1787826996.838106:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 391 00002000:00100000:1.0:1787826996.838118:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (411041792->415236095) req@ffff8d547fe292c0 x1874672134261888/t30064771396(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:597/0 lens 488/448 e 0 to 0 dl 1787827007 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826996.838143:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe292c0 with x1874672134261888 ext(411041792->415236095) 00002000:00010000:1.0:1787826996.838150:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe292c0 00000100:00100000:3.0:1787826997.064950:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826997.065024:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262016 00000100:00100000:2.0:1787826997.065033:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262016 00002000:00100000:2.0:1787826997.065101:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (415236096->419430399) req@ffff8d547fe2a580 x1874672134262016/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/0 e 0 to 0 dl 1787827008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826997.065112:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2a580 with x1874672134262016 ext(415236096->419430399) 00002000:00010000:2.0:1787826997.065117:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2a580 00000100:00100000:2.0:1787826997.065148:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 392 00000100:00100000:2.0:1787826997.065157:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134262016:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:0.0:1787826997.065462:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826997.080452:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134262016:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15281us (15495us total) trans 30064771397 rc 0/0 00000100:00100000:0.0:1787826997.080468:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 392 00002000:00100000:0.0:1787826997.080480:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (415236096->419430399) req@ffff8d547fe2a580 x1874672134262016/t30064771397(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/448 e 0 to 0 dl 1787827008 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826997.080507:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2a580 with x1874672134262016 ext(415236096->419430399) 00002000:00010000:0.0:1787826997.080513:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2a580 00000100:00100000:1.0:1787826997.309955:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826997.310088:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262144 00000100:00100000:2.0:1787826997.310096:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262144 00002000:00100000:2.0:1787826997.310144:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (419430400->423624703) req@ffff8d547fe2c000 x1874672134262144/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/0 e 0 to 0 dl 1787827008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826997.310155:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2c000 with x1874672134262144 ext(419430400->423624703) 00002000:00010000:2.0:1787826997.310161:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2c000 00000100:00100000:2.0:1787826997.310199:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 393 00000100:00100000:2.0:1787826997.310210:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134262144:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826997.324259:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134262144:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14043us (14304us total) trans 30064771398 rc 0/0 00000100:00100000:2.0:1787826997.324270:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 393 00002000:00100000:2.0:1787826997.324279:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (419430400->423624703) req@ffff8d547fe2c000 x1874672134262144/t30064771398(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/448 e 0 to 0 dl 1787827008 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826997.324311:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2c000 with x1874672134262144 ext(419430400->423624703) 00002000:00010000:2.0:1787826997.324316:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2c000 00000100:00100000:0.0:1787826997.329490:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826997.329518:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143767296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826997.329557:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143767424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826997.329616:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826997.329658:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826997.329724:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826997.329732:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143767552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826997.329753:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767424 00000100:00100000:0.0:1787826997.329765:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767424 00000100:00100000:1.0:1787826997.329773:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.329817:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767296 00000100:00100000:3.0:1787826997.329827:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767296 00000100:00100000:0.0:1787826997.329845:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787826997.329858:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143767424:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826997.329889:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767552 00000100:00100000:3.0:1787826997.329894:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787826997.329897:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767552 00000004:00000024:0.0:1787826997.329908:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787826997.329912:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143767296:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826997.329938:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00002000:00000024:3.0:1787826997.329948:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787826997.329963:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143767552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826997.329978:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787826997.329990:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143767424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.330019:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143767296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.330029:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787826997.330040:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143767552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826997.330049:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:3.0:1787826997.330073:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787826997.330112:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2a940 x1874672143767552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826997.330365:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143767552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826997.330384:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143767424:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787826997.330428:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0d2c0 x1874672143767296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826997.330441:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143767296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826997.330501:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00010000:2.0:1787826997.457429:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826997.552717:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826997.552803:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262272 00000100:00100000:1.0:1787826997.552814:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262272 00002000:00100000:1.0:1787826997.552863:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (423624704->427819007) req@ffff8d547fe29a40 x1874672134262272/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/0 e 0 to 0 dl 1787827008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826997.552876:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe29a40 with x1874672134262272 ext(423624704->427819007) 00002000:00010000:1.0:1787826997.552881:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe29a40 00000100:00100000:1.0:1787826997.552925:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 394 00000100:00100000:1.0:1787826997.552934:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134262272:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826997.572201:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134262272:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19256us (19481us total) trans 30064771399 rc 0/0 00000100:00100000:1.0:1787826997.572245:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 394 00002000:00100000:1.0:1787826997.572259:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (423624704->427819007) req@ffff8d547fe29a40 x1874672134262272/t30064771399(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/448 e 0 to 0 dl 1787827008 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826997.572270:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe29a40 with x1874672134262272 ext(423624704->427819007) 00002000:00010000:1.0:1787826997.572276:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe29a40 00000100:00100000:3.0:1787826997.796565:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826997.796681:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262400 00000100:00100000:2.0:1787826997.796691:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262400 00002000:00100000:2.0:1787826997.796740:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (427819008->432013311) req@ffff8d547fe2a940 x1874672134262400/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/0 e 0 to 0 dl 1787827008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826997.796751:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2a940 with x1874672134262400 ext(427819008->432013311) 00002000:00010000:2.0:1787826997.796767:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2a940 00000100:00100000:2.0:1787826997.796799:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 395 00000100:00100000:2.0:1787826997.796808:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134262400:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826997.817047:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134262400:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20229us (20480us total) trans 30064771400 rc 0/0 00000100:00100000:2.0:1787826997.817061:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 395 00002000:00100000:2.0:1787826997.817073:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (427819008->432013311) req@ffff8d547fe2a940 x1874672134262400/t30064771400(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:598/0 lens 488/448 e 0 to 0 dl 1787827008 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826997.817084:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2a940 with x1874672134262400 ext(427819008->432013311) 00002000:00010000:2.0:1787826997.817091:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2a940 00000100:00100000:1.0:1787826997.841678:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143767808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.841707:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143768064:0@lo:400:kworker.0 00000100:00100000:2.0:1787826997.841752:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143767680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826997.841760:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.841785:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826997.841804:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.841820:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143768576:0@lo:400:kworker.0 00000100:00100000:1.0:1787826997.841831:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143768320:0@lo:400:kworker.0 00000100:00100000:2.0:1787826997.841840:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143768192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.841854:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.841880:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787826997.841882:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826997.841883:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.841895:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143767936:0@lo:400:kworker.0 00000100:00100000:1.0:1787826997.841914:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143768832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826997.841917:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143768704:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.841926:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826997.841958:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.841966:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143768448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826997.841970:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768576 00000100:00100000:2.0:1787826997.841978:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768576 00000100:00100000:3.0:1787826997.841997:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.842031:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768064 00000100:00100000:3.0:1787826997.842035:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768064 00000100:00100000:0.0:1787826997.842051:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767680 00000100:00100000:0.0:1787826997.842057:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767680 00000100:00100000:3.0:1787826997.842070:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787826997.842080:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143768064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826997.842092:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1787826997.842102:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842132:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143768064:12345-0@lo:400:kworker.0 Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.842141:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787826997.842149:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143767680:12345-0@lo:400:kworker.0 Request processed in 48us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826997.842157:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1787826997.842164:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767808 00000100:00100000:3.0:1787826997.842168:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767808 00000100:00100000:3.0:1787826997.842193:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768320 00000100:00100000:3.0:1787826997.842196:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768320 00000100:00100000:3.0:1787826997.842207:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143767936 00000100:00100000:3.0:1787826997.842209:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143767936 00000100:00100000:3.0:1787826997.842242:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768832 00000100:00100000:3.0:1787826997.842245:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768832 00000100:00100000:3.0:1787826997.842255:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768448 00000100:00100000:3.0:1787826997.842257:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768448 00000100:00100000:3.0:1787826997.842272:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787826997.842277:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143767808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842318:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143767808:12345-0@lo:400:kworker.0 Request processed in 40us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.842323:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787826997.842333:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1787826997.842338:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143768320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842368:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143768320:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.842375:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1787826997.842387:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787826997.842394:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143767936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842418:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143767936:12345-0@lo:400:kworker.0 Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.842423:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787826997.842431:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1787826997.842436:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143768832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826997.842458:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143767808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842469:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143768832:12345-0@lo:400:kworker.0 Request processed in 20us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.842476:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787826997.842489:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143768320:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842491:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1787826997.842501:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143768448:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826997.842508:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa60f00 x1874672143768832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826997.842520:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143768832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842530:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143768448:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.842536:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787826997.842548:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826997.842565:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768704 00000100:00100000:3.0:1787826997.842569:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768704 00000100:00100000:1.0:1787826997.842581:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143767680:0@lo:400:kworker.0 00000100:00100000:2.0:1787826997.842592:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768192 00000100:00100000:2.0:1787826997.842597:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768192 00000100:00100000:3.0:1787826997.842601:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787826997.842610:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143768704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842640:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143768704:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826997.842646:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00080000:3.0:1787826997.842666:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826997.842670:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826997.842673:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826997.842687:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143768704:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842711:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143767936:0@lo:400:kworker.0 00010000:00080000:3.0:1787826997.842724:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa60000 x1874672143768448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826997.842734:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143768448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.842742:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143768064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826997.845212:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787826997.845246:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787826997.845250:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143768576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826997.845261:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143768192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826997.845341:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143768576:12345-0@lo:400:kworker.0 Request processed in 100us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826997.845346:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143768192:12345-0@lo:400:kworker.0 Request processed in 87us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826997.845352:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787826997.845370:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787826997.845377:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143768192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826997.845388:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143768576:0@lo:400:kworker.0 00000100:00100000:1.0:1787826998.044896:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826998.045438:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262528 00000100:00100000:2.0:1787826998.045447:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262528 00002000:00100000:2.0:1787826998.045493:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (432013312->436207615) req@ffff8d547fa61e00 x1874672134262528/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/0 e 0 to 0 dl 1787827009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826998.045523:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa61e00 with x1874672134262528 ext(432013312->436207615) 00002000:00010000:2.0:1787826998.045528:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa61e00 00000100:00100000:0.0:1787826998.045615:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 396 00000100:00100000:0.0:1787826998.045628:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134262528:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787826998.060436:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134262528:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14805us (15539us total) trans 30064771401 rc 0/0 00000100:00100000:0.0:1787826998.060446:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 396 00002000:00100000:0.0:1787826998.060456:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (432013312->436207615) req@ffff8d547fa61e00 x1874672134262528/t30064771401(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/448 e 0 to 0 dl 1787827009 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826998.060465:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa61e00 with x1874672134262528 ext(432013312->436207615) 00002000:00010000:0.0:1787826998.060469:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa61e00 00000100:00100000:3.0:1787826998.281754:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826998.281911:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262656 00000100:00100000:1.0:1787826998.281921:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262656 00002000:00100000:1.0:1787826998.281965:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (436207616->440401919) req@ffff8d547fbbc000 x1874672134262656/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/0 e 0 to 0 dl 1787827009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826998.281990:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbc000 with x1874672134262656 ext(436207616->440401919) 00002000:00010000:1.0:1787826998.281996:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbc000 00000100:00100000:1.0:1787826998.282029:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 397 00000100:00100000:1.0:1787826998.282038:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2391:x1874672134262656:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826998.306905:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134262656:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 24857us (25149us total) trans 30064771402 rc 0/0 00000100:00100000:2.0:1787826998.306920:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 397 00002000:00100000:2.0:1787826998.306934:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (436207616->440401919) req@ffff8d547fbbc000 x1874672134262656/t30064771402(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/448 e 0 to 0 dl 1787827009 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826998.306944:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbc000 with x1874672134262656 ext(436207616->440401919) 00002000:00010000:2.0:1787826998.306951:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbc000 00000100:00100000:3.0:1787826998.353733:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826998.353756:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143768960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826998.353823:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826998.354236:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143768960 00000100:00100000:1.0:1787826998.354245:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143768960 00000100:00100000:1.0:1787826998.354306:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787826998.354315:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143768960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826998.354404:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787826998.354458:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143768960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826998.354466:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787826998.354497:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143768960:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787826998.482113:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826998.535503:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826998.536412:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262784 00000100:00100000:1.0:1787826998.536423:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262784 00002000:00100000:1.0:1787826998.536474:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (440401920->444596223) req@ffff8d547fbfd680 x1874672134262784/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/0 e 0 to 0 dl 1787827009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826998.536485:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfd680 with x1874672134262784 ext(440401920->444596223) 00002000:00010000:1.0:1787826998.536502:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfd680 00000100:00100000:1.0:1787826998.536537:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 398 00000100:00100000:1.0:1787826998.536551:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134262784:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826998.559663:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134262784:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23102us (24158us total) trans 30064771403 rc 0/0 00000100:00100000:1.0:1787826998.559679:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 398 00002000:00100000:1.0:1787826998.559704:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (440401920->444596223) req@ffff8d547fbfd680 x1874672134262784/t30064771403(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/448 e 0 to 0 dl 1787827009 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826998.559715:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfd680 with x1874672134262784 ext(440401920->444596223) 00002000:00010000:1.0:1787826998.559721:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfd680 00000100:00100000:0.0:1787826998.793152:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826998.793241:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134262912 00000100:00100000:1.0:1787826998.793251:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134262912 00002000:00100000:1.0:1787826998.793311:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (444596224->448790527) req@ffff8d547fe0f0c0 x1874672134262912/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/0 e 0 to 0 dl 1787827009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826998.793321:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0f0c0 with x1874672134262912 ext(444596224->448790527) 00002000:00010000:1.0:1787826998.793326:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0f0c0 00000100:00100000:1.0:1787826998.793360:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 399 00000100:00100000:1.0:1787826998.793381:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134262912:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826998.811445:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134262912:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18049us (18285us total) trans 30064771404 rc 0/0 00000100:00100000:1.0:1787826998.811464:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 399 00002000:00100000:1.0:1787826998.811481:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (444596224->448790527) req@ffff8d547fe0f0c0 x1874672134262912/t30064771404(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:599/0 lens 488/448 e 0 to 0 dl 1787827009 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826998.811493:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0f0c0 with x1874672134262912 ext(444596224->448790527) 00002000:00010000:1.0:1787826998.811502:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0f0c0 00000100:00100000:2.0:1787826999.033328:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787826999.033487:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263040 00000100:00100000:1.0:1787826999.033503:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263040 00002000:00100000:1.0:1787826999.033595:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (448790528->452984831) req@ffff8d547fbff480 x1874672134263040/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/0 e 0 to 0 dl 1787827010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826999.033609:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbff480 with x1874672134263040 ext(448790528->452984831) 00002000:00010000:1.0:1787826999.033627:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbff480 00000100:00080000:3.0:1787826999.033748:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826999.033804:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 400 00000100:00100000:1.0:1787826999.033819:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134263040:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787826999.059880:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134263040:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 26056us (26553us total) trans 30064771405 rc 0/0 00000100:00100000:1.0:1787826999.059894:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 400 00002000:00100000:1.0:1787826999.059907:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (448790528->452984831) req@ffff8d547fbff480 x1874672134263040/t30064771405(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/448 e 0 to 0 dl 1787827010 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826999.059919:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbff480 with x1874672134263040 ext(448790528->452984831) 00002000:00010000:1.0:1787826999.059925:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbff480 00000100:00100000:1.0:1787826999.289312:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826999.289391:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263168 00000100:00100000:2.0:1787826999.289401:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263168 00002000:00100000:2.0:1787826999.289468:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (452984832->457179135) req@ffff8d547fa63480 x1874672134263168/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/0 e 0 to 0 dl 1787827010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826999.289480:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa63480 with x1874672134263168 ext(452984832->457179135) 00002000:00010000:2.0:1787826999.289486:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa63480 00000100:00100000:2.0:1787826999.289528:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 401 00000100:00100000:2.0:1787826999.289538:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134263168:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826999.316926:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134263168:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 27380us (27614us total) trans 30064771406 rc 0/0 00000100:00100000:2.0:1787826999.316940:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 401 00002000:00100000:2.0:1787826999.316964:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (452984832->457179135) req@ffff8d547fa63480 x1874672134263168/t30064771406(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/448 e 0 to 0 dl 1787827010 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826999.316976:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa63480 with x1874672134263168 ext(452984832->457179135) 00002000:00010000:2.0:1787826999.316983:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa63480 00010000:00010000:2.0:1787826999.505456:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826999.523261:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787826999.523336:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263296 00000100:00100000:3.0:1787826999.523345:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263296 00002000:00100000:3.0:1787826999.523398:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (457179136->461373439) req@ffff8d547fa603c0 x1874672134263296/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/0 e 0 to 0 dl 1787827010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826999.523409:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa603c0 with x1874672134263296 ext(457179136->461373439) 00002000:00010000:3.0:1787826999.523415:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa603c0 00000100:00100000:3.0:1787826999.523442:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 402 00000100:00100000:3.0:1787826999.523457:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134263296:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787826999.543024:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134263296:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19556us (19754us total) trans 30064771407 rc 0/0 00000100:00100000:3.0:1787826999.543048:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 402 00002000:00100000:3.0:1787826999.543062:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (457179136->461373439) req@ffff8d547fa603c0 x1874672134263296/t30064771407(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/448 e 0 to 0 dl 1787827010 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826999.543073:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa603c0 with x1874672134263296 ext(457179136->461373439) 00002000:00010000:3.0:1787826999.543079:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa603c0 00000100:00100000:0.0:1787826999.764692:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787826999.764793:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263424 00000100:00100000:2.0:1787826999.764802:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263424 00002000:00100000:2.0:1787826999.764844:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (461373440->465567743) req@ffff8d547fe0c000 x1874672134263424/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/0 e 0 to 0 dl 1787827010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826999.764855:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0c000 with x1874672134263424 ext(461373440->465567743) 00002000:00010000:2.0:1787826999.764861:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0c000 00000100:00100000:2.0:1787826999.764893:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 403 00000100:00100000:2.0:1787826999.764901:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134263424:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787826999.782777:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134263424:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17866us (18082us total) trans 30064771408 rc 0/0 00000100:00100000:2.0:1787826999.782791:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 403 00002000:00100000:2.0:1787826999.782806:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (461373440->465567743) req@ffff8d547fe0c000 x1874672134263424/t30064771408(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/448 e 0 to 0 dl 1787827010 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826999.782817:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0c000 with x1874672134263424 ext(461373440->465567743) 00002000:00010000:2.0:1787826999.782824:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0c000 00000100:00100000:3.0:1787826999.889379:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143769088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826999.889388:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143769216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826999.889446:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826999.889471:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826999.889501:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769216 00000100:00100000:2.0:1787826999.889509:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769216 00000100:00100000:3.0:1787826999.889543:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769088 00000100:00100000:3.0:1787826999.889550:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769088 00000100:00100000:2.0:1787826999.889574:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787826999.889586:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787826999.889588:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143769216:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826999.889601:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143769088:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787826999.889613:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787826999.889628:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 36864 granted 556676544 pending 71720960 free 2849767424 avail 2618245120 00002000:00000024:0.0:1787826999.889637:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 36864 granted 556676544 pending 71720960 free 2849767424 avail 2618245120 00000100:00100000:0.0:1787826999.889693:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143769088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826999.889706:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787826999.889707:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143769216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826999.889718:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787826999.889831:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143769088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826999.889858:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143769216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826999.992903:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787826999.992983:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263552 00000100:00100000:0.0:1787826999.992999:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263552 00002000:00100000:0.0:1787826999.993062:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (465567744->469762047) req@ffff8d547fa62940 x1874672134263552/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/0 e 0 to 0 dl 1787827010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826999.993073:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62940 with x1874672134263552 ext(465567744->469762047) 00002000:00010000:0.0:1787826999.993079:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62940 00000100:00100000:0.0:1787826999.993108:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 404 00000100:00100000:0.0:1787826999.993118:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134263552:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827000.011405:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134263552:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18278us (18498us total) trans 30064771409 rc 0/0 00000100:00100000:2.0:1787827000.011429:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 404 00002000:00100000:2.0:1787827000.011443:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (465567744->469762047) req@ffff8d547fa62940 x1874672134263552/t30064771409(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:600/0 lens 488/448 e 0 to 0 dl 1787827010 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827000.011465:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62940 with x1874672134263552 ext(465567744->469762047) 00002000:00010000:2.0:1787827000.011471:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62940 00000100:00100000:1.0:1787827000.220790:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827000.220850:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263680 00000100:00100000:2.0:1787827000.220860:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263680 00002000:00100000:2.0:1787827000.220907:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (469762048->473956351) req@ffff8d547fa63c00 x1874672134263680/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/0 e 0 to 0 dl 1787827011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827000.220918:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa63c00 with x1874672134263680 ext(469762048->473956351) 00002000:00010000:2.0:1787827000.220924:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa63c00 00000100:00100000:2.0:1787827000.220953:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 405 00000100:00100000:2.0:1787827000.220962:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134263680:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827000.232626:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134263680:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11657us (11836us total) trans 30064771410 rc 0/0 00000100:00100000:2.0:1787827000.232637:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 405 00002000:00100000:2.0:1787827000.232649:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (469762048->473956351) req@ffff8d547fa63c00 x1874672134263680/t30064771410(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/448 e 0 to 0 dl 1787827011 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827000.232682:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa63c00 with x1874672134263680 ext(469762048->473956351) 00002000:00010000:2.0:1787827000.232688:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa63c00 00000100:00100000:1.0:1787827000.455470:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827000.455659:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263808 00000100:00100000:2.0:1787827000.455680:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263808 00002000:00100000:2.0:1787827000.455729:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (473956352->478150655) req@ffff8d547fa61680 x1874672134263808/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/0 e 0 to 0 dl 1787827011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827000.455741:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa61680 with x1874672134263808 ext(473956352->478150655) 00002000:00010000:2.0:1787827000.455747:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa61680 00000100:00100000:2.0:1787827000.455781:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 406 00000100:00100000:2.0:1787827000.455792:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134263808:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827000.472563:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134263808:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16763us (17093us total) trans 30064771411 rc 0/0 00000100:00100000:1.0:1787827000.472629:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 406 00002000:00100000:1.0:1787827000.472644:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (473956352->478150655) req@ffff8d547fa61680 x1874672134263808/t30064771411(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/448 e 0 to 0 dl 1787827011 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827000.472655:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa61680 with x1874672134263808 ext(473956352->478150655) 00002000:00010000:1.0:1787827000.472672:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa61680 00010000:00010000:0.0:1787827000.530201:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827000.701312:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827000.701563:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134263936 00000100:00100000:3.0:1787827000.701576:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134263936 00002000:00100000:3.0:1787827000.701642:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (478150656->482344959) req@ffff8d547fa60000 x1874672134263936/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/0 e 0 to 0 dl 1787827011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827000.701654:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa60000 with x1874672134263936 ext(478150656->482344959) 00002000:00010000:3.0:1787827000.701660:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa60000 00000100:00100000:3.0:1787827000.701702:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 407 00000100:00100000:3.0:1787827000.701712:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134263936:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827000.720534:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134263936:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18813us (19225us total) trans 30064771412 rc 0/0 00000100:00100000:3.0:1787827000.720548:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 407 00002000:00100000:3.0:1787827000.720560:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (478150656->482344959) req@ffff8d547fa60000 x1874672134263936/t30064771412(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/448 e 0 to 0 dl 1787827011 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827000.720580:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa60000 with x1874672134263936 ext(478150656->482344959) 00002000:00010000:3.0:1787827000.720586:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa60000 00000100:00100000:1.0:1787827000.945803:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827000.945891:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264064 00000100:00100000:2.0:1787827000.945900:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264064 00002000:00100000:2.0:1787827000.945948:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (482344960->486539263) req@ffff8d547fa62d00 x1874672134264064/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/0 e 0 to 0 dl 1787827011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827000.945960:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62d00 with x1874672134264064 ext(482344960->486539263) 00002000:00010000:2.0:1787827000.945965:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62d00 00000100:00100000:0.0:1787827000.946054:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 408 00000100:00100000:0.0:1787827000.946066:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134264064:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827000.959312:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134264064:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13240us (13512us total) trans 30064771413 rc 0/0 00000100:00100000:0.0:1787827000.959324:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 408 00002000:00100000:0.0:1787827000.959348:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (482344960->486539263) req@ffff8d547fa62d00 x1874672134264064/t30064771413(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:601/0 lens 488/448 e 0 to 0 dl 1787827011 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827000.959359:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62d00 with x1874672134264064 ext(482344960->486539263) 00002000:00010000:0.0:1787827000.959365:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62d00 00000001:00080000:3.0:1787827000.960067:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771413 is committed 00000100:00100000:2.0:1787827001.185419:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827001.185540:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264192 00000100:00100000:1.0:1787827001.185549:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264192 00000100:00080000:0.0:1787827001.185604:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787827001.185611:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (486539264->490733567) req@ffff8d547fbff840 x1874672134264192/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/0 e 0 to 0 dl 1787827012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827001.185623:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbff840 with x1874672134264192 ext(486539264->490733567) 00002000:00010000:1.0:1787827001.185629:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbff840 00000100:00100000:1.0:1787827001.185658:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 409 00000100:00100000:1.0:1787827001.185670:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134264192:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827001.203370:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134264192:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17692us (17964us total) trans 30064771414 rc 0/0 00000100:00100000:0.0:1787827001.203385:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 409 00002000:00100000:0.0:1787827001.203398:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (486539264->490733567) req@ffff8d547fbff840 x1874672134264192/t30064771414(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/448 e 0 to 0 dl 1787827012 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827001.203414:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbff840 with x1874672134264192 ext(486539264->490733567) 00002000:00010000:0.0:1787827001.203420:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbff840 00000100:00100000:1.0:1787827001.418024:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827001.418094:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264320 00000100:00100000:3.0:1787827001.418104:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264320 00002000:00100000:3.0:1787827001.418152:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (490733568->494927871) req@ffff8d547fb2fc00 x1874672134264320/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/0 e 0 to 0 dl 1787827012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827001.418163:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2fc00 with x1874672134264320 ext(490733568->494927871) 00002000:00010000:3.0:1787827001.418168:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2fc00 00000100:00100000:3.0:1787827001.418210:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 410 00000100:00100000:3.0:1787827001.418247:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134264320:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827001.434909:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134264320:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16656us (16883us total) trans 30064771415 rc 0/0 00000100:00100000:3.0:1787827001.434923:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 410 00002000:00100000:3.0:1787827001.434935:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (490733568->494927871) req@ffff8d547fb2fc00 x1874672134264320/t30064771415(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/448 e 0 to 0 dl 1787827012 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827001.434946:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2fc00 with x1874672134264320 ext(490733568->494927871) 00002000:00010000:3.0:1787827001.434951:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2fc00 00010000:00010000:2.0:1787827001.553412:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827001.652208:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827001.652297:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264448 00000100:00100000:2.0:1787827001.652306:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264448 00002000:00100000:2.0:1787827001.652369:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (494927872->499122175) req@ffff8d547fe0da40 x1874672134264448/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/0 e 0 to 0 dl 1787827012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827001.652381:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0da40 with x1874672134264448 ext(494927872->499122175) 00002000:00010000:2.0:1787827001.652387:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0da40 00000100:00100000:2.0:1787827001.652440:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 411 00000100:00100000:2.0:1787827001.652451:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134264448:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827001.668874:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134264448:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16419us (16668us total) trans 30064771416 rc 0/0 00000100:00100000:2.0:1787827001.668883:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 411 00002000:00100000:2.0:1787827001.668894:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (494927872->499122175) req@ffff8d547fe0da40 x1874672134264448/t30064771416(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/448 e 0 to 0 dl 1787827012 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827001.668905:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0da40 with x1874672134264448 ext(494927872->499122175) 00002000:00010000:2.0:1787827001.668910:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0da40 00000100:00100000:1.0:1787827001.745181:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827001.745328:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827001.745387:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827001.745391:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264832 00000100:00100000:3.0:1787827001.745400:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264832 00000100:00100000:2.0:1787827001.745441:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264704 00000100:00080000:1.0:1787827001.745446:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827001.745447:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264704 00000100:00100000:3.0:1787827001.745468:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 400 00000100:00080000:1.0:1787827001.745473:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827001.745482:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134264832:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827001.745497:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 401 00000100:00100000:2.0:1787827001.745509:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134264704:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827001.745545:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264576 00000100:00100000:0.0:1787827001.745551:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264576 00000100:00100000:2.0:1787827001.745573:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134264704:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827001.745581:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 401 00000100:00100000:0.0:1787827001.745595:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 523 00000100:00100000:0.0:1787827001.745607:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134264576:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827001.745611:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134264832:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827001.745632:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 400 00000100:00100000:0.0:1787827001.745670:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134264576:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827001.745677:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 523 00000100:00100000:0.0:1787827001.746068:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827001.746110:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134264960 00000100:00100000:2.0:1787827001.746115:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134264960 00002000:00100000:2.0:1787827001.746142:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (499122176->500785151) req@ffff8d547fe0ed00 x1874672134264960/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/0 e 0 to 0 dl 1787827012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827001.746152:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0ed00 with x1874672134264960 ext(499122176->500785151) 00002000:00010000:2.0:1787827001.746156:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0ed00 00000100:00100000:2.0:1787827001.746182:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 412 00000100:00100000:2.0:1787827001.746190:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134264960:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827001.746983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827001.747036:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265088 00000100:00100000:0.0:1787827001.747041:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265088 00002000:00100000:0.0:1787827001.747064:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (500785152->500805631) req@ffff8d547fb2e1c0 x1874672134265088/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/0 e 0 to 0 dl 1787827012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827001.747073:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2e1c0 with x1874672134265088 ext(500785152->500805631) 00002000:00010000:0.0:1787827001.747076:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2e1c0 00000100:00100000:0.0:1787827001.747098:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 413 00000100:00100000:0.0:1787827001.747106:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134265088:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827001.755520:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2390:x1874672134265088:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 8396us (8519us total) trans 30064771418 rc 0/0 00000100:00100000:1.0:1787827001.755537:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 413 00002000:00100000:1.0:1787827001.755552:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (500785152->500805631) req@ffff8d547fb2e1c0 x1874672134265088/t30064771418(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/448 e 0 to 0 dl 1787827012 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827001.755560:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2e1c0 with x1874672134265088 ext(500785152->500805631) 00002000:00010000:1.0:1787827001.755566:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2e1c0 00000100:00100000:2.0:1787827001.755582:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2390:x1874672134264960:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 9390us (9510us total) trans 30064771417 rc 0/0 00000100:00100000:2.0:1787827001.755595:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 412 00002000:00100000:2.0:1787827001.755607:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (499122176->500785151) req@ffff8d547fe0ed00 x1874672134264960/t30064771417(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:602/0 lens 488/448 e 0 to 0 dl 1787827012 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827001.755616:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0ed00 with x1874672134264960 ext(499122176->500785151) 00002000:00010000:2.0:1787827001.755621:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0ed00 00000100:00100000:0.0:1787827002.123281:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827002.123433:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265216 00000100:00100000:1.0:1787827002.123443:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265216 00002000:00100000:1.0:1787827002.123495:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (503316480->507510783) req@ffff8d547fe0cf00 x1874672134265216/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/0 e 0 to 0 dl 1787827013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827002.123506:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0cf00 with x1874672134265216 ext(503316480->507510783) 00002000:00010000:1.0:1787827002.123512:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0cf00 00000100:00100000:1.0:1787827002.123681:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 414 00000100:00100000:1.0:1787827002.123692:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134265216:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827002.141002:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134265216:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17302us (17781us total) trans 30064771419 rc 0/0 00000100:00100000:1.0:1787827002.141017:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 414 00002000:00100000:1.0:1787827002.141029:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (503316480->507510783) req@ffff8d547fe0cf00 x1874672134265216/t30064771419(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/448 e 0 to 0 dl 1787827013 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827002.141038:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0cf00 with x1874672134265216 ext(503316480->507510783) 00002000:00010000:1.0:1787827002.141042:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0cf00 00000100:00100000:3.0:1787827002.353006:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827002.353085:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265344 00000100:00100000:1.0:1787827002.353095:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265344 00002000:00100000:1.0:1787827002.353138:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (507510784->511705087) req@ffff8d547fbbed00 x1874672134265344/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/0 e 0 to 0 dl 1787827013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827002.353147:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbed00 with x1874672134265344 ext(507510784->511705087) 00002000:00010000:1.0:1787827002.353151:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbed00 00000100:00100000:1.0:1787827002.353184:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 415 00000100:00100000:1.0:1787827002.353193:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134265344:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827002.364175:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134265344:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10973us (11166us total) trans 30064771420 rc 0/0 00000100:00100000:1.0:1787827002.364196:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 415 00002000:00100000:1.0:1787827002.364209:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (507510784->511705087) req@ffff8d547fbbed00 x1874672134265344/t30064771420(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/448 e 0 to 0 dl 1787827013 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827002.364243:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbed00 with x1874672134265344 ext(507510784->511705087) 00002000:00010000:1.0:1787827002.364262:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbed00 00000100:00100000:0.0:1787827002.449458:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787827002.449469:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787827002.449484:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143769472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827002.449485:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143769600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827002.449559:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827002.449598:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827002.449625:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143769344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827002.449628:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769600 00000100:00100000:3.0:1787827002.449636:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769600 00000100:00100000:2.0:1787827002.449654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827002.449691:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769472 00000100:00100000:1.0:1787827002.449697:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769472 00000100:00100000:3.0:1787827002.449704:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787827002.449715:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143769600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827002.449740:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787827002.449750:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143769472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787827002.449752:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787827002.449764:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827002.449809:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143769472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827002.449818:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787827002.449818:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143769600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827002.449830:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787827002.449894:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769344 00000100:00100000:0.0:1787827002.449899:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769344 00000100:00100000:0.0:1787827002.449945:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787827002.449952:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143769344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787827002.449986:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827002.450022:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143769344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827002.450028:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1787827002.450044:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787827002.450070:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0c780 x1874672143769472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827002.450101:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143769472:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787827002.450209:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbbc780 x1874672143769600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827002.450347:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143769600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827002.450363:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143769344:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787827002.578127:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827002.588476:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827002.588541:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265472 00000100:00100000:0.0:1787827002.588552:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265472 00002000:00100000:0.0:1787827002.588603:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (511705088->515899391) req@ffff8d547fbbc3c0 x1874672134265472/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/0 e 0 to 0 dl 1787827013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827002.588614:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbc3c0 with x1874672134265472 ext(511705088->515899391) 00002000:00010000:0.0:1787827002.588619:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbc3c0 00000100:00100000:0.0:1787827002.588657:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 416 00000100:00100000:0.0:1787827002.588667:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134265472:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827002.607258:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134265472:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18547us (18742us total) trans 30064771421 rc 0/0 00000100:00100000:0.0:1787827002.607273:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 416 00002000:00100000:0.0:1787827002.607286:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (511705088->515899391) req@ffff8d547fbbc3c0 x1874672134265472/t30064771421(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/448 e 0 to 0 dl 1787827013 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827002.607298:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbc3c0 with x1874672134265472 ext(511705088->515899391) 00002000:00010000:0.0:1787827002.607304:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbc3c0 00000100:00100000:1.0:1787827002.818715:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827002.818794:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265600 00000100:00100000:0.0:1787827002.818804:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265600 00002000:00100000:0.0:1787827002.818860:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (515899392->520093695) req@ffff8d547fb2d2c0 x1874672134265600/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/0 e 0 to 0 dl 1787827013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827002.818877:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2d2c0 with x1874672134265600 ext(515899392->520093695) 00002000:00010000:0.0:1787827002.818883:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2d2c0 00000100:00100000:0.0:1787827002.818913:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 417 00000100:00100000:0.0:1787827002.818928:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134265600:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827002.830033:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134265600:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11094us (11315us total) trans 30064771422 rc 0/0 00000100:00100000:0.0:1787827002.830047:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 417 00002000:00100000:0.0:1787827002.830066:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (515899392->520093695) req@ffff8d547fb2d2c0 x1874672134265600/t30064771422(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:603/0 lens 488/448 e 0 to 0 dl 1787827013 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827002.830078:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2d2c0 with x1874672134265600 ext(515899392->520093695) 00002000:00010000:0.0:1787827002.830086:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2d2c0 00000100:00100000:3.0:1787827002.961480:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143769728:0@lo:400:kworker.0 00000100:00100000:3.0:1787827002.961549:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827002.961620:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769728 00000100:00100000:0.0:1787827002.961629:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769728 00000100:00100000:1.0:1787827002.961676:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143769856:0@lo:400:kworker.0 00000100:00100000:0.0:1787827002.961695:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1787827002.961707:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143769728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827002.961710:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787827002.961718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827002.961722:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143770112:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.961763:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827002.961774:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143769984:0@lo:400:kworker.0 00000100:00100000:3.0:1787827002.961774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827002.961780:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143769728:12345-0@lo:400:kworker.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827002.961790:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1787827002.961817:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827002.961822:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143769728:0@lo:400:kworker.0 00000100:00100000:0.0:1787827002.961847:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769856 00000100:00100000:0.0:1787827002.961852:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769856 00000100:00100000:3.0:1787827002.961860:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143770112 00000100:00100000:3.0:1787827002.961866:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143770112 00000100:00100000:0.0:1787827002.961889:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143769984 00000100:00100000:0.0:1787827002.961894:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143769984 00000100:00100000:1.0:1787827002.961896:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1787827002.961907:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787827002.961912:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143769856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827002.961920:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143770112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827002.961929:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1787827002.961940:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143769984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.961963:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143769856:12345-0@lo:400:kworker.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827002.961971:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1787827002.961983:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143770112:12345-0@lo:400:kworker.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827002.961991:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143769984:12345-0@lo:400:kworker.0 Request processed in 51us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827002.961997:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787827002.962003:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787827002.962020:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143769984:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962034:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143769856:0@lo:400:kworker.0 00000100:00100000:3.0:1787827002.962060:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143770112:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962157:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787827002.962170:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143770240:0@lo:400:kworker.0 00000100:00100000:0.0:1787827002.962179:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143770368:0@lo:400:kworker.0 00000100:00100000:2.0:1787827002.962202:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143770496:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827002.962263:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827002.962280:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143770624:0@lo:400:kworker.0 00000100:00100000:2.0:1787827002.962295:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827002.962300:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143770880:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962320:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827002.962328:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143770368 00000100:00100000:2.0:1787827002.962332:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143770368 00000100:00100000:1.0:1787827002.962359:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827002.962365:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827002.962369:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143770496 00000100:00100000:1.0:1787827002.962371:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143770752:0@lo:400:kworker.0 00000100:00100000:2.0:1787827002.962375:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143770496 00000100:00100000:1.0:1787827002.962407:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827002.962408:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143770880 00000100:00100000:0.0:1787827002.962413:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143770240 00000100:00100000:0.0:1787827002.962420:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143770240 00000100:00100000:2.0:1787827002.962420:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143770880 00000100:00100000:1.0:1787827002.962437:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143770752 00000100:00100000:1.0:1787827002.962443:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143770752 00000100:00100000:2.0:1787827002.962452:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1787827002.962463:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143770624 00000100:00100000:2.0:1787827002.962463:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143770368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827002.962470:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143770624 00000100:00100000:1.0:1787827002.962477:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1787827002.962487:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827002.962506:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787827002.962515:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143770240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827002.962527:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143770368:12345-0@lo:400:kworker.0 Request processed in 66us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827002.962534:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1787827002.962550:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1787827002.962560:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787827002.962560:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143770880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962563:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143770496:12345-0@lo:400:kworker.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827002.962569:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143770240:12345-0@lo:400:kworker.0 Request processed in 53us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827002.962570:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143770752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962582:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1787827002.962587:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787827002.962603:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143770880:12345-0@lo:400:kworker.0 Request processed in 45us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827002.962609:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143770752:12345-0@lo:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827002.962611:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1787827002.962615:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787827002.962619:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1787827002.962630:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143770624:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787827002.962632:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb58b40 x1874672143770496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787827002.962637:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827002.962648:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143770496:0@lo:400:kworker.0 00000100:00080000:3.0:1787827002.962657:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827002.962662:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787827002.962676:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb59a40 x1874672143770880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827002.962689:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143770880:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962691:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143770752:0@lo:400:kworker.0 00000100:00100000:0.0:1787827002.962700:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143770624:12345-0@lo:400:kworker.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827002.962709:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787827002.962711:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143770368:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962716:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143770624:0@lo:400:kworker.0 00000100:00100000:1.0:1787827002.962734:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143770240:0@lo:400:kworker.0 00000100:00100000:2.0:1787827003.037211:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827003.037424:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265728 00000100:00100000:0.0:1787827003.037436:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265728 00002000:00100000:0.0:1787827003.037518:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (520093696->524287999) req@ffff8d547fb5b480 x1874672134265728/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/0 e 0 to 0 dl 1787827014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827003.037531:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b480 with x1874672134265728 ext(520093696->524287999) 00002000:00010000:0.0:1787827003.037538:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b480 00000100:00100000:0.0:1787827003.037576:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 418 00000100:00100000:0.0:1787827003.037587:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2390:x1874672134265728:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:3.0:1787827003.037946:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827003.052409:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2390:x1874672134265728:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14812us (15198us total) trans 30064771423 rc 0/0 00000100:00100000:2.0:1787827003.052424:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 418 00002000:00100000:2.0:1787827003.052437:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (520093696->524287999) req@ffff8d547fb5b480 x1874672134265728/t30064771423(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/448 e 0 to 0 dl 1787827014 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827003.052461:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b480 with x1874672134265728 ext(520093696->524287999) 00002000:00010000:2.0:1787827003.052468:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b480 00000100:00100000:0.0:1787827003.273659:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827003.273926:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265856 00000100:00100000:2.0:1787827003.273941:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265856 00002000:00100000:2.0:1787827003.273987:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (524288000->528482303) req@ffff8d547fe0d680 x1874672134265856/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/0 e 0 to 0 dl 1787827014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827003.273997:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0d680 with x1874672134265856 ext(524288000->528482303) 00002000:00010000:2.0:1787827003.274002:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0d680 00000100:00100000:2.0:1787827003.274032:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 419 00000100:00100000:2.0:1787827003.274041:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2391:x1874672134265856:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827003.288447:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134265856:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14397us (14788us total) trans 30064771424 rc 0/0 00000100:00100000:2.0:1787827003.288461:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 419 00002000:00100000:2.0:1787827003.288473:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (524288000->528482303) req@ffff8d547fe0d680 x1874672134265856/t30064771424(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/448 e 0 to 0 dl 1787827014 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827003.288484:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0d680 with x1874672134265856 ext(524288000->528482303) 00002000:00010000:2.0:1787827003.288489:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0d680 00000100:00100000:1.0:1787827003.473632:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143771008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827003.473780:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827003.473835:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771008 00000100:00100000:3.0:1787827003.473843:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771008 00000100:00100000:3.0:1787827003.473893:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787827003.473914:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143771008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827003.473947:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827003.474004:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143771008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827003.474011:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787827003.474067:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143771008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827003.494570:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827003.494655:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134265984 00000100:00100000:0.0:1787827003.494665:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134265984 00002000:00100000:0.0:1787827003.494720:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (528482304->532676607) req@ffff8d547fb2cf00 x1874672134265984/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/0 e 0 to 0 dl 1787827014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827003.494732:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2cf00 with x1874672134265984 ext(528482304->532676607) 00002000:00010000:0.0:1787827003.494737:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2cf00 00000100:00100000:0.0:1787827003.494782:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 420 00000100:00100000:0.0:1787827003.494791:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134265984:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827003.511088:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134265984:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16287us (16517us total) trans 30064771425 rc 0/0 00000100:00100000:0.0:1787827003.511104:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 420 00002000:00100000:0.0:1787827003.511117:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (528482304->532676607) req@ffff8d547fb2cf00 x1874672134265984/t30064771425(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/448 e 0 to 0 dl 1787827014 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827003.511128:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2cf00 with x1874672134265984 ext(528482304->532676607) 00002000:00010000:0.0:1787827003.511133:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2cf00 00010000:00010000:2.0:1787827003.601403:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827003.726097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827003.726157:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134266112 00000100:00100000:2.0:1787827003.726167:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134266112 00002000:00100000:2.0:1787827003.726262:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (532676608->536870911) req@ffff8d547fb2c780 x1874672134266112/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/0 e 0 to 0 dl 1787827014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827003.726274:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c780 with x1874672134266112 ext(532676608->536870911) 00002000:00010000:2.0:1787827003.726280:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c780 00000100:00100000:2.0:1787827003.726311:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 421 00000100:00100000:2.0:1787827003.726318:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134266112:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827003.744693:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134266112:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18364us (18595us total) trans 30064771426 rc 0/0 00000100:00100000:2.0:1787827003.744724:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 421 00002000:00100000:2.0:1787827003.744738:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (532676608->536870911) req@ffff8d547fb2c780 x1874672134266112/t30064771426(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/448 e 0 to 0 dl 1787827014 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827003.744750:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c780 with x1874672134266112 ext(532676608->536870911) 00002000:00010000:2.0:1787827003.744756:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c780 00000100:00100000:1.0:1787827003.958814:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827003.958891:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134266240 00000100:00100000:2.0:1787827003.958901:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134266240 00002000:00100000:2.0:1787827003.958947:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (536870912->541065215) req@ffff8d547fb2c3c0 x1874672134266240/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/0 e 0 to 0 dl 1787827014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827003.958972:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c3c0 with x1874672134266240 ext(536870912->541065215) 00002000:00010000:2.0:1787827003.958977:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c3c0 00000100:00100000:2.0:1787827003.959077:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 422 00000100:00100000:2.0:1787827003.959088:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134266240:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827003.976614:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134266240:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17518us (17799us total) trans 30064771427 rc 0/0 00000100:00100000:1.0:1787827003.976628:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 422 00002000:00100000:1.0:1787827003.976641:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (536870912->541065215) req@ffff8d547fb2c3c0 x1874672134266240/t30064771427(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:604/0 lens 488/448 e 0 to 0 dl 1787827014 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827003.976652:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c3c0 with x1874672134266240 ext(536870912->541065215) 00002000:00010000:1.0:1787827003.976659:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c3c0 00000100:00100000:0.0:1787827004.200026:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827004.200147:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134266368 00000100:00100000:1.0:1787827004.200158:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134266368 00002000:00100000:1.0:1787827004.200206:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (541065216->545259519) req@ffff8d547fe0d2c0 x1874672134266368/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/0 e 0 to 0 dl 1787827015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827004.200253:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0d2c0 with x1874672134266368 ext(541065216->545259519) 00002000:00010000:1.0:1787827004.200259:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0d2c0 00000100:00100000:1.0:1787827004.200294:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 423 00000100:00100000:1.0:1787827004.200303:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134266368:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827004.218047:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134266368:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17736us (18018us total) trans 30064771428 rc 0/0 00000100:00100000:2.0:1787827004.218062:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 423 00002000:00100000:2.0:1787827004.218073:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (541065216->545259519) req@ffff8d547fe0d2c0 x1874672134266368/t30064771428(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/448 e 0 to 0 dl 1787827015 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827004.218085:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0d2c0 with x1874672134266368 ext(541065216->545259519) 00002000:00010000:2.0:1787827004.218091:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0d2c0 00000100:00100000:0.0:1787827004.438856:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827004.440362:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134266496 00000100:00100000:2.0:1787827004.440371:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134266496 00002000:00100000:2.0:1787827004.440419:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (545259520->549453823) req@ffff8d547fe0cb40 x1874672134266496/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/0 e 0 to 0 dl 1787827015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827004.440441:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0cb40 with x1874672134266496 ext(545259520->549453823) 00002000:00010000:2.0:1787827004.440446:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0cb40 00000100:00100000:2.0:1787827004.440487:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 424 00000100:00100000:2.0:1787827004.440496:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134266496:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827004.467645:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134266496:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 27134us (28781us total) trans 30064771429 rc 0/0 00000100:00100000:0.0:1787827004.467663:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 424 00002000:00100000:0.0:1787827004.467676:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (545259520->549453823) req@ffff8d547fe0cb40 x1874672134266496/t30064771429(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/448 e 0 to 0 dl 1787827015 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827004.467687:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0cb40 with x1874672134266496 ext(545259520->549453823) 00002000:00010000:0.0:1787827004.467693:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0cb40 00010000:00010000:0.0:1787827004.625743:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827004.681446:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827004.681550:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134266624 00000100:00100000:0.0:1787827004.681560:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134266624 00002000:00100000:0.0:1787827004.681621:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (549453824->553648127) req@ffff8d547fb59a40 x1874672134266624/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/0 e 0 to 0 dl 1787827015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827004.681632:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb59a40 with x1874672134266624 ext(549453824->553648127) 00002000:00010000:0.0:1787827004.681638:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb59a40 00000100:00100000:0.0:1787827004.681669:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 425 00000100:00100000:0.0:1787827004.681678:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134266624:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827004.706905:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134266624:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 25217us (25458us total) trans 30064771430 rc 0/0 00000100:00100000:0.0:1787827004.706920:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 425 00002000:00100000:0.0:1787827004.706934:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (549453824->553648127) req@ffff8d547fb59a40 x1874672134266624/t30064771430(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/448 e 0 to 0 dl 1787827015 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827004.706945:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb59a40 with x1874672134266624 ext(549453824->553648127) 00002000:00010000:0.0:1787827004.706951:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb59a40 00000100:00100000:2.0:1787827004.923047:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827004.923111:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134266752 00000100:00100000:0.0:1787827004.923121:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134266752 00002000:00100000:0.0:1787827004.923182:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (553648128->557842431) req@ffff8d547fb58f00 x1874672134266752/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/0 e 0 to 0 dl 1787827015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827004.923189:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58f00 with x1874672134266752 ext(553648128->557842431) 00002000:00010000:0.0:1787827004.923195:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58f00 00000100:00100000:0.0:1787827004.923268:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 426 00000100:00100000:0.0:1787827004.923278:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134266752:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827004.952164:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134266752:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 28876us (29115us total) trans 30064771431 rc 0/0 00000100:00100000:0.0:1787827004.952180:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 426 00002000:00100000:0.0:1787827004.952197:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (553648128->557842431) req@ffff8d547fb58f00 x1874672134266752/t30064771431(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:605/0 lens 488/448 e 0 to 0 dl 1787827015 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827004.952208:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58f00 with x1874672134266752 ext(553648128->557842431) 00002000:00010000:0.0:1787827004.952252:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58f00 00000100:00100000:0.0:1787827005.009486:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787827005.009511:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827005.009599:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827005.009781:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787827005.009794:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143771264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827005.009826:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827005.009872:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771136 00000100:00100000:2.0:1787827005.009880:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771136 00000100:00100000:3.0:1787827005.009924:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771264 00000100:00100000:3.0:1787827005.009930:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771264 00000100:00100000:2.0:1787827005.009943:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1787827005.009946:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827005.009954:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143771136:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827005.009970:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00002000:00000024:2.0:1787827005.009978:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2568192 granted 556721600 pending 69234688 free 2849767424 avail 2618245120 00000100:00100000:3.0:1787827005.009983:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143771264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827005.009997:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2568192 granted 556721600 pending 69234688 free 2849767424 avail 2618245120 00000100:00100000:2.0:1787827005.010029:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143771136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827005.010035:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787827005.010052:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143771264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827005.010060:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787827005.010098:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827005.010146:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143771264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827005.169075:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827005.169289:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134266880 00000100:00100000:2.0:1787827005.169297:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134266880 00002000:00100000:2.0:1787827005.169360:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (557842432->562036735) req@ffff8d547fbbde00 x1874672134266880/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/0 e 0 to 0 dl 1787827016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827005.169372:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbde00 with x1874672134266880 ext(557842432->562036735) 00002000:00010000:2.0:1787827005.169377:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbde00 00000100:00100000:2.0:1787827005.169409:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 427 00000100:00100000:2.0:1787827005.169420:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134266880:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:1.0:1787827005.169431:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827005.183661:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134266880:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14232us (14591us total) trans 30064771432 rc 0/0 00000100:00100000:2.0:1787827005.183683:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 427 00002000:00100000:2.0:1787827005.183695:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (557842432->562036735) req@ffff8d547fbbde00 x1874672134266880/t30064771432(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/448 e 0 to 0 dl 1787827016 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827005.183705:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbde00 with x1874672134266880 ext(557842432->562036735) 00002000:00010000:2.0:1787827005.183711:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbde00 00000100:00100000:0.0:1787827005.410757:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827005.410850:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267008 00000100:00100000:1.0:1787827005.410859:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267008 00002000:00100000:1.0:1787827005.410903:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (562036736->566231039) req@ffff8d5347a30780 x1874672134267008/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/0 e 0 to 0 dl 1787827016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827005.410915:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30780 with x1874672134267008 ext(562036736->566231039) 00002000:00010000:1.0:1787827005.410920:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30780 00000100:00100000:1.0:1787827005.411044:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 428 00000100:00100000:1.0:1787827005.411062:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2390:x1874672134267008:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827005.432593:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2390:x1874672134267008:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 21523us (21828us total) trans 30064771433 rc 0/0 00000100:00100000:2.0:1787827005.432607:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 428 00002000:00100000:2.0:1787827005.432619:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (562036736->566231039) req@ffff8d5347a30780 x1874672134267008/t30064771433(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/448 e 0 to 0 dl 1787827016 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827005.432630:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30780 with x1874672134267008 ext(562036736->566231039) 00002000:00010000:2.0:1787827005.432635:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30780 00000100:00100000:0.0:1787827005.638544:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827005.638620:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267136 00000100:00100000:2.0:1787827005.638631:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267136 00002000:00100000:2.0:1787827005.638690:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (566231040->570425343) req@ffff8d5347a303c0 x1874672134267136/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/0 e 0 to 0 dl 1787827016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827005.638702:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a303c0 with x1874672134267136 ext(566231040->570425343) 00002000:00010000:2.0:1787827005.638707:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a303c0 00000100:00100000:2.0:1787827005.638739:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 429 00000100:00100000:2.0:1787827005.638747:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134267136:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787827005.649990:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827005.656338:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134267136:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17583us (17795us total) trans 30064771434 rc 0/0 00000100:00100000:1.0:1787827005.656352:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 429 00002000:00100000:1.0:1787827005.656365:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (566231040->570425343) req@ffff8d5347a303c0 x1874672134267136/t30064771434(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/448 e 0 to 0 dl 1787827016 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827005.656376:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a303c0 with x1874672134267136 ext(566231040->570425343) 00002000:00010000:1.0:1787827005.656382:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a303c0 00000100:00100000:2.0:1787827005.881896:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827005.881977:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267264 00000100:00100000:1.0:1787827005.881988:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267264 00002000:00100000:1.0:1787827005.882038:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (570425344->574619647) req@ffff8d547fb583c0 x1874672134267264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/0 e 0 to 0 dl 1787827016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827005.882050:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb583c0 with x1874672134267264 ext(570425344->574619647) 00002000:00010000:1.0:1787827005.882057:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb583c0 00000100:00100000:1.0:1787827005.882091:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 430 00000100:00100000:1.0:1787827005.882117:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134267264:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827005.897944:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134267264:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15820us (16048us total) trans 30064771435 rc 0/0 00000100:00100000:3.0:1787827005.897959:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 430 00002000:00100000:3.0:1787827005.897972:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (570425344->574619647) req@ffff8d547fb583c0 x1874672134267264/t30064771435(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:606/0 lens 488/448 e 0 to 0 dl 1787827016 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827005.897982:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb583c0 with x1874672134267264 ext(570425344->574619647) 00002000:00010000:3.0:1787827005.897988:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb583c0 00000100:00100000:2.0:1787827006.128130:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827006.128267:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267392 00000100:00100000:3.0:1787827006.128276:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267392 00002000:00100000:3.0:1787827006.128320:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (574619648->578813951) req@ffff8d547fb5a940 x1874672134267392/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/0 e 0 to 0 dl 1787827017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827006.128332:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5a940 with x1874672134267392 ext(574619648->578813951) 00002000:00010000:3.0:1787827006.128337:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5a940 00000100:00100000:3.0:1787827006.128402:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 431 00000100:00100000:3.0:1787827006.128412:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134267392:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827006.170623:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134267392:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 42198us (42487us total) trans 30064771436 rc 0/0 00000100:00100000:2.0:1787827006.170643:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 431 00002000:00100000:2.0:1787827006.170663:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (574619648->578813951) req@ffff8d547fb5a940 x1874672134267392/t30064771436(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/448 e 0 to 0 dl 1787827017 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827006.170674:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5a940 with x1874672134267392 ext(574619648->578813951) 00002000:00010000:2.0:1787827006.170679:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5a940 00000100:00100000:0.0:1787827006.401166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827006.401263:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267520 00000100:00100000:2.0:1787827006.401273:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267520 00002000:00100000:2.0:1787827006.401316:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (578813952->583008255) req@ffff8d5347a32940 x1874672134267520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/0 e 0 to 0 dl 1787827017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827006.401328:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a32940 with x1874672134267520 ext(578813952->583008255) 00002000:00010000:2.0:1787827006.401333:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a32940 00000100:00100000:2.0:1787827006.401362:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 432 00000100:00100000:2.0:1787827006.401381:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134267520:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827006.415827:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2392:x1874672134267520:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14440us (14661us total) trans 30064771437 rc 0/0 00000100:00100000:2.0:1787827006.415842:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 432 00002000:00100000:2.0:1787827006.415855:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (578813952->583008255) req@ffff8d5347a32940 x1874672134267520/t30064771437(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/448 e 0 to 0 dl 1787827017 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827006.415876:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a32940 with x1874672134267520 ext(578813952->583008255) 00002000:00010000:2.0:1787827006.415885:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a32940 00000001:00080000:3.0:1787827006.416030:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771436 is committed 00000100:00100000:2.0:1787827006.622452:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827006.622550:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267648 00000100:00100000:0.0:1787827006.622559:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267648 00002000:00100000:0.0:1787827006.622602:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (583008256->587202559) req@ffff8d547fb59680 x1874672134267648/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/0 e 0 to 0 dl 1787827017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827006.622613:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb59680 with x1874672134267648 ext(583008256->587202559) 00002000:00010000:0.0:1787827006.622629:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb59680 00000100:00100000:0.0:1787827006.622662:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 433 00000100:00100000:0.0:1787827006.622671:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134267648:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827006.636532:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2391:x1874672134267648:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13853us (14079us total) trans 30064771438 rc 0/0 00000100:00100000:0.0:1787827006.636558:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 433 00002000:00100000:0.0:1787827006.636570:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (583008256->587202559) req@ffff8d547fb59680 x1874672134267648/t30064771438(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/448 e 0 to 0 dl 1787827017 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827006.636580:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb59680 with x1874672134267648 ext(583008256->587202559) 00002000:00010000:0.0:1787827006.636586:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb59680 00010000:00010000:2.0:1787827006.673414:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827006.854481:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827006.854545:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267776 00000100:00100000:0.0:1787827006.854554:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267776 00002000:00100000:0.0:1787827006.854598:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (587202560->591396863) req@ffff8d547fb2d680 x1874672134267776/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/0 e 0 to 0 dl 1787827017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827006.854609:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2d680 with x1874672134267776 ext(587202560->591396863) 00002000:00010000:0.0:1787827006.854614:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2d680 00000100:00100000:0.0:1787827006.854648:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 434 00000100:00100000:0.0:1787827006.854658:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134267776:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827006.866269:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827006.866305:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268032 00000100:00100000:2.0:1787827006.866313:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268032 00000100:00100000:2.0:1787827006.866394:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 408 00000100:00100000:2.0:1787827006.866404:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2390:x1874672134268032:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827006.866475:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2390:x1874672134268032:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827006.866484:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 408 00000100:00080000:2.0:1787827006.866509:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827006.866687:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827006.866716:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134267904 00000100:00100000:1.0:1787827006.866721:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134267904 00000100:00100000:2.0:1787827006.866732:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827006.866759:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 525 00000100:00100000:1.0:1787827006.866766:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134267904:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827006.866910:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134267904:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 142us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827006.866918:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 525 00000100:00100000:3.0:1787827006.867106:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268160 00000100:00100000:3.0:1787827006.867112:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268160 00000100:00080000:2.0:1787827006.867162:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827006.867169:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 409 00000100:00100000:3.0:1787827006.867178:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134268160:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827006.867260:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134268160:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 83us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827006.867268:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 409 00000100:00100000:0.0:1787827006.881768:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134267776:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 27102us (27287us total) trans 30064771439 rc 0/0 00000100:00100000:0.0:1787827006.881781:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 434 00002000:00100000:0.0:1787827006.881792:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (587202560->591396863) req@ffff8d547fb2d680 x1874672134267776/t30064771439(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:607/0 lens 488/448 e 0 to 0 dl 1787827017 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827006.881802:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2d680 with x1874672134267776 ext(587202560->591396863) 00002000:00010000:0.0:1787827006.881807:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2d680 00000100:00100000:1.0:1787827007.085601:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827007.085673:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268288 00000100:00100000:2.0:1787827007.085680:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268288 00002000:00100000:2.0:1787827007.085736:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (591396864->595591167) req@ffff8d547fb2de00 x1874672134268288/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/0 e 0 to 0 dl 1787827018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787827007.085743:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787827007.085746:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2de00 with x1874672134268288 ext(591396864->595591167) 00002000:00010000:2.0:1787827007.085753:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2de00 00000100:00100000:2.0:1787827007.085789:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 435 00000100:00100000:2.0:1787827007.085799:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134268288:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827007.096900:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134268288:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11094us (11299us total) trans 30064771440 rc 0/0 00000100:00100000:1.0:1787827007.096914:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 435 00002000:00100000:1.0:1787827007.096927:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (591396864->595591167) req@ffff8d547fb2de00 x1874672134268288/t30064771440(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/448 e 0 to 0 dl 1787827018 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827007.096937:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2de00 with x1874672134268288 ext(591396864->595591167) 00002000:00010000:1.0:1787827007.096942:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2de00 00000100:00100000:2.0:1787827007.311901:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827007.311970:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268416 00000100:00100000:1.0:1787827007.311980:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268416 00002000:00100000:1.0:1787827007.312026:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (595591168->599785471) req@ffff8d547665f050 x1874672134268416/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/0 e 0 to 0 dl 1787827018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827007.312038:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547665f050 with x1874672134268416 ext(595591168->599785471) 00002000:00010000:1.0:1787827007.312043:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547665f050 00000100:00100000:1.0:1787827007.312077:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 436 00000100:00100000:1.0:1787827007.312099:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547665f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134268416:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827007.335689:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547665f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134268416:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23582us (23789us total) trans 30064771441 rc 0/0 00000100:00100000:2.0:1787827007.335702:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 436 00002000:00100000:2.0:1787827007.335714:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (595591168->599785471) req@ffff8d547665f050 x1874672134268416/t30064771441(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/448 e 0 to 0 dl 1787827018 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827007.335733:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547665f050 with x1874672134268416 ext(595591168->599785471) 00002000:00010000:2.0:1787827007.335738:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547665f050 00000100:00100000:0.0:1787827007.568452:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827007.568494:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268544 00000100:00100000:1.0:1787827007.568503:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268544 00002000:00100000:1.0:1787827007.568542:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (599785472->603979775) req@ffff8d5347a31680 x1874672134268544/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/0 e 0 to 0 dl 1787827018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827007.568549:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a31680 with x1874672134268544 ext(599785472->603979775) 00002000:00010000:1.0:1787827007.568553:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a31680 00000100:00100000:1.0:1787827007.568574:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 437 00000100:00100000:1.0:1787827007.568581:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134268544:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827007.569350:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787827007.569366:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143771392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827007.569416:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827007.569495:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771392 00000100:00100000:3.0:1787827007.569500:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771392 00000100:00100000:2.0:1787827007.569505:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787827007.569517:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143771520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827007.569552:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787827007.569557:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827007.569565:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143771392:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827007.569567:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787827007.569580:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143771648:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787827007.569598:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827007.569616:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827007.569753:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771648 00000100:00100000:2.0:1787827007.569758:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771648 00000100:00100000:0.0:1787827007.569779:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771520 00000100:00100000:0.0:1787827007.569784:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771520 00000100:00100000:2.0:1787827007.569799:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787827007.569809:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143771648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827007.569821:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00002000:00000024:2.0:1787827007.569830:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827007.569833:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143771520:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1787827007.569833:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1787827007.569860:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827007.569882:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143771648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827007.569896:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143771392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 334us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827007.569907:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143771520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827007.569907:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787827007.569917:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00010000:00080000:0.0:1787827007.569958:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a33c00 x1874672143771648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827007.569976:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143771648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827007.569985:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:2.0:1787827007.570111:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827007.570142:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143771520:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787827007.570150:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a31e00 x1874672143771392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827007.570165:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143771392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827007.584531:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134268544:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15940us (16078us total) trans 30064771442 rc 0/0 00000100:00100000:1.0:1787827007.584545:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 437 00002000:00100000:1.0:1787827007.584559:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (599785472->603979775) req@ffff8d5347a31680 x1874672134268544/t30064771442(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/448 e 0 to 0 dl 1787827018 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827007.584570:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a31680 with x1874672134268544 ext(599785472->603979775) 00002000:00010000:1.0:1787827007.584576:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a31680 00010000:00010000:2.0:1787827007.697756:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827007.806498:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827007.806585:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268672 00000100:00100000:3.0:1787827007.806595:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268672 00002000:00100000:3.0:1787827007.806653:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (603979776->608174079) req@ffff8d547fb5b480 x1874672134268672/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/0 e 0 to 0 dl 1787827018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827007.806663:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b480 with x1874672134268672 ext(603979776->608174079) 00002000:00010000:3.0:1787827007.806669:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b480 00000100:00100000:3.0:1787827007.806701:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 438 00000100:00100000:3.0:1787827007.806710:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134268672:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827007.825905:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134268672:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19186us (19411us total) trans 30064771443 rc 0/0 00000100:00100000:3.0:1787827007.825919:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 438 00002000:00100000:3.0:1787827007.825933:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (603979776->608174079) req@ffff8d547fb5b480 x1874672134268672/t30064771443(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:608/0 lens 488/448 e 0 to 0 dl 1787827018 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827007.825959:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b480 with x1874672134268672 ext(603979776->608174079) 00002000:00010000:3.0:1787827007.825965:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b480 00000100:00100000:1.0:1787827008.031513:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827008.031609:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268800 00000100:00100000:0.0:1787827008.031622:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268800 00002000:00100000:0.0:1787827008.031684:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (608174080->612368383) req@ffff8d547fb2fc00 x1874672134268800/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/0 e 0 to 0 dl 1787827019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827008.031697:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2fc00 with x1874672134268800 ext(608174080->612368383) 00002000:00010000:0.0:1787827008.031703:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2fc00 00000100:00100000:0.0:1787827008.031757:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 439 00000100:00100000:0.0:1787827008.031769:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134268800:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827008.043155:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134268800:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11373us (11641us total) trans 30064771444 rc 0/0 00000100:00100000:0.0:1787827008.043172:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 439 00002000:00100000:0.0:1787827008.043206:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (608174080->612368383) req@ffff8d547fb2fc00 x1874672134268800/t30064771444(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/448 e 0 to 0 dl 1787827019 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827008.043287:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2fc00 with x1874672134268800 ext(608174080->612368383) 00002000:00010000:0.0:1787827008.043295:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2fc00 00000100:00100000:0.0:1787827008.082265:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143771776:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.082306:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143771904:0@lo:400:kworker.0 00000100:00100000:2.0:1787827008.082349:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143772032:0@lo:400:kworker.0 00000100:00100000:0.0:1787827008.082350:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827008.082365:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827008.082422:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143772160:0@lo:400:kworker.0 00000100:00100000:0.0:1787827008.082427:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143772288:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.082435:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143772416:0@lo:400:kworker.0 00000100:00100000:2.0:1787827008.082451:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827008.082483:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827008.082504:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827008.082513:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827008.082515:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143772544:0@lo:400:kworker.0 00000100:00100000:0.0:1787827008.082522:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143772800:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.082538:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143772928:0@lo:400:kworker.0 00000100:00100000:3.0:1787827008.082549:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143772672:0@lo:400:kworker.0 00000100:00100000:2.0:1787827008.082581:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827008.082594:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771776 00000100:00100000:0.0:1787827008.082602:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771776 00000100:00100000:3.0:1787827008.082612:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827008.082617:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827008.082665:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143771904 00000100:00100000:0.0:1787827008.082675:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1787827008.082675:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143771904 00000100:00100000:0.0:1787827008.082690:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143771776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827008.082694:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772032 00000100:00100000:3.0:1787827008.082701:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772032 00000100:00100000:2.0:1787827008.082744:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772416 00000100:00100000:1.0:1787827008.082745:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772544 00000100:00100000:3.0:1787827008.082747:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772928 00000100:00100000:1.0:1787827008.082752:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772544 00000100:00100000:3.0:1787827008.082752:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772928 00000100:00100000:0.0:1787827008.082757:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143771776:12345-0@lo:400:kworker.0 Request processed in 66us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827008.082764:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772416 00000100:00100000:0.0:1787827008.082769:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1787827008.082803:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1787827008.082819:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1787827008.082822:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827008.082834:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143772032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.082836:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787827008.082855:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1787827008.082860:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143772928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827008.082872:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143772416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827008.082922:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143771904:12345-0@lo:400:kworker.0 Request processed in 108us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827008.082937:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143772032:12345-0@lo:400:kworker.0 Request processed in 103us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827008.082944:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1787827008.082955:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787827008.082960:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143772928:12345-0@lo:400:kworker.0 Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827008.082962:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143772416:12345-0@lo:400:kworker.0 Request processed in 94us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827008.082978:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787827008.082985:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1787827008.082999:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1787827008.083015:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143772544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.083027:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772288 00000100:00100000:1.0:1787827008.083034:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772288 00000100:00100000:0.0:1787827008.083040:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827008.083068:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143772032:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.083086:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772672 00000100:00100000:3.0:1787827008.083087:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143772544:12345-0@lo:400:kworker.0 Request processed in 77us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827008.083093:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772672 00000100:00100000:3.0:1787827008.083099:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1787827008.083102:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143771776:0@lo:400:kworker.0 00010000:00080000:2.0:1787827008.083106:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbbde00 x1874672143772544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827008.083121:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772800 00000100:00100000:2.0:1787827008.083126:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143772544:0@lo:400:kworker.0 00000100:00100000:3.0:1787827008.083130:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772800 00000100:00100000:1.0:1787827008.083140:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787827008.083153:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143772288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827008.083191:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1787827008.083202:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143772800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827008.083206:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787827008.083269:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143772288:12345-0@lo:400:kworker.0 Request processed in 118us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827008.083285:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787827008.083286:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143772160 00000100:00100000:0.0:1787827008.083293:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143772672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827008.083296:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143772160 00000100:00100000:3.0:1787827008.083297:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143772800:12345-0@lo:400:kworker.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827008.083322:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1787827008.083346:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787827008.083358:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143772160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.083359:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143772288:0@lo:400:kworker.0 00000100:00100000:0.0:1787827008.083371:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143772672:12345-0@lo:400:kworker.0 Request processed in 81us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827008.083380:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787827008.083396:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143772672:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.083400:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143772800:0@lo:400:kworker.0 00000100:00080000:0.0:1787827008.083419:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827008.083426:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143772160:12345-0@lo:400:kworker.0 Request processed in 71us (925us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827008.083427:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787827008.083437:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827008.083442:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787827008.083447:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143772160:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.083485:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143772416:0@lo:400:kworker.0 00010000:00080000:1.0:1787827008.083499:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfde00 x1874672143772928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827008.083509:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143772928:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.083518:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143771904:0@lo:400:kworker.0 00000100:00100000:1.0:1787827008.265594:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827008.265684:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134268928 00000100:00100000:2.0:1787827008.265693:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134268928 00002000:00100000:2.0:1787827008.265741:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (612368384->616562687) req@ffff8d547fb2c780 x1874672134268928/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/0 e 0 to 0 dl 1787827019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827008.265749:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c780 with x1874672134268928 ext(612368384->616562687) 00002000:00010000:2.0:1787827008.265753:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c780 00000100:00100000:2.0:1787827008.265776:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 440 00000100:00100000:2.0:1787827008.265782:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134268928:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827008.285069:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134268928:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19275us (19472us total) trans 30064771445 rc 0/0 00000100:00100000:3.0:1787827008.285556:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 440 00002000:00100000:3.0:1787827008.285571:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (612368384->616562687) req@ffff8d547fb2c780 x1874672134268928/t30064771445(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/448 e 0 to 0 dl 1787827019 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827008.285582:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c780 with x1874672134268928 ext(612368384->616562687) 00002000:00010000:3.0:1787827008.285587:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c780 00000100:00100000:1.0:1787827008.498623:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827008.498745:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269056 00000100:00100000:0.0:1787827008.498755:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269056 00002000:00100000:0.0:1787827008.498800:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (616562688->620756991) req@ffff8d547fb2c3c0 x1874672134269056/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/0 e 0 to 0 dl 1787827019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827008.498812:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c3c0 with x1874672134269056 ext(616562688->620756991) 00002000:00010000:0.0:1787827008.498817:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c3c0 00000100:00100000:0.0:1787827008.498891:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 441 00000100:00100000:0.0:1787827008.498901:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2390:x1874672134269056:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827008.511728:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2390:x1874672134269056:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12821us (13107us total) trans 30064771446 rc 0/0 00000100:00100000:2.0:1787827008.511740:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 441 00002000:00100000:2.0:1787827008.511749:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (616562688->620756991) req@ffff8d547fb2c3c0 x1874672134269056/t30064771446(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/448 e 0 to 0 dl 1787827019 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827008.511756:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb2c3c0 with x1874672134269056 ext(616562688->620756991) 00002000:00010000:2.0:1787827008.511761:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb2c3c0 00000100:00100000:1.0:1787827008.593434:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827008.593457:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143773056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827008.593527:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827008.593581:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773056 00000100:00100000:0.0:1787827008.593588:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773056 00000100:00100000:0.0:1787827008.593640:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787827008.593649:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143773056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827008.593681:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827008.593735:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143773056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827008.593740:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787827008.593823:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143773056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827008.719290:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827008.719353:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269184 00000100:00100000:2.0:1787827008.719363:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269184 00002000:00100000:2.0:1787827008.719407:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (620756992->624951295) req@ffff8d5347a312c0 x1874672134269184/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/0 e 0 to 0 dl 1787827019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827008.719418:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a312c0 with x1874672134269184 ext(620756992->624951295) 00002000:00010000:2.0:1787827008.719423:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a312c0 00000100:00100000:2.0:1787827008.719453:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 442 00000100:00100000:2.0:1787827008.719462:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2391:x1874672134269184:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:0.0:1787827008.721844:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827008.732019:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2391:x1874672134269184:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12548us (12728us total) trans 30064771447 rc 0/0 00000100:00100000:3.0:1787827008.732040:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 442 00002000:00100000:3.0:1787827008.732053:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (620756992->624951295) req@ffff8d5347a312c0 x1874672134269184/t30064771447(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/448 e 0 to 0 dl 1787827019 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827008.732066:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a312c0 with x1874672134269184 ext(620756992->624951295) 00002000:00010000:3.0:1787827008.732073:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a312c0 00000100:00100000:2.0:1787827008.945381:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827008.945432:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269312 00000100:00100000:1.0:1787827008.945442:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269312 00002000:00100000:1.0:1787827008.945501:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (624951296->629145599) req@ffff8d547fb5a940 x1874672134269312/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/0 e 0 to 0 dl 1787827019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827008.945512:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5a940 with x1874672134269312 ext(624951296->629145599) 00002000:00010000:1.0:1787827008.945518:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5a940 00000100:00100000:1.0:1787827008.945551:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 443 00000100:00100000:1.0:1787827008.945561:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134269312:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827008.967868:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134269312:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22298us (22484us total) trans 30064771448 rc 0/0 00000100:00100000:2.0:1787827008.967881:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 443 00002000:00100000:2.0:1787827008.967895:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (624951296->629145599) req@ffff8d547fb5a940 x1874672134269312/t30064771448(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:609/0 lens 488/448 e 0 to 0 dl 1787827019 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827008.967907:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5a940 with x1874672134269312 ext(624951296->629145599) 00002000:00010000:2.0:1787827008.967912:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5a940 00000100:00100000:2.0:1787827009.186885:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827009.186953:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269440 00000100:00100000:1.0:1787827009.186963:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269440 00000100:00080000:0.0:1787827009.187024:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787827009.187030:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (629145600->633339903) req@ffff8d547fb59680 x1874672134269440/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/0 e 0 to 0 dl 1787827020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827009.187042:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb59680 with x1874672134269440 ext(629145600->633339903) 00002000:00010000:1.0:1787827009.187048:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb59680 00000100:00100000:1.0:1787827009.187075:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 444 00000100:00100000:1.0:1787827009.187085:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134269440:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827009.200946:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134269440:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13853us (14057us total) trans 30064771449 rc 0/0 00000100:00100000:3.0:1787827009.200956:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 444 00002000:00100000:3.0:1787827009.200969:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (629145600->633339903) req@ffff8d547fb59680 x1874672134269440/t30064771449(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/448 e 0 to 0 dl 1787827020 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827009.201005:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb59680 with x1874672134269440 ext(629145600->633339903) 00002000:00010000:3.0:1787827009.201012:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb59680 00000100:00100000:2.0:1787827009.416840:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827009.416905:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269568 00000100:00100000:1.0:1787827009.416914:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269568 00002000:00100000:1.0:1787827009.416960:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (633339904->637534207) req@ffff8d547fb5b840 x1874672134269568/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/0 e 0 to 0 dl 1787827020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827009.416982:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b840 with x1874672134269568 ext(633339904->637534207) 00002000:00010000:1.0:1787827009.416986:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b840 00000100:00100000:1.0:1787827009.417013:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 445 00000100:00100000:1.0:1787827009.417019:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134269568:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827009.431877:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134269568:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14842us (15027us total) trans 30064771450 rc 0/0 00000100:00100000:2.0:1787827009.431898:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 445 00002000:00100000:2.0:1787827009.431917:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (633339904->637534207) req@ffff8d547fb5b840 x1874672134269568/t30064771450(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/448 e 0 to 0 dl 1787827020 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827009.431930:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b840 with x1874672134269568 ext(633339904->637534207) 00002000:00010000:2.0:1787827009.431937:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b840 00000100:00100000:2.0:1787827009.645734:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827009.645843:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269696 00000100:00100000:3.0:1787827009.645853:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269696 00002000:00100000:3.0:1787827009.645896:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (637534208->641728511) req@ffff8d547fb58780 x1874672134269696/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/0 e 0 to 0 dl 1787827020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827009.645907:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58780 with x1874672134269696 ext(637534208->641728511) 00002000:00010000:3.0:1787827009.645912:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58780 00000100:00100000:3.0:1787827009.645948:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 446 00000100:00100000:3.0:1787827009.645958:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134269696:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827009.659194:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134269696:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13228us (13460us total) trans 30064771451 rc 0/0 00000100:00100000:3.0:1787827009.659252:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 446 00002000:00100000:3.0:1787827009.659268:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (637534208->641728511) req@ffff8d547fb58780 x1874672134269696/t30064771451(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/448 e 0 to 0 dl 1787827020 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827009.659279:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58780 with x1874672134269696 ext(637534208->641728511) 00002000:00010000:3.0:1787827009.659287:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58780 00010000:00010000:2.0:1787827009.745391:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827009.863052:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827009.863121:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269824 00000100:00100000:0.0:1787827009.863141:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269824 00002000:00100000:0.0:1787827009.863179:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (641728512->645922815) req@ffff8d547fb592c0 x1874672134269824/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/0 e 0 to 0 dl 1787827020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827009.863186:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb592c0 with x1874672134269824 ext(641728512->645922815) 00002000:00010000:0.0:1787827009.863190:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb592c0 00000100:00100000:0.0:1787827009.863250:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 447 00000100:00100000:0.0:1787827009.863262:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2390:x1874672134269824:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827009.875149:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2390:x1874672134269824:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11873us (12086us total) trans 30064771452 rc 0/0 00000100:00100000:2.0:1787827009.875168:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 447 00002000:00100000:2.0:1787827009.875190:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (641728512->645922815) req@ffff8d547fb592c0 x1874672134269824/t30064771452(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:610/0 lens 488/448 e 0 to 0 dl 1787827020 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827009.875243:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb592c0 with x1874672134269824 ext(641728512->645922815) 00002000:00010000:2.0:1787827009.875251:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb592c0 00000100:00100000:0.0:1787827010.108932:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827010.108996:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134269952 00000100:00100000:3.0:1787827010.109013:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134269952 00002000:00100000:3.0:1787827010.109096:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (645922816->650117119) req@ffff8d5347a33480 x1874672134269952/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/0 e 0 to 0 dl 1787827021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827010.109109:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a33480 with x1874672134269952 ext(645922816->650117119) 00002000:00010000:3.0:1787827010.109116:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a33480 00000100:00100000:3.0:1787827010.109171:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 448 00000100:00100000:3.0:1787827010.109183:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2391:x1874672134269952:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827010.121669:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2391:x1874672134269952:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12476us (12740us total) trans 30064771453 rc 0/0 00000100:00100000:3.0:1787827010.121684:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 448 00002000:00100000:3.0:1787827010.121696:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (645922816->650117119) req@ffff8d5347a33480 x1874672134269952/t30064771453(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/448 e 0 to 0 dl 1787827021 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827010.121706:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a33480 with x1874672134269952 ext(645922816->650117119) 00002000:00010000:3.0:1787827010.121712:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a33480 00000100:00100000:1.0:1787827010.129462:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143773312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827010.129468:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143773184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827010.129558:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827010.129621:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773312 00000100:00100000:2.0:1787827010.129641:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773312 00000100:00100000:3.0:1787827010.129648:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827010.129712:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773184 00000100:00100000:2.0:1787827010.129717:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773184 00000100:00100000:0.0:1787827010.129735:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00080000:1.0:1787827010.129741:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827010.129747:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143773312:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827010.129759:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787827010.129770:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143773184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787827010.129775:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2564096 granted 559203776 pending 71720960 free 2849767424 avail 2618245120 00002000:00000024:2.0:1787827010.129786:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2564096 granted 559203776 pending 71720960 free 2849767424 avail 2618245120 00000100:00100000:0.0:1787827010.129835:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143773312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827010.129842:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787827010.129868:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143773184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827010.129878:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787827010.129882:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143773312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827010.129899:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143773184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827010.329055:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827010.329177:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270080 00000100:00100000:2.0:1787827010.329191:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270080 00002000:00100000:2.0:1787827010.329320:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (650117120->654311423) req@ffff8d547fbf4f00 x1874672134270080/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/0 e 0 to 0 dl 1787827021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827010.329333:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4f00 with x1874672134270080 ext(650117120->654311423) 00002000:00010000:2.0:1787827010.329340:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4f00 00000100:00100000:2.0:1787827010.329416:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 449 00000100:00100000:2.0:1787827010.329426:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2390:x1874672134270080:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827010.343648:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2390:x1874672134270080:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14213us (14596us total) trans 30064771454 rc 0/0 00000100:00100000:0.0:1787827010.343662:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 449 00002000:00100000:0.0:1787827010.343675:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (650117120->654311423) req@ffff8d547fbf4f00 x1874672134270080/t30064771454(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/448 e 0 to 0 dl 1787827021 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827010.343685:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4f00 with x1874672134270080 ext(650117120->654311423) 00002000:00010000:0.0:1787827010.343690:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4f00 00000100:00100000:1.0:1787827010.558564:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827010.558694:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270208 00000100:00100000:2.0:1787827010.558705:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270208 00002000:00100000:2.0:1787827010.558753:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (654311424->658505727) req@ffff8d547fbf6940 x1874672134270208/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/0 e 0 to 0 dl 1787827021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827010.558764:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6940 with x1874672134270208 ext(654311424->658505727) 00002000:00010000:2.0:1787827010.558770:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6940 00000100:00100000:2.0:1787827010.558805:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 450 00000100:00100000:2.0:1787827010.558815:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134270208:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827010.581822:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134270208:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22999us (23258us total) trans 30064771455 rc 0/0 00000100:00100000:3.0:1787827010.581836:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 450 00002000:00100000:3.0:1787827010.581849:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (654311424->658505727) req@ffff8d547fbf6940 x1874672134270208/t30064771455(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/448 e 0 to 0 dl 1787827021 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827010.581860:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6940 with x1874672134270208 ext(654311424->658505727) 00002000:00010000:3.0:1787827010.581866:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6940 00010000:00010000:2.0:1787827010.769417:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827010.804296:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827010.805516:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270336 00000100:00100000:2.0:1787827010.805525:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270336 00002000:00100000:2.0:1787827010.805576:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (658505728->662700031) req@ffff8d547fbf61c0 x1874672134270336/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/0 e 0 to 0 dl 1787827021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827010.805587:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf61c0 with x1874672134270336 ext(658505728->662700031) 00002000:00010000:2.0:1787827010.805604:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf61c0 00000100:00100000:2.0:1787827010.805648:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 451 00000100:00100000:2.0:1787827010.805658:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134270336:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827010.822989:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134270336:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17324us (18691us total) trans 30064771456 rc 0/0 00000100:00100000:1.0:1787827010.823003:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 451 00002000:00100000:1.0:1787827010.823014:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (658505728->662700031) req@ffff8d547fbf61c0 x1874672134270336/t30064771456(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:611/0 lens 488/448 e 0 to 0 dl 1787827021 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827010.823022:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf61c0 with x1874672134270336 ext(658505728->662700031) 00002000:00010000:1.0:1787827010.823026:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf61c0 00000100:00100000:2.0:1787827011.037260:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827011.037331:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270464 00000100:00100000:1.0:1787827011.037340:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270464 00002000:00100000:1.0:1787827011.037463:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (662700032->666894335) req@ffff8d547fb58000 x1874672134270464/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/0 e 0 to 0 dl 1787827022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827011.037473:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58000 with x1874672134270464 ext(662700032->666894335) 00002000:00010000:1.0:1787827011.037489:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58000 00000100:00100000:1.0:1787827011.037529:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 452 00000100:00100000:1.0:1787827011.037539:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134270464:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:0.0:1787827011.038405:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827011.061440:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134270464:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 23893us (24179us total) trans 30064771457 rc 0/0 00000100:00100000:3.0:1787827011.061464:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 452 00002000:00100000:3.0:1787827011.061477:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (662700032->666894335) req@ffff8d547fb58000 x1874672134270464/t30064771457(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/448 e 0 to 0 dl 1787827022 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827011.061505:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58000 with x1874672134270464 ext(662700032->666894335) 00002000:00010000:3.0:1787827011.061511:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58000 00000100:00100000:2.0:1787827011.285125:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827011.285176:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270592 00000100:00100000:1.0:1787827011.285184:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270592 00002000:00100000:1.0:1787827011.285270:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (666894336->671088639) req@ffff8d547fb58b40 x1874672134270592/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/0 e 0 to 0 dl 1787827022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827011.285281:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58b40 with x1874672134270592 ext(666894336->671088639) 00002000:00010000:1.0:1787827011.285286:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58b40 00000100:00100000:1.0:1787827011.285313:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 453 00000100:00100000:1.0:1787827011.285320:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134270592:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827011.303492:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134270592:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18162us (18363us total) trans 30064771458 rc 0/0 00000100:00100000:3.0:1787827011.303506:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 453 00002000:00100000:3.0:1787827011.303520:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (666894336->671088639) req@ffff8d547fb58b40 x1874672134270592/t30064771458(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/448 e 0 to 0 dl 1787827022 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827011.303531:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb58b40 with x1874672134270592 ext(666894336->671088639) 00002000:00010000:3.0:1787827011.303538:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb58b40 00000100:00100000:1.0:1787827011.531571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827011.531676:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270720 00000100:00100000:3.0:1787827011.531685:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270720 00002000:00100000:3.0:1787827011.531728:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (671088640->675282943) req@ffff8d547fbf52c0 x1874672134270720/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/0 e 0 to 0 dl 1787827022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827011.531739:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf52c0 with x1874672134270720 ext(671088640->675282943) 00002000:00010000:3.0:1787827011.531744:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf52c0 00000100:00100000:3.0:1787827011.531844:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 454 00000100:00100000:3.0:1787827011.531854:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134270720:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827011.558456:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134270720:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 26593us (26884us total) trans 30064771459 rc 0/0 00000100:00100000:2.0:1787827011.558469:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 454 00002000:00100000:2.0:1787827011.558482:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (671088640->675282943) req@ffff8d547fbf52c0 x1874672134270720/t30064771459(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/448 e 0 to 0 dl 1787827022 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827011.558493:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf52c0 with x1874672134270720 ext(671088640->675282943) 00002000:00010000:2.0:1787827011.558512:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf52c0 00000001:00080000:1.0:1787827011.558586:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771458 is committed 00000100:00100000:1.0:1787827011.779382:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827011.779514:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270848 00000100:00100000:0.0:1787827011.779535:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270848 00002000:00100000:0.0:1787827011.779577:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (675282944->679477247) req@ffff8d547fbf7480 x1874672134270848/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/0 e 0 to 0 dl 1787827022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827011.779587:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf7480 with x1874672134270848 ext(675282944->679477247) 00002000:00010000:0.0:1787827011.779591:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf7480 00000100:00100000:0.0:1787827011.779652:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 455 00000100:00100000:0.0:1787827011.779661:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134270848:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787827011.793351:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827011.802139:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134270848:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 22467us (22752us total) trans 30064771460 rc 0/0 00000100:00100000:0.0:1787827011.802155:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 455 00002000:00100000:0.0:1787827011.802170:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (675282944->679477247) req@ffff8d547fbf7480 x1874672134270848/t30064771460(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:612/0 lens 488/448 e 0 to 0 dl 1787827022 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827011.802181:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf7480 with x1874672134270848 ext(675282944->679477247) 00002000:00010000:0.0:1787827011.802198:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf7480 00000100:00100000:2.0:1787827011.985349:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827011.985404:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827011.985433:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134270976 00000100:00100000:0.0:1787827011.985443:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134270976 00000100:00100000:2.0:1787827011.985444:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827011.985471:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134271232 00000100:00100000:1.0:1787827011.985477:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134271232 00000100:00100000:3.0:1787827011.985496:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134271104 00000100:00100000:3.0:1787827011.985503:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134271104 00000100:00100000:0.0:1787827011.985514:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 527 00000100:00100000:0.0:1787827011.985540:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134270976:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827011.985541:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 416 00000100:00100000:2.0:1787827011.985554:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 417 00000100:00100000:1.0:1787827011.985558:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134271232:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827011.985567:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2392:x1874672134271104:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:3.0:1787827011.985592:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787827011.985597:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827011.985620:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134270976:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827011.985620:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134271232:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827011.985624:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2392:x1874672134271104:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827011.985639:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 527 00000100:00100000:1.0:1787827011.985642:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 416 00000100:00100000:2.0:1787827011.985660:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 417 00000100:00100000:1.0:1787827012.022595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827012.022714:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134271360 00000100:00100000:3.0:1787827012.022723:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134271360 00002000:00100000:3.0:1787827012.022767:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (679477248->683671551) req@ffff8d547fbf4b40 x1874672134271360/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/0 e 0 to 0 dl 1787827023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827012.022792:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4b40 with x1874672134271360 ext(679477248->683671551) 00002000:00010000:3.0:1787827012.022798:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4b40 00000100:00100000:3.0:1787827012.022835:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 456 00000100:00100000:3.0:1787827012.022845:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134271360:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827012.040504:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134271360:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17650us (17907us total) trans 30064771461 rc 0/0 00000100:00100000:3.0:1787827012.040517:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 456 00002000:00100000:3.0:1787827012.040530:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (679477248->683671551) req@ffff8d547fbf4b40 x1874672134271360/t30064771461(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/448 e 0 to 0 dl 1787827023 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827012.040540:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4b40 with x1874672134271360 ext(679477248->683671551) 00002000:00010000:3.0:1787827012.040547:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4b40 00000100:00100000:2.0:1787827012.265389:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827012.265493:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134271488 00000100:00100000:0.0:1787827012.265502:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134271488 00002000:00100000:0.0:1787827012.265546:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (683671552->687865855) req@ffff8d547fb5b0c0 x1874672134271488/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/0 e 0 to 0 dl 1787827023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827012.265575:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b0c0 with x1874672134271488 ext(683671552->687865855) 00002000:00010000:0.0:1787827012.265580:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b0c0 00000100:00100000:0.0:1787827012.265616:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 457 00000100:00100000:0.0:1787827012.265741:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134271488:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827012.280024:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134271488:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14381us (14626us total) trans 30064771462 rc 0/0 00000100:00100000:2.0:1787827012.280054:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 457 00002000:00100000:2.0:1787827012.280067:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (683671552->687865855) req@ffff8d547fb5b0c0 x1874672134271488/t30064771462(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/448 e 0 to 0 dl 1787827023 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827012.280089:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb5b0c0 with x1874672134271488 ext(683671552->687865855) 00002000:00010000:2.0:1787827012.280096:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb5b0c0 00000100:00100000:0.0:1787827012.494780:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827012.494850:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134271616 00000100:00100000:2.0:1787827012.494859:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134271616 00002000:00100000:2.0:1787827012.494906:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (687865856->692060159) req@ffff8d5347a30b40 x1874672134271616/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/0 e 0 to 0 dl 1787827023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827012.494916:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30b40 with x1874672134271616 ext(687865856->692060159) 00002000:00010000:2.0:1787827012.494921:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30b40 00000100:00100000:2.0:1787827012.494958:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 458 00000100:00100000:2.0:1787827012.494967:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a30b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134271616:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827012.510634:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a30b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134271616:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15651us (15845us total) trans 30064771463 rc 0/0 00000100:00100000:2.0:1787827012.510650:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 458 00002000:00100000:2.0:1787827012.510663:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (687865856->692060159) req@ffff8d5347a30b40 x1874672134271616/t30064771463(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/448 e 0 to 0 dl 1787827023 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827012.510673:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30b40 with x1874672134271616 ext(687865856->692060159) 00002000:00010000:2.0:1787827012.510678:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30b40 00000100:00100000:1.0:1787827012.689390:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143773440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827012.689414:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143773568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827012.689446:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143773696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827012.689464:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827012.689464:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827012.689513:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773568 00000100:00100000:0.0:1787827012.689521:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773568 00000100:00100000:2.0:1787827012.689538:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827012.689573:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773440 00000100:00100000:1.0:1787827012.689578:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773440 00000100:00100000:3.0:1787827012.689581:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773696 00000100:00100000:3.0:1787827012.689588:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773696 00000100:00100000:0.0:1787827012.689599:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787827012.689620:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143773568:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827012.689633:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787827012.689640:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143773440:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:0.0:1787827012.689655:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:1.0:1787827012.689662:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827012.689662:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1787827012.689669:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827012.689677:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143773696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787827012.689694:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827012.689759:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143773568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827012.689998:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143773568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 387us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827012.690007:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787827012.690023:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143773440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 378us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827012.690038:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787827012.690045:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143773696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 369us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827012.690055:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:2.0:1787827012.690064:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a330c0 x1874672143773440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827012.690085:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143773440:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787827012.690108:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a30000 x1874672143773696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827012.690128:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143773696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827012.719597:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827012.719713:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134271744 00000100:00100000:1.0:1787827012.719723:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134271744 00002000:00100000:1.0:1787827012.719771:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (692060160->696254463) req@ffff8d547fbff840 x1874672134271744/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/0 e 0 to 0 dl 1787827023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827012.719784:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbff840 with x1874672134271744 ext(692060160->696254463) 00002000:00010000:1.0:1787827012.719790:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbff840 00000100:00100000:1.0:1787827012.719821:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 459 00000100:00100000:1.0:1787827012.719831:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134271744:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827012.732300:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134271744:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12463us (12705us total) trans 30064771464 rc 0/0 00000100:00100000:2.0:1787827012.732312:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 459 00002000:00100000:2.0:1787827012.732325:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (692060160->696254463) req@ffff8d547fbff840 x1874672134271744/t30064771464(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/448 e 0 to 0 dl 1787827023 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827012.732335:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbff840 with x1874672134271744 ext(692060160->696254463) 00002000:00010000:2.0:1787827012.732341:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbff840 00010000:00010000:0.0:1787827012.817393:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827012.937308:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827012.937445:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134271872 00000100:00100000:1.0:1787827012.937455:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134271872 00002000:00100000:1.0:1787827012.937503:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (696254464->700448767) req@ffff8d547fbfe940 x1874672134271872/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/0 e 0 to 0 dl 1787827023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827012.937515:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfe940 with x1874672134271872 ext(696254464->700448767) 00002000:00010000:1.0:1787827012.937521:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfe940 00000100:00100000:1.0:1787827012.937553:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 460 00000100:00100000:1.0:1787827012.937563:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134271872:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827012.951302:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134271872:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13730us (13993us total) trans 30064771465 rc 0/0 00000100:00100000:1.0:1787827012.951331:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 460 00002000:00100000:1.0:1787827012.951344:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (696254464->700448767) req@ffff8d547fbfe940 x1874672134271872/t30064771465(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:613/0 lens 488/448 e 0 to 0 dl 1787827023 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827012.951355:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfe940 with x1874672134271872 ext(696254464->700448767) 00002000:00010000:1.0:1787827012.951361:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfe940 00000100:00100000:0.0:1787827013.163088:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827013.163159:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272000 00000100:00100000:3.0:1787827013.163170:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272000 00000100:00080000:2.0:1787827013.163294:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787827013.163296:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (700448768->704643071) req@ffff8d5347a30000 x1874672134272000/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/0 e 0 to 0 dl 1787827024 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827013.163310:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30000 with x1874672134272000 ext(700448768->704643071) 00002000:00010000:3.0:1787827013.163317:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30000 00000100:00100000:3.0:1787827013.163360:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 461 00000100:00100000:3.0:1787827013.163373:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134272000:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827013.174814:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134272000:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11433us (11728us total) trans 30064771466 rc 0/0 00000100:00100000:3.0:1787827013.174830:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 461 00002000:00100000:3.0:1787827013.174844:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (700448768->704643071) req@ffff8d5347a30000 x1874672134272000/t30064771466(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/448 e 0 to 0 dl 1787827024 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827013.174861:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30000 with x1874672134272000 ext(700448768->704643071) 00002000:00010000:3.0:1787827013.174868:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30000 00000100:00100000:0.0:1787827013.201406:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143773824:0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.201406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143774208:0@lo:400:kworker.0 00000100:00100000:1.0:1787827013.201422:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143773952:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.201470:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143774080:0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.201489:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827013.201499:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827013.201514:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774208 00000100:00100000:1.0:1787827013.201522:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774208 00000100:00100000:3.0:1787827013.201522:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827013.201567:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143774720:0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.201570:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143774336:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.201570:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143774592:0@lo:400:kworker.0 00000100:00100000:1.0:1787827013.201587:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1787827013.201599:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143774208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.201605:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827013.201622:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827013.201626:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827013.201635:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143775232:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.201660:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143775104:0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.201662:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143774848:0@lo:400:kworker.0 00000100:00100000:1.0:1787827013.201670:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143774208:12345-0@lo:400:kworker.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827013.201672:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827013.201685:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1787827013.201695:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827013.201706:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774720 00000100:00100000:1.0:1787827013.201711:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774720 00000100:00100000:2.0:1787827013.201715:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143774208:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.201725:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787827013.201732:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827013.201736:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143774976:0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.201756:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143775232 00000100:00100000:2.0:1787827013.201761:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143775232 00000100:00100000:0.0:1787827013.201767:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143775360:0@lo:400:kworker.0 00000100:00100000:1.0:1787827013.201767:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774848 00000100:00100000:1.0:1787827013.201774:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774848 00000100:00100000:3.0:1787827013.201783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827013.201795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1787827013.201804:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143774720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827013.201819:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1787827013.201820:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827013.201832:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774080 00000100:00100000:1.0:1787827013.201833:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143775232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.201839:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774080 00000100:00100000:2.0:1787827013.201862:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143774720:12345-0@lo:400:kworker.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827013.201868:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773824 00000100:00100000:2.0:1787827013.201873:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1787827013.201875:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773824 00000100:00100000:1.0:1787827013.201880:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143775232:12345-0@lo:400:kworker.0 Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827013.201886:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1787827013.201886:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774336 00000100:00100000:3.0:1787827013.201892:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774336 00000100:00100000:2.0:1787827013.201894:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143775360 00000100:00100000:2.0:1787827013.201899:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143775360 00000100:00100000:1.0:1787827013.201908:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787827013.201925:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1787827013.201930:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143774848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.201930:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787827013.201943:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143774080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.201946:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1787827013.201953:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143773824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.201962:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143775360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827013.201984:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143774848:12345-0@lo:400:kworker.0 Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827013.202000:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1787827013.202019:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143774080:12345-0@lo:400:kworker.0 Request processed in 77us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827013.202027:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143773824:12345-0@lo:400:kworker.0 Request processed in 88us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827013.202028:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143775360:12345-0@lo:400:kworker.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827013.202033:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00010000:00080000:1.0:1787827013.202041:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dfc00 x1874672143774848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827013.202047:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1787827013.202048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1787827013.202056:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787827013.202066:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143774848:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.202071:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143774336:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787827013.202081:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787827013.202088:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787827013.202098:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477df0c0 x1874672143775360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827013.202109:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774592 00000100:00100000:1.0:1787827013.202109:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143775360:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.202115:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143774336:12345-0@lo:400:kworker.0 Request processed in 45us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827013.202117:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774592 00000100:00100000:2.0:1787827013.202122:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827013.202130:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143773824:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.202131:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787827013.202150:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143774464:0@lo:400:kworker.0 00000100:00100000:1.0:1787827013.202153:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143774336:0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.202161:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143775104 00000100:00100000:3.0:1787827013.202164:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143773952 00000100:00100000:0.0:1787827013.202165:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143775104 00000100:00100000:3.0:1787827013.202170:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143773952 00000100:00100000:2.0:1787827013.202188:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827013.202244:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1787827013.202254:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774976 00000100:00100000:3.0:1787827013.202254:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143773952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.202258:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143774464 00000100:00100000:0.0:1787827013.202260:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774976 00000100:00100000:2.0:1787827013.202264:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143774464 00000100:00100000:1.0:1787827013.202272:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787827013.202284:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143774592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.202301:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143773952:12345-0@lo:400:kworker.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827013.202308:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787827013.202312:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1787827013.202316:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787827013.202317:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143775104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.202328:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143774464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.202342:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787827013.202352:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143775104:12345-0@lo:400:kworker.0 Request processed in 36us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827013.202354:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143774976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.202375:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143774464:12345-0@lo:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827013.202377:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787827013.202388:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787827013.202407:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143774976:12345-0@lo:400:kworker.0 Request processed in 56us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827013.202417:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143774592:12345-0@lo:400:kworker.0 Request processed in 133us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827013.202417:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:0.0:1787827013.202422:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827013.202431:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787827013.202437:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143773952:0@lo:400:kworker.0 00000100:00100000:2.0:1787827013.202456:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143774464:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.202468:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143774976:0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.202475:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143774720:0@lo:400:kworker.0 00000100:00100000:3.0:1787827013.202495:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143774080:0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.202498:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143775232:0@lo:400:kworker.0 00010000:00080000:3.0:1787827013.202513:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dc3c0 x1874672143774592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827013.202523:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143774592:0@lo:400:kworker.0 00010000:00080000:3.0:1787827013.202532:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477de580 x1874672143775104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827013.202540:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143775104:0@lo:400:kworker.0 00000100:00100000:0.0:1787827013.373999:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827013.374062:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272128 00000100:00100000:1.0:1787827013.374070:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272128 00002000:00100000:1.0:1787827013.374114:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (704643072->708837375) req@ffff8d5347a321c0 x1874672134272128/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/0 e 0 to 0 dl 1787827024 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827013.374125:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a321c0 with x1874672134272128 ext(704643072->708837375) 00002000:00010000:1.0:1787827013.374130:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a321c0 00000100:00100000:1.0:1787827013.374160:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 462 00000100:00100000:1.0:1787827013.374168:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134272128:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827013.384356:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134272128:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10180us (10358us total) trans 30064771467 rc 0/0 00000100:00100000:1.0:1787827013.384368:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 462 00002000:00100000:1.0:1787827013.384379:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (704643072->708837375) req@ffff8d5347a321c0 x1874672134272128/t30064771467(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/448 e 0 to 0 dl 1787827024 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827013.384386:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a321c0 with x1874672134272128 ext(704643072->708837375) 00002000:00010000:1.0:1787827013.384390:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a321c0 00000100:00100000:2.0:1787827013.587510:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827013.587586:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272256 00000100:00100000:0.0:1787827013.587610:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272256 00002000:00100000:0.0:1787827013.587661:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (708837376->713031679) req@ffff8d547fbbde00 x1874672134272256/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/0 e 0 to 0 dl 1787827024 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827013.587672:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbde00 with x1874672134272256 ext(708837376->713031679) 00002000:00010000:0.0:1787827013.587678:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbde00 00000100:00100000:0.0:1787827013.587705:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 463 00000100:00100000:0.0:1787827013.587714:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134272256:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827013.598164:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134272256:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10441us (10653us total) trans 30064771468 rc 0/0 00000100:00100000:1.0:1787827013.598188:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 463 00002000:00100000:1.0:1787827013.598201:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (708837376->713031679) req@ffff8d547fbbde00 x1874672134272256/t30064771468(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/448 e 0 to 0 dl 1787827024 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827013.598211:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbde00 with x1874672134272256 ext(708837376->713031679) 00002000:00010000:1.0:1787827013.598237:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbde00 00000100:00100000:2.0:1787827013.713453:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143775488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827013.713522:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827013.713565:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143775488 00000100:00100000:0.0:1787827013.713572:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143775488 00000100:00100000:0.0:1787827013.713628:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787827013.713639:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143775488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827013.713670:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827013.713716:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143775488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827013.713724:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787827013.713758:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143775488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827013.798351:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827013.798394:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272384 00000100:00100000:3.0:1787827013.798403:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272384 00002000:00100000:3.0:1787827013.798441:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (713031680->717225983) req@ffff8d5347a30780 x1874672134272384/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/0 e 0 to 0 dl 1787827024 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827013.798448:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30780 with x1874672134272384 ext(713031680->717225983) 00002000:00010000:3.0:1787827013.798452:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30780 00000100:00100000:3.0:1787827013.798474:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 464 00000100:00100000:3.0:1787827013.798480:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134272384:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827013.808941:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134272384:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10445us (10588us total) trans 30064771469 rc 0/0 00000100:00100000:3.0:1787827013.808955:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 464 00002000:00100000:3.0:1787827013.808968:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (713031680->717225983) req@ffff8d5347a30780 x1874672134272384/t30064771469(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:614/0 lens 488/448 e 0 to 0 dl 1787827024 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827013.808983:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a30780 with x1874672134272384 ext(713031680->717225983) 00002000:00010000:3.0:1787827013.808990:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a30780 00010000:00010000:2.0:1787827013.841369:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827014.000333:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827014.000401:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272512 00000100:00100000:0.0:1787827014.000411:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272512 00002000:00100000:0.0:1787827014.000459:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (717225984->721420287) req@ffff8d547fbbe1c0 x1874672134272512/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/0 e 0 to 0 dl 1787827025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827014.000471:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbe1c0 with x1874672134272512 ext(717225984->721420287) 00002000:00010000:0.0:1787827014.000476:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbe1c0 00000100:00100000:0.0:1787827014.000506:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 465 00000100:00100000:0.0:1787827014.000516:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134272512:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827014.010014:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134272512:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 9483us (9670us total) trans 30064771470 rc 0/0 00000100:00100000:0.0:1787827014.010042:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 465 00002000:00100000:0.0:1787827014.010056:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (717225984->721420287) req@ffff8d547fbbe1c0 x1874672134272512/t30064771470(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/448 e 0 to 0 dl 1787827025 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827014.010065:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbbe1c0 with x1874672134272512 ext(717225984->721420287) 00002000:00010000:0.0:1787827014.010072:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbbe1c0 00000100:00100000:1.0:1787827014.191362:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827014.191423:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272640 00000100:00100000:2.0:1787827014.191433:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272640 00002000:00100000:2.0:1787827014.191489:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (721420288->725614591) req@ffff8d547fbf4000 x1874672134272640/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/0 e 0 to 0 dl 1787827025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827014.191501:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4000 with x1874672134272640 ext(721420288->725614591) 00002000:00010000:2.0:1787827014.191515:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4000 00000100:00100000:2.0:1787827014.191546:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 466 00000100:00100000:2.0:1787827014.191555:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134272640:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827014.202497:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134272640:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10925us (11131us total) trans 30064771471 rc 0/0 00000100:00100000:3.0:1787827014.202516:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 466 00002000:00100000:3.0:1787827014.202533:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (721420288->725614591) req@ffff8d547fbf4000 x1874672134272640/t30064771471(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/448 e 0 to 0 dl 1787827025 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827014.202591:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4000 with x1874672134272640 ext(721420288->725614591) 00002000:00010000:3.0:1787827014.202601:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4000 00000100:00100000:1.0:1787827014.416624:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827014.416711:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272768 00000100:00100000:2.0:1787827014.416723:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272768 00002000:00100000:2.0:1787827014.416786:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (725614592->729808895) req@ffff8d547fbf6d00 x1874672134272768/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/0 e 0 to 0 dl 1787827025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827014.416800:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6d00 with x1874672134272768 ext(725614592->729808895) 00002000:00010000:2.0:1787827014.416807:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6d00 00000100:00100000:2.0:1787827014.416839:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 467 00000100:00100000:2.0:1787827014.416850:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134272768:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827014.429776:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134272768:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12918us (13157us total) trans 30064771472 rc 0/0 00000100:00100000:2.0:1787827014.429789:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 467 00002000:00100000:2.0:1787827014.429801:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (725614592->729808895) req@ffff8d547fbf6d00 x1874672134272768/t30064771472(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/448 e 0 to 0 dl 1787827025 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827014.429820:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf6d00 with x1874672134272768 ext(725614592->729808895) 00002000:00010000:2.0:1787827014.429825:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf6d00 00000100:00100000:1.0:1787827014.624758:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827014.624812:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134272896 00000100:00100000:3.0:1787827014.624821:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134272896 00002000:00100000:3.0:1787827014.624867:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (729808896->734003199) req@ffff8d547fbf4780 x1874672134272896/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/0 e 0 to 0 dl 1787827025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827014.624879:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4780 with x1874672134272896 ext(729808896->734003199) 00002000:00010000:3.0:1787827014.624885:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4780 00000100:00100000:3.0:1787827014.624913:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 468 00000100:00100000:3.0:1787827014.624923:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134272896:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827014.634714:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134272896:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 9782us (9955us total) trans 30064771473 rc 0/0 00000100:00100000:3.0:1787827014.634729:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 468 00002000:00100000:3.0:1787827014.634744:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (729808896->734003199) req@ffff8d547fbf4780 x1874672134272896/t30064771473(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/448 e 0 to 0 dl 1787827025 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827014.634754:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf4780 with x1874672134272896 ext(729808896->734003199) 00002000:00010000:3.0:1787827014.634760:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf4780 00000100:00100000:2.0:1787827014.837795:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827014.837854:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273024 00000100:00100000:3.0:1787827014.837864:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273024 00002000:00100000:3.0:1787827014.837922:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (734003200->738197503) req@ffff8d547d357480 x1874672134273024/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/0 e 0 to 0 dl 1787827025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827014.837934:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d357480 with x1874672134273024 ext(734003200->738197503) 00002000:00010000:3.0:1787827014.837939:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d357480 00000100:00100000:3.0:1787827014.837971:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 469 00000100:00100000:3.0:1787827014.837978:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134273024:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827014.849385:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134273024:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11396us (11588us total) trans 30064771474 rc 0/0 00000100:00100000:1.0:1787827014.849399:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 469 00002000:00100000:1.0:1787827014.849423:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (734003200->738197503) req@ffff8d547d357480 x1874672134273024/t30064771474(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:615/0 lens 488/448 e 0 to 0 dl 1787827025 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827014.849434:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d357480 with x1874672134273024 ext(734003200->738197503) 00002000:00010000:1.0:1787827014.849448:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d357480 00010000:00010000:2.0:1787827014.865336:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827015.038610:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827015.038684:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273152 00000100:00100000:1.0:1787827015.038693:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273152 00000100:00080000:0.0:1787827015.038763:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787827015.038765:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (738197504->742391807) req@ffff8d53477de580 x1874672134273152/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/0 e 0 to 0 dl 1787827026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827015.038778:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477de580 with x1874672134273152 ext(738197504->742391807) 00002000:00010000:1.0:1787827015.038784:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477de580 00000100:00100000:1.0:1787827015.038812:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 470 00000100:00100000:1.0:1787827015.038822:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134273152:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827015.050782:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134273152:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11952us (12170us total) trans 30064771475 rc 0/0 00000100:00100000:2.0:1787827015.050798:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 470 00002000:00100000:2.0:1787827015.050811:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (738197504->742391807) req@ffff8d53477de580 x1874672134273152/t30064771475(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/448 e 0 to 0 dl 1787827026 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827015.050822:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477de580 with x1874672134273152 ext(738197504->742391807) 00002000:00010000:2.0:1787827015.050827:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477de580 00000100:00100000:1.0:1787827015.236595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827015.236665:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273280 00000100:00100000:0.0:1787827015.236675:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273280 00002000:00100000:0.0:1787827015.236720:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (742391808->746586111) req@ffff8d547fbfde00 x1874672134273280/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/0 e 0 to 0 dl 1787827026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827015.236731:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfde00 with x1874672134273280 ext(742391808->746586111) 00002000:00010000:0.0:1787827015.236736:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfde00 00000100:00100000:0.0:1787827015.236775:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 471 00000100:00100000:0.0:1787827015.236784:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134273280:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827015.248287:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134273280:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11495us (11700us total) trans 30064771476 rc 0/0 00000100:00100000:0.0:1787827015.248301:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 471 00002000:00100000:0.0:1787827015.248312:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (742391808->746586111) req@ffff8d547fbfde00 x1874672134273280/t30064771476(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/448 e 0 to 0 dl 1787827026 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827015.248322:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbfde00 with x1874672134273280 ext(742391808->746586111) 00002000:00010000:0.0:1787827015.248328:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbfde00 00000100:00100000:1.0:1787827015.249376:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143775616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827015.249397:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143775744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827015.249442:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827015.249483:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827015.249507:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143775744 00000100:00100000:0.0:1787827015.249515:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143775744 00000100:00100000:3.0:1787827015.249545:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143775616 00000100:00100000:3.0:1787827015.249551:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143775616 00000100:00100000:0.0:1787827015.249585:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787827015.249598:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787827015.249599:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143775744:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787827015.249604:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827015.249612:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143775616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787827015.249621:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2564096 granted 563422656 pending 75939840 free 2849767424 avail 2618245120 00002000:00000024:3.0:1787827015.249626:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2564096 granted 563422656 pending 75939840 free 2849767424 avail 2618245120 00000100:00100000:0.0:1787827015.249681:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143775744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827015.249689:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143775616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827015.249691:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787827015.249702:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787827015.249735:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d13a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143775616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827015.249955:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143775744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827015.449687:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827015.449768:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273408 00000100:00100000:3.0:1787827015.449784:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273408 00002000:00100000:3.0:1787827015.449852:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (746586112->750780415) req@ffff8d546e154000 x1874672134273408/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/0 e 0 to 0 dl 1787827026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827015.449866:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e154000 with x1874672134273408 ext(746586112->750780415) 00002000:00010000:3.0:1787827015.449872:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e154000 00000100:00100000:3.0:1787827015.449912:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 472 00000100:00100000:3.0:1787827015.449923:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134273408:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827015.462993:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134273408:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13057us (13299us total) trans 30064771477 rc 0/0 00000100:00100000:0.0:1787827015.463011:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 472 00002000:00100000:0.0:1787827015.463026:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (746586112->750780415) req@ffff8d546e154000 x1874672134273408/t30064771477(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/448 e 0 to 0 dl 1787827026 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827015.463038:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e154000 with x1874672134273408 ext(746586112->750780415) 00002000:00010000:0.0:1787827015.463045:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e154000 00000100:00100000:2.0:1787827015.667326:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827015.667400:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273536 00000100:00100000:0.0:1787827015.667416:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273536 00002000:00100000:0.0:1787827015.667486:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (750780416->754974719) req@ffff8d546e15f480 x1874672134273536/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/0 e 0 to 0 dl 1787827026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827015.667500:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15f480 with x1874672134273536 ext(750780416->754974719) 00002000:00010000:0.0:1787827015.667506:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15f480 00000100:00100000:0.0:1787827015.667542:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 473 00000100:00100000:0.0:1787827015.667553:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134273536:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827015.679863:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134273536:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12303us (12538us total) trans 30064771478 rc 0/0 00000100:00100000:0.0:1787827015.679874:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 473 00002000:00100000:0.0:1787827015.679892:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (750780416->754974719) req@ffff8d546e15f480 x1874672134273536/t30064771478(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/448 e 0 to 0 dl 1787827026 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827015.679899:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15f480 with x1874672134273536 ext(750780416->754974719) 00002000:00010000:0.0:1787827015.679904:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15f480 00000100:00100000:2.0:1787827015.877906:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827015.878039:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273664 00000100:00100000:3.0:1787827015.878047:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273664 00002000:00100000:3.0:1787827015.878093:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (754974720->759169023) req@ffff8d546e15c780 x1874672134273664/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/0 e 0 to 0 dl 1787827026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827015.878101:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15c780 with x1874672134273664 ext(754974720->759169023) 00002000:00010000:3.0:1787827015.878105:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15c780 00000100:00100000:3.0:1787827015.878130:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 474 00000100:00100000:3.0:1787827015.878136:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134273664:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787827015.889389:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827015.890281:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134273664:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12138us (12377us total) trans 30064771479 rc 0/0 00000100:00100000:3.0:1787827015.890292:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 474 00002000:00100000:3.0:1787827015.890303:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (754974720->759169023) req@ffff8d546e15c780 x1874672134273664/t30064771479(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:616/0 lens 488/448 e 0 to 0 dl 1787827026 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827015.890311:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15c780 with x1874672134273664 ext(754974720->759169023) 00002000:00010000:3.0:1787827015.890315:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15c780 00000100:00100000:1.0:1787827016.081166:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827016.081260:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273792 00000100:00100000:2.0:1787827016.081270:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273792 00002000:00100000:2.0:1787827016.081324:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (759169024->763363327) req@ffff8d547d13a1c0 x1874672134273792/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/0 e 0 to 0 dl 1787827027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827016.081334:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d13a1c0 with x1874672134273792 ext(759169024->763363327) 00002000:00010000:2.0:1787827016.081352:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d13a1c0 00000100:00100000:2.0:1787827016.081385:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 475 00000100:00100000:2.0:1787827016.081395:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134273792:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827016.091416:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d13a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134273792:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10011us (10254us total) trans 30064771480 rc 0/0 00000100:00100000:1.0:1787827016.091435:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 475 00002000:00100000:1.0:1787827016.091449:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (759169024->763363327) req@ffff8d547d13a1c0 x1874672134273792/t30064771480(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/448 e 0 to 0 dl 1787827027 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827016.091459:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547d13a1c0 with x1874672134273792 ext(759169024->763363327) 00002000:00010000:1.0:1787827016.091465:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547d13a1c0 00000100:00100000:0.0:1787827016.290774:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827016.290835:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134273920 00000100:00100000:1.0:1787827016.290845:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134273920 00002000:00100000:1.0:1787827016.290893:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (763363328->767557631) req@ffff8d5347a303c0 x1874672134273920/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/0 e 0 to 0 dl 1787827027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827016.290915:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a303c0 with x1874672134273920 ext(763363328->767557631) 00002000:00010000:1.0:1787827016.290922:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a303c0 00000100:00100000:1.0:1787827016.290951:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 476 00000100:00100000:1.0:1787827016.290962:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134273920:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827016.301165:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134273920:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10189us (10385us total) trans 30064771481 rc 0/0 00000100:00100000:1.0:1787827016.301177:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 476 00002000:00100000:1.0:1787827016.301187:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (763363328->767557631) req@ffff8d5347a303c0 x1874672134273920/t30064771481(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/448 e 0 to 0 dl 1787827027 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827016.301195:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a303c0 with x1874672134273920 ext(763363328->767557631) 00002000:00010000:1.0:1787827016.301199:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a303c0 00000100:00100000:2.0:1787827016.517923:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827016.517992:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274048 00000100:00100000:1.0:1787827016.518003:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274048 00002000:00100000:1.0:1787827016.518044:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (767557632->771751935) req@ffff8d546e15d2c0 x1874672134274048/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/0 e 0 to 0 dl 1787827027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827016.518052:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15d2c0 with x1874672134274048 ext(767557632->771751935) 00002000:00010000:1.0:1787827016.518056:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15d2c0 00000100:00100000:1.0:1787827016.518081:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 477 00000100:00100000:1.0:1787827016.518087:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2390:x1874672134274048:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827016.531905:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e15d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2390:x1874672134274048:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13810us (13993us total) trans 30064771482 rc 0/0 00000100:00100000:1.0:1787827016.531916:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 477 00002000:00100000:1.0:1787827016.531940:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (767557632->771751935) req@ffff8d546e15d2c0 x1874672134274048/t30064771482(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/448 e 0 to 0 dl 1787827027 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827016.531950:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e15d2c0 with x1874672134274048 ext(767557632->771751935) 00002000:00010000:1.0:1787827016.531956:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e15d2c0 00000100:00100000:2.0:1787827016.732361:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827016.732427:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274176 00000100:00100000:1.0:1787827016.732437:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274176 00002000:00100000:1.0:1787827016.732484:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (771751936->775946239) req@ffff8d53492c4000 x1874672134274176/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/0 e 0 to 0 dl 1787827027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827016.732495:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4000 with x1874672134274176 ext(771751936->775946239) 00002000:00010000:1.0:1787827016.732500:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4000 00000100:00100000:1.0:1787827016.732531:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 478 00000100:00100000:1.0:1787827016.732541:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2392:x1874672134274176:12345-192.168.203.6@tcp:4:iozone.0 00000001:00080000:1.0:1787827016.743349:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771482 is committed 00000100:00100000:3.0:1787827016.743381:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2392:x1874672134274176:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10834us (11021us total) trans 30064771483 rc 0/0 00000100:00100000:3.0:1787827016.743393:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 478 00002000:00100000:3.0:1787827016.743404:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (771751936->775946239) req@ffff8d53492c4000 x1874672134274176/t30064771483(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/448 e 0 to 0 dl 1787827027 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827016.743412:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4000 with x1874672134274176 ext(771751936->775946239) 00002000:00010000:3.0:1787827016.743417:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4000 00010000:00010000:0.0:1787827016.913455:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827016.944172:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827016.944259:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274304 00000100:00100000:0.0:1787827016.944269:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274304 00002000:00100000:0.0:1787827016.944327:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (775946240->780140543) req@ffff8d547f9c03c0 x1874672134274304/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/0 e 0 to 0 dl 1787827027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827016.944340:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c03c0 with x1874672134274304 ext(775946240->780140543) 00002000:00010000:0.0:1787827016.944347:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c03c0 00000100:00100000:0.0:1787827016.944380:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 479 00000100:00100000:0.0:1787827016.944391:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134274304:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827016.955940:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134274304:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11532us (11774us total) trans 30064771484 rc 0/0 00000100:00100000:1.0:1787827016.955961:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 479 00002000:00100000:1.0:1787827016.955979:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (775946240->780140543) req@ffff8d547f9c03c0 x1874672134274304/t30064771484(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:617/0 lens 488/448 e 0 to 0 dl 1787827027 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827016.955988:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c03c0 with x1874672134274304 ext(775946240->780140543) 00002000:00010000:1.0:1787827016.955994:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c03c0 00000100:00100000:2.0:1787827017.105891:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827017.105939:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827017.105953:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274560 00000100:00100000:3.0:1787827017.105963:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274560 00000100:00100000:2.0:1787827017.105991:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827017.106032:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274432 00000100:00100000:2.0:1787827017.106033:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274688 00000100:00100000:2.0:1787827017.106040:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274688 00000100:00100000:1.0:1787827017.106046:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274432 00000100:00100000:3.0:1787827017.106053:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 424 00000100:00100000:3.0:1787827017.106071:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134274560:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827017.106091:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 425 00000100:00100000:2.0:1787827017.106102:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134274688:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827017.106125:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 529 00000100:00100000:1.0:1787827017.106137:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134274432:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827017.106188:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134274688:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827017.106189:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134274560:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827017.106200:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827017.106205:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827017.106208:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 425 00000100:00100000:3.0:1787827017.106238:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 424 00000100:00100000:1.0:1787827017.106277:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134274432:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 139us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827017.106286:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 529 00000100:00100000:2.0:1787827017.156312:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827017.156376:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274816 00000100:00100000:0.0:1787827017.156385:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274816 00002000:00100000:0.0:1787827017.156448:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (780140544->784334847) req@ffff8d53492c4b40 x1874672134274816/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/0 e 0 to 0 dl 1787827028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827017.156457:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4b40 with x1874672134274816 ext(780140544->784334847) 00002000:00010000:0.0:1787827017.156461:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4b40 00000100:00100000:0.0:1787827017.156486:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 480 00000100:00100000:0.0:1787827017.156494:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134274816:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:2.0:1787827017.156767:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827017.167816:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134274816:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11313us (11501us total) trans 30064771485 rc 0/0 00000100:00100000:3.0:1787827017.167830:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 480 00002000:00100000:3.0:1787827017.167844:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (780140544->784334847) req@ffff8d53492c4b40 x1874672134274816/t30064771485(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/448 e 0 to 0 dl 1787827028 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827017.167855:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c4b40 with x1874672134274816 ext(780140544->784334847) 00002000:00010000:3.0:1787827017.167861:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c4b40 00000100:00100000:1.0:1787827017.380317:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827017.380380:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134274944 00000100:00100000:0.0:1787827017.380401:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134274944 00002000:00100000:0.0:1787827017.380447:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (784334848->788529151) req@ffff8d547f9c3840 x1874672134274944/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/0 e 0 to 0 dl 1787827028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827017.380458:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3840 with x1874672134274944 ext(784334848->788529151) 00002000:00010000:0.0:1787827017.380463:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3840 00000100:00100000:0.0:1787827017.380492:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 481 00000100:00100000:0.0:1787827017.380503:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134274944:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827017.392100:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134274944:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11589us (11779us total) trans 30064771486 rc 0/0 00000100:00100000:1.0:1787827017.392116:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 481 00002000:00100000:1.0:1787827017.392129:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (784334848->788529151) req@ffff8d547f9c3840 x1874672134274944/t30064771486(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/448 e 0 to 0 dl 1787827028 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827017.392140:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3840 with x1874672134274944 ext(784334848->788529151) 00002000:00010000:1.0:1787827017.392160:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3840 00000100:00100000:2.0:1787827017.604564:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827017.604721:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275072 00000100:00100000:3.0:1787827017.604729:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275072 00002000:00100000:3.0:1787827017.604768:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (788529152->792723455) req@ffff8d53492c52c0 x1874672134275072/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/0 e 0 to 0 dl 1787827028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827017.604775:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c52c0 with x1874672134275072 ext(788529152->792723455) 00002000:00010000:3.0:1787827017.604779:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c52c0 00000100:00100000:3.0:1787827017.604805:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 482 00000100:00100000:3.0:1787827017.604814:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134275072:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827017.616649:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134275072:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11819us (12077us total) trans 30064771487 rc 0/0 00000100:00100000:2.0:1787827017.616668:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 482 00002000:00100000:2.0:1787827017.616686:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (788529152->792723455) req@ffff8d53492c52c0 x1874672134275072/t30064771487(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/448 e 0 to 0 dl 1787827028 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827017.616698:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c52c0 with x1874672134275072 ext(788529152->792723455) 00002000:00010000:2.0:1787827017.616706:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c52c0 00000100:00100000:2.0:1787827017.809451:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827017.809481:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143775872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827017.809492:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143776128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827017.809577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143776000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827017.809682:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827017.809848:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143775872 00000100:00100000:3.0:1787827017.809858:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143775872 00000100:00080000:2.0:1787827017.809925:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827017.809964:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827017.809971:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827017.809982:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776128 00000100:00100000:2.0:1787827017.809987:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776128 00000100:00100000:3.0:1787827017.810031:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787827017.810040:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787827017.810046:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143775872:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827017.810053:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143776128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787827017.810086:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787827017.810092:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827017.810164:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143776128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827017.810173:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787827017.810179:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143775872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827017.810182:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776000 00000100:00100000:1.0:1787827017.810188:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776000 00000100:00080000:2.0:1787827017.810200:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827017.810209:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787827017.810256:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787827017.810265:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143776000:12345-0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787827017.810280:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a32940 x1874672143775872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:1.0:1787827017.810296:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827017.810303:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143775872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827017.810334:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143776000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827017.810341:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787827017.810368:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143776000:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1787827017.810422:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a31e00 x1874672143776128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827017.810431:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143776128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827017.824400:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827017.824501:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275200 00000100:00100000:2.0:1787827017.824514:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275200 00002000:00100000:2.0:1787827017.824583:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (792723456->796917759) req@ffff8d547f9c21c0 x1874672134275200/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/0 e 0 to 0 dl 1787827028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827017.824606:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c21c0 with x1874672134275200 ext(792723456->796917759) 00002000:00010000:2.0:1787827017.824612:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c21c0 00000100:00100000:2.0:1787827017.824669:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 483 00000100:00100000:2.0:1787827017.824683:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2391:x1874672134275200:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827017.839507:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2391:x1874672134275200:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14818us (15115us total) trans 30064771488 rc 0/0 00000100:00100000:2.0:1787827017.839536:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 483 00002000:00100000:2.0:1787827017.839549:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (792723456->796917759) req@ffff8d547f9c21c0 x1874672134275200/t30064771488(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:618/0 lens 488/448 e 0 to 0 dl 1787827028 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827017.839559:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c21c0 with x1874672134275200 ext(792723456->796917759) 00002000:00010000:2.0:1787827017.839566:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c21c0 00010000:00010000:2.0:1787827017.937396:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827018.048323:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827018.048385:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275328 00000100:00100000:3.0:1787827018.048393:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275328 00002000:00100000:3.0:1787827018.048437:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (796917760->801112063) req@ffff8d547f9c3480 x1874672134275328/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/0 e 0 to 0 dl 1787827029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827018.048449:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3480 with x1874672134275328 ext(796917760->801112063) 00002000:00010000:3.0:1787827018.048454:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3480 00000100:00100000:3.0:1787827018.048487:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 484 00000100:00100000:3.0:1787827018.048495:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2390:x1874672134275328:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827018.060382:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2390:x1874672134275328:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11877us (12057us total) trans 30064771489 rc 0/0 00000100:00100000:3.0:1787827018.060397:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 484 00002000:00100000:3.0:1787827018.060410:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (796917760->801112063) req@ffff8d547f9c3480 x1874672134275328/t30064771489(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/448 e 0 to 0 dl 1787827029 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827018.060421:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c3480 with x1874672134275328 ext(796917760->801112063) 00002000:00010000:3.0:1787827018.060426:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c3480 00000100:00100000:1.0:1787827018.272094:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827018.272154:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275456 00000100:00100000:3.0:1787827018.272163:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275456 00002000:00100000:3.0:1787827018.272208:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (801112064->805306367) req@ffff8d547f9c0b40 x1874672134275456/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/0 e 0 to 0 dl 1787827029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827018.272246:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c0b40 with x1874672134275456 ext(801112064->805306367) 00002000:00010000:3.0:1787827018.272252:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c0b40 00000100:00100000:3.0:1787827018.272293:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 485 00000100:00100000:3.0:1787827018.272308:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2391:x1874672134275456:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827018.284752:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2391:x1874672134275456:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12442us (12655us total) trans 30064771490 rc 0/0 00000100:00100000:3.0:1787827018.284764:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 485 00002000:00100000:3.0:1787827018.284775:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (801112064->805306367) req@ffff8d547f9c0b40 x1874672134275456/t30064771490(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/448 e 0 to 0 dl 1787827029 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827018.284782:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c0b40 with x1874672134275456 ext(801112064->805306367) 00002000:00010000:3.0:1787827018.284786:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c0b40 00000100:00100000:0.0:1787827018.321430:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143776384:0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.321430:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143776512:0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.321516:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827018.321524:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827018.321527:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143776640:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.321530:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143776256:0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.321589:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143776896:0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.321596:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143777024:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.321599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827018.321603:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827018.321636:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827018.321646:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143776768:0@lo:400:kworker.0 00000100:00100000:3.0:1787827018.321646:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143777152:0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.321663:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827018.321665:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143777408:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.321688:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827018.321709:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827018.321712:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143777536:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.321719:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143777280:0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.321722:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827018.321737:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143777664:0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.321771:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776256 00000100:00100000:0.0:1787827018.321778:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776256 00000100:00100000:2.0:1787827018.321783:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827018.321815:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143777792:0@lo:400:kworker.0 00000100:00100000:3.0:1787827018.321817:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776896 00000100:00100000:1.0:1787827018.321823:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827018.321824:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776896 00000100:00100000:0.0:1787827018.321832:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1787827018.321843:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143776256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.321857:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827018.321879:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777024 00000100:00100000:3.0:1787827018.321883:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777024 00000100:00100000:1.0:1787827018.321896:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776384 00000100:00100000:1.0:1787827018.321905:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776384 00000100:00100000:2.0:1787827018.321905:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776512 00000100:00100000:3.0:1787827018.321910:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777408 00000100:00100000:2.0:1787827018.321912:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776512 00000100:00100000:3.0:1787827018.321915:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777408 00000100:00100000:0.0:1787827018.321918:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143776256:12345-0@lo:400:kworker.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827018.321944:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1787827018.321949:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777536 00000100:00100000:3.0:1787827018.321953:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777536 00000100:00100000:2.0:1787827018.321958:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776768 00000100:00100000:2.0:1787827018.321963:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776768 00000100:00100000:1.0:1787827018.321973:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143776640 00000100:00100000:3.0:1787827018.321977:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787827018.321982:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143776640 00000100:00100000:0.0:1787827018.321988:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777152 00000100:00100000:0.0:1787827018.321993:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777152 00000100:00100000:3.0:1787827018.321999:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143776896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.322005:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787827018.322017:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143776512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.322024:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777280 00000100:00100000:1.0:1787827018.322031:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777280 00000100:00100000:0.0:1787827018.322032:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777792 00000100:00100000:0.0:1787827018.322037:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777792 00000100:00100000:3.0:1787827018.322051:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143776896:12345-0@lo:400:kworker.0 Request processed in 57us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827018.322065:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787827018.322073:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143776512:12345-0@lo:400:kworker.0 Request processed in 58us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827018.322080:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1787827018.322085:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787827018.322089:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787827018.322096:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143776384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.322096:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1787827018.322102:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143777024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.322112:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.322112:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787827018.322130:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143776768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.322165:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143776384:12345-0@lo:400:kworker.0 Request processed in 74us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827018.322167:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143777024:12345-0@lo:400:kworker.0 Request processed in 69us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827018.322180:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143776640:12345-0@lo:400:kworker.0 Request processed in 72us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827018.322181:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1787827018.322181:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787827018.322190:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143776768:12345-0@lo:400:kworker.0 Request processed in 61us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827018.322197:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1787827018.322207:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787827018.322207:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787827018.322212:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1787827018.322244:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143777408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.322259:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143777152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827018.322276:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143777408:12345-0@lo:400:kworker.0 Request processed in 59us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827018.322284:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787827018.322288:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1787827018.322297:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1787827018.322302:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143777792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.322306:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143777152:12345-0@lo:400:kworker.0 Request processed in 48us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827018.322307:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787827018.322310:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143777280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.322323:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1787827018.322323:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143777536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.322369:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143776896:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.322371:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143777792:12345-0@lo:400:kworker.0 Request processed in 62us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827018.322377:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143777280:12345-0@lo:400:kworker.0 Request processed in 69us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827018.322378:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143777536:12345-0@lo:400:kworker.0 Request processed in 57us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827018.322388:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1787827018.322393:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143777408:0@lo:400:kworker.0 00000100:00100000:3.0:1787827018.322394:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787827018.322396:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00080000:2.0:1787827018.322415:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827018.322419:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143776384:0@lo:400:kworker.0 00000100:00080000:2.0:1787827018.322421:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787827018.322427:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827018.322456:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827018.322484:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143776256:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.322484:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777664 00000100:00100000:2.0:1787827018.322490:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777664 00000100:00100000:3.0:1787827018.322497:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143776640:0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.322502:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143776768:0@lo:400:kworker.0 00000100:00100000:3.0:1787827018.322515:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143777152:0@lo:400:kworker.0 00010000:00080000:1.0:1787827018.322523:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dfc00 x1874672143777280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827018.322539:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1787827018.322551:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143777664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827018.322553:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143777280:0@lo:400:kworker.0 00000100:00080000:0.0:1787827018.322569:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787827018.322574:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe1e00 x1874672143777792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827018.322581:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143777792:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.322609:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143777664:12345-0@lo:400:kworker.0 Request processed in 58us (151us total) trans 0 rc 0/0 00010000:00080000:0.0:1787827018.322611:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dcf00 x1874672143777024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827018.322623:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1787827018.322632:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143777024:0@lo:400:kworker.0 00010000:00080000:0.0:1787827018.322646:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe2940 x1874672143777536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827018.322667:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143777536:0@lo:400:kworker.0 00000100:00100000:0.0:1787827018.322679:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143776512:0@lo:400:kworker.0 00000100:00100000:3.0:1787827018.322885:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143777664:0@lo:400:kworker.0 00000100:00100000:2.0:1787827018.495669:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827018.497250:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275584 00000100:00100000:1.0:1787827018.497262:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275584 00002000:00100000:1.0:1787827018.497314:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (805306368->809500671) req@ffff8d53492c43c0 x1874672134275584/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/0 e 0 to 0 dl 1787827029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827018.497326:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c43c0 with x1874672134275584 ext(805306368->809500671) 00002000:00010000:1.0:1787827018.497331:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c43c0 00000100:00100000:1.0:1787827018.497372:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 486 00000100:00100000:1.0:1787827018.497382:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134275584:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827018.516471:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134275584:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 19083us (20803us total) trans 30064771491 rc 0/0 00000100:00100000:1.0:1787827018.516481:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 486 00002000:00100000:1.0:1787827018.516491:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (805306368->809500671) req@ffff8d53492c43c0 x1874672134275584/t30064771491(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/448 e 0 to 0 dl 1787827029 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827018.516499:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c43c0 with x1874672134275584 ext(805306368->809500671) 00002000:00010000:1.0:1787827018.516504:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c43c0 00000100:00100000:0.0:1787827018.736587:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827018.736663:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275712 00000100:00100000:1.0:1787827018.736677:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275712 00002000:00100000:1.0:1787827018.736753:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (809500672->813694975) req@ffff8d547fbee580 x1874672134275712/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/0 e 0 to 0 dl 1787827029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827018.736776:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee580 with x1874672134275712 ext(809500672->813694975) 00002000:00010000:1.0:1787827018.736780:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee580 00000100:00100000:1.0:1787827018.736806:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 487 00000100:00100000:1.0:1787827018.736818:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134275712:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827018.750633:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134275712:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13809us (14046us total) trans 30064771492 rc 0/0 00000100:00100000:1.0:1787827018.750648:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 487 00002000:00100000:1.0:1787827018.750661:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (809500672->813694975) req@ffff8d547fbee580 x1874672134275712/t30064771492(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/448 e 0 to 0 dl 1787827029 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827018.750671:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee580 with x1874672134275712 ext(809500672->813694975) 00002000:00010000:1.0:1787827018.750677:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee580 00000100:00100000:2.0:1787827018.833465:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143777920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827018.833534:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827018.833593:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143777920 00000100:00100000:0.0:1787827018.833601:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143777920 00000100:00100000:0.0:1787827018.833648:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787827018.833658:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143777920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827018.833689:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827018.833741:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143777920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827018.833748:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787827018.833777:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143777920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827018.951121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827018.951290:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275840 00000100:00100000:0.0:1787827018.951314:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275840 00002000:00100000:0.0:1787827018.951367:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (813694976->817889279) req@ffff8d53492c7840 x1874672134275840/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/0 e 0 to 0 dl 1787827029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827018.951376:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7840 with x1874672134275840 ext(813694976->817889279) 00002000:00010000:0.0:1787827018.951379:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7840 00000100:00100000:0.0:1787827018.951403:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 488 00000100:00100000:0.0:1787827018.951409:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134275840:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787827018.961390:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827018.963131:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134275840:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11712us (12015us total) trans 30064771493 rc 0/0 00000100:00100000:1.0:1787827018.963161:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 488 00002000:00100000:1.0:1787827018.963174:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (813694976->817889279) req@ffff8d53492c7840 x1874672134275840/t30064771493(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:619/0 lens 488/448 e 0 to 0 dl 1787827029 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827018.963185:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7840 with x1874672134275840 ext(813694976->817889279) 00002000:00010000:1.0:1787827018.963191:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7840 00000100:00100000:0.0:1787827019.159175:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827019.159383:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134275968 00000100:00100000:1.0:1787827019.159400:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134275968 00000100:00080000:0.0:1787827019.159467:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787827019.159493:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (817889280->822083583) req@ffff8d547fbed2c0 x1874672134275968/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/0 e 0 to 0 dl 1787827030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827019.159531:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbed2c0 with x1874672134275968 ext(817889280->822083583) 00002000:00010000:1.0:1787827019.159537:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbed2c0 00000100:00100000:1.0:1787827019.159570:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 489 00000100:00100000:1.0:1787827019.159583:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134275968:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827019.171493:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134275968:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11906us (12315us total) trans 30064771494 rc 0/0 00000100:00100000:0.0:1787827019.171508:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 489 00002000:00100000:0.0:1787827019.171532:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (817889280->822083583) req@ffff8d547fbed2c0 x1874672134275968/t30064771494(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/448 e 0 to 0 dl 1787827030 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827019.171543:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbed2c0 with x1874672134275968 ext(817889280->822083583) 00002000:00010000:0.0:1787827019.171549:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbed2c0 00000100:00100000:1.0:1787827019.364408:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827019.364475:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276096 00000100:00100000:2.0:1787827019.364499:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276096 00002000:00100000:2.0:1787827019.364543:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (822083584->826277887) req@ffff8d547fbe8780 x1874672134276096/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/0 e 0 to 0 dl 1787827030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827019.364555:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8780 with x1874672134276096 ext(822083584->826277887) 00002000:00010000:2.0:1787827019.364561:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8780 00000100:00100000:2.0:1787827019.364588:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 490 00000100:00100000:2.0:1787827019.364599:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134276096:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827019.376093:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134276096:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11486us (11681us total) trans 30064771495 rc 0/0 00000100:00100000:3.0:1787827019.376112:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 490 00002000:00100000:3.0:1787827019.376146:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (822083584->826277887) req@ffff8d547fbe8780 x1874672134276096/t30064771495(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/448 e 0 to 0 dl 1787827030 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827019.376156:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8780 with x1874672134276096 ext(822083584->826277887) 00002000:00010000:3.0:1787827019.376162:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8780 00000100:00100000:1.0:1787827019.565321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827019.565393:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276224 00000100:00100000:2.0:1787827019.565402:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276224 00002000:00100000:2.0:1787827019.565449:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (826277888->830472191) req@ffff8d547fbe9680 x1874672134276224/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/0 e 0 to 0 dl 1787827030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827019.565460:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9680 with x1874672134276224 ext(826277888->830472191) 00002000:00010000:2.0:1787827019.565465:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9680 00000100:00100000:2.0:1787827019.565493:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 491 00000100:00100000:2.0:1787827019.565503:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134276224:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827019.577205:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2390:x1874672134276224:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11697us (11886us total) trans 30064771496 rc 0/0 00000100:00100000:1.0:1787827019.577243:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 491 00002000:00100000:1.0:1787827019.577256:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (826277888->830472191) req@ffff8d547fbe9680 x1874672134276224/t30064771496(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/448 e 0 to 0 dl 1787827030 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827019.577267:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe9680 with x1874672134276224 ext(826277888->830472191) 00002000:00010000:1.0:1787827019.577272:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe9680 00000100:00100000:2.0:1787827019.779118:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827019.779176:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276352 00000100:00100000:3.0:1787827019.779185:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276352 00002000:00100000:3.0:1787827019.779269:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (830472192->834666495) req@ffff8d53492c7c00 x1874672134276352/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/0 e 0 to 0 dl 1787827030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827019.779277:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7c00 with x1874672134276352 ext(830472192->834666495) 00002000:00010000:3.0:1787827019.779281:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7c00 00000100:00100000:3.0:1787827019.779303:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 492 00000100:00100000:3.0:1787827019.779310:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2391:x1874672134276352:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827019.790625:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2391:x1874672134276352:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11304us (11501us total) trans 30064771497 rc 0/0 00000100:00100000:3.0:1787827019.790640:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 492 00002000:00100000:3.0:1787827019.790652:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (830472192->834666495) req@ffff8d53492c7c00 x1874672134276352/t30064771497(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/448 e 0 to 0 dl 1787827030 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827019.790664:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492c7c00 with x1874672134276352 ext(830472192->834666495) 00002000:00010000:3.0:1787827019.790669:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492c7c00 00000100:00100000:0.0:1787827019.977981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827019.978087:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276480 00000100:00100000:3.0:1787827019.978097:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276480 00002000:00100000:3.0:1787827019.978149:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (834666496->838860799) req@ffff8d547fbef480 x1874672134276480/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/0 e 0 to 0 dl 1787827030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827019.978159:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef480 with x1874672134276480 ext(834666496->838860799) 00002000:00010000:3.0:1787827019.978176:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef480 00000100:00100000:3.0:1787827019.978328:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 493 00000100:00100000:3.0:1787827019.978340:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134276480:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:2.0:1787827019.986305:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827019.992405:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134276480:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14058us (14424us total) trans 30064771498 rc 0/0 00000100:00100000:3.0:1787827019.992421:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 493 00002000:00100000:3.0:1787827019.992434:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (834666496->838860799) req@ffff8d547fbef480 x1874672134276480/t30064771498(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:620/0 lens 488/448 e 0 to 0 dl 1787827030 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827019.992444:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbef480 with x1874672134276480 ext(834666496->838860799) 00002000:00010000:3.0:1787827019.992450:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbef480 00000100:00100000:0.0:1787827020.201503:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827020.201567:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276608 00000100:00100000:1.0:1787827020.201576:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276608 00002000:00100000:1.0:1787827020.201627:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (838860800->843055103) req@ffff8d547fbecb40 x1874672134276608/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/0 e 0 to 0 dl 1787827031 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827020.201643:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbecb40 with x1874672134276608 ext(838860800->843055103) 00002000:00010000:1.0:1787827020.201649:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbecb40 00000100:00100000:1.0:1787827020.201681:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 494 00000100:00100000:1.0:1787827020.201692:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134276608:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827020.215038:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2393:x1874672134276608:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13339us (13533us total) trans 30064771499 rc 0/0 00000100:00100000:3.0:1787827020.215053:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 494 00002000:00100000:3.0:1787827020.215065:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (838860800->843055103) req@ffff8d547fbecb40 x1874672134276608/t30064771499(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/448 e 0 to 0 dl 1787827031 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827020.215075:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbecb40 with x1874672134276608 ext(838860800->843055103) 00002000:00010000:3.0:1787827020.215081:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbecb40 00000100:00100000:0.0:1787827020.369402:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143778176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827020.369411:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143778048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827020.369474:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827020.369513:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778048 00000100:00100000:0.0:1787827020.369517:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827020.369532:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778048 00000100:00080000:2.0:1787827020.369568:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827020.369571:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778176 00000100:00100000:3.0:1787827020.369577:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778176 00000100:00100000:1.0:1787827020.369586:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787827020.369598:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143778048:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787827020.369603:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787827020.369619:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2535424 granted 559175104 pending 71720960 free 2849767424 avail 2618245120 00000100:00100000:3.0:1787827020.369622:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787827020.369634:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143778176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787827020.369648:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2535424 granted 559175104 pending 71720960 free 2849767424 avail 2618245120 00000100:00100000:1.0:1787827020.369677:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143778048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827020.369685:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787827020.369696:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143778176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827020.369711:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787827020.369783:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143778048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827020.369800:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143778176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827020.418077:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827020.418143:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276736 00000100:00100000:1.0:1787827020.418151:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276736 00002000:00100000:1.0:1787827020.418187:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (843055104->847249407) req@ffff8d547fbec000 x1874672134276736/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/0 e 0 to 0 dl 1787827031 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827020.418194:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbec000 with x1874672134276736 ext(843055104->847249407) 00002000:00010000:1.0:1787827020.418198:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbec000 00000100:00100000:1.0:1787827020.418237:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 495 00000100:00100000:1.0:1787827020.418244:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134276736:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827020.431365:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2392:x1874672134276736:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13110us (13285us total) trans 30064771500 rc 0/0 00000100:00100000:1.0:1787827020.431378:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 495 00002000:00100000:1.0:1787827020.431390:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (843055104->847249407) req@ffff8d547fbec000 x1874672134276736/t30064771500(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/448 e 0 to 0 dl 1787827031 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827020.431401:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbec000 with x1874672134276736 ext(843055104->847249407) 00002000:00010000:1.0:1787827020.431406:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbec000 00000100:00100000:0.0:1787827020.642335:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827020.642472:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276864 00000100:00100000:1.0:1787827020.642483:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276864 00002000:00100000:1.0:1787827020.642531:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (847249408->851443711) req@ffff8d547fbeda40 x1874672134276864/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/0 e 0 to 0 dl 1787827031 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827020.642553:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbeda40 with x1874672134276864 ext(847249408->851443711) 00002000:00010000:1.0:1787827020.642559:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbeda40 00000100:00100000:1.0:1787827020.642592:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 496 00000100:00100000:1.0:1787827020.642601:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134276864:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827020.654745:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134276864:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12136us (12408us total) trans 30064771501 rc 0/0 00000100:00100000:2.0:1787827020.654769:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 496 00002000:00100000:2.0:1787827020.654782:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (847249408->851443711) req@ffff8d547fbeda40 x1874672134276864/t30064771501(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/448 e 0 to 0 dl 1787827031 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827020.654793:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbeda40 with x1874672134276864 ext(847249408->851443711) 00002000:00010000:2.0:1787827020.654799:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbeda40 00000100:00100000:1.0:1787827020.862167:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827020.862249:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134276992 00000100:00100000:0.0:1787827020.862259:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134276992 00002000:00100000:0.0:1787827020.862305:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (851443712->855638015) req@ffff8d547fbe83c0 x1874672134276992/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/0 e 0 to 0 dl 1787827031 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827020.862316:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe83c0 with x1874672134276992 ext(851443712->855638015) 00002000:00010000:0.0:1787827020.862321:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe83c0 00000100:00100000:0.0:1787827020.862363:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 497 00000100:00100000:0.0:1787827020.862374:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2390:x1874672134276992:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827020.873497:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2390:x1874672134276992:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11115us (11326us total) trans 30064771502 rc 0/0 00000100:00100000:0.0:1787827020.873511:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 497 00002000:00100000:0.0:1787827020.873523:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (851443712->855638015) req@ffff8d547fbe83c0 x1874672134276992/t30064771502(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:621/0 lens 488/448 e 0 to 0 dl 1787827031 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827020.873547:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe83c0 with x1874672134276992 ext(851443712->855638015) 00002000:00010000:0.0:1787827020.873553:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe83c0 00010000:00010000:0.0:1787827021.009377:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827021.072353:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827021.072452:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134277120 00000100:00100000:3.0:1787827021.072460:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134277120 00002000:00100000:3.0:1787827021.072525:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (855638016->859832319) req@ffff8d547fbea940 x1874672134277120/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/0 e 0 to 0 dl 1787827032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827021.072539:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbea940 with x1874672134277120 ext(855638016->859832319) 00002000:00010000:3.0:1787827021.072545:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbea940 00000100:00100000:3.0:1787827021.072580:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 498 00000100:00080000:2.0:1787827021.072581:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827021.072590:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2391:x1874672134277120:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827021.084064:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2391:x1874672134277120:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11469us (11713us total) trans 30064771503 rc 0/0 00000100:00100000:3.0:1787827021.084074:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 498 00002000:00100000:3.0:1787827021.084084:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (855638016->859832319) req@ffff8d547fbea940 x1874672134277120/t30064771503(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/448 e 0 to 0 dl 1787827032 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827021.084090:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbea940 with x1874672134277120 ext(855638016->859832319) 00002000:00010000:3.0:1787827021.084095:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbea940 00000100:00100000:0.0:1787827021.306586:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827021.306655:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134277248 00000100:00100000:2.0:1787827021.306666:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134277248 00002000:00100000:2.0:1787827021.306713:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (859832320->864026623) req@ffff8d547fbee1c0 x1874672134277248/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/0 e 0 to 0 dl 1787827032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827021.306725:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee1c0 with x1874672134277248 ext(859832320->864026623) 00002000:00010000:2.0:1787827021.306730:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee1c0 00000100:00100000:2.0:1787827021.306763:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 499 00000100:00100000:2.0:1787827021.306774:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134277248:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827021.320149:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134277248:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13367us (13562us total) trans 30064771504 rc 0/0 00000100:00100000:3.0:1787827021.320162:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 499 00002000:00100000:3.0:1787827021.320174:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (859832320->864026623) req@ffff8d547fbee1c0 x1874672134277248/t30064771504(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/448 e 0 to 0 dl 1787827032 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827021.320185:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbee1c0 with x1874672134277248 ext(859832320->864026623) 00002000:00010000:3.0:1787827021.320190:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbee1c0 00000100:00100000:1.0:1787827021.534319:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827021.534407:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134277376 00000100:00100000:3.0:1787827021.534417:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134277376 00002000:00100000:3.0:1787827021.534462:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (864026624->868220927) req@ffff8d547fbe8f00 x1874672134277376/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/0 e 0 to 0 dl 1787827032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827021.534472:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8f00 with x1874672134277376 ext(864026624->868220927) 00002000:00010000:3.0:1787827021.534478:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8f00 00000100:00100000:3.0:1787827021.534504:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 500 00000100:00100000:3.0:1787827021.534510:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134277376:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827021.548113:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134277376:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13592us (13805us total) trans 30064771505 rc 0/0 00000100:00100000:2.0:1787827021.548140:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 500 00002000:00100000:2.0:1787827021.548154:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (864026624->868220927) req@ffff8d547fbe8f00 x1874672134277376/t30064771505(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/448 e 0 to 0 dl 1787827032 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827021.548164:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8f00 with x1874672134277376 ext(864026624->868220927) 00002000:00010000:2.0:1787827021.548171:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8f00 00000100:00100000:2.0:1787827021.758358:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827021.758416:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134277504 00000100:00100000:3.0:1787827021.758425:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134277504 00002000:00100000:3.0:1787827021.758469:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (868220928->872415231) req@ffff8d5347a31e00 x1874672134277504/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/0 e 0 to 0 dl 1787827032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827021.758479:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a31e00 with x1874672134277504 ext(868220928->872415231) 00002000:00010000:3.0:1787827021.758484:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a31e00 00000100:00100000:3.0:1787827021.758517:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 501 00000100:00100000:3.0:1787827021.758527:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134277504:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827021.770957:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2392:x1874672134277504:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12423us (12597us total) trans 30064771506 rc 0/0 00000100:00100000:2.0:1787827021.770979:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 501 00002000:00100000:2.0:1787827021.770993:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (868220928->872415231) req@ffff8d5347a31e00 x1874672134277504/t30064771506(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/448 e 0 to 0 dl 1787827032 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827021.771005:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5347a31e00 with x1874672134277504 ext(868220928->872415231) 00002000:00010000:2.0:1787827021.771011:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5347a31e00 00000001:00080000:1.0:1787827021.771723:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771506 is committed 00000100:00100000:2.0:1787827021.976908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827021.977173:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134277632 00000100:00100000:1.0:1787827021.977183:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134277632 00002000:00100000:1.0:1787827021.977257:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (872415232->876609535) req@ffff8d53492bcb40 x1874672134277632/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/0 e 0 to 0 dl 1787827032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827021.977270:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bcb40 with x1874672134277632 ext(872415232->876609535) 00002000:00010000:1.0:1787827021.977277:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bcb40 00000100:00100000:1.0:1787827021.977306:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 502 00000100:00100000:1.0:1787827021.977320:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134277632:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827021.996290:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134277632:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 18965us (19382us total) trans 30064771507 rc 0/0 00000100:00100000:2.0:1787827021.996303:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 502 00002000:00100000:2.0:1787827021.996315:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (872415232->876609535) req@ffff8d53492bcb40 x1874672134277632/t30064771507(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:622/0 lens 488/448 e 0 to 0 dl 1787827032 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827021.996327:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bcb40 with x1874672134277632 ext(872415232->876609535) 00002000:00010000:2.0:1787827021.996333:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bcb40 00010000:00010000:2.0:1787827022.033357:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827022.191319:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827022.191384:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134277760 00000100:00100000:1.0:1787827022.191393:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134277760 00002000:00100000:1.0:1787827022.191437:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (876609536->880803839) req@ffff8d53492bf0c0 x1874672134277760/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/0 e 0 to 0 dl 1787827033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827022.191449:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bf0c0 with x1874672134277760 ext(876609536->880803839) 00002000:00010000:1.0:1787827022.191454:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bf0c0 00000100:00100000:1.0:1787827022.191482:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 503 00000100:00100000:1.0:1787827022.191501:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134277760:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827022.207756:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134277760:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16241us (16427us total) trans 30064771508 rc 0/0 00000100:00100000:1.0:1787827022.207776:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 503 00002000:00100000:1.0:1787827022.207793:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (876609536->880803839) req@ffff8d53492bf0c0 x1874672134277760/t30064771508(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/448 e 0 to 0 dl 1787827033 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827022.207805:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bf0c0 with x1874672134277760 ext(876609536->880803839) 00002000:00010000:1.0:1787827022.207812:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bf0c0 00000100:00100000:2.0:1787827022.225146:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827022.225179:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827022.225212:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278144 00000100:00100000:2.0:1787827022.225250:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827022.225262:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278016 00000100:00100000:1.0:1787827022.225263:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278144 00000100:00100000:3.0:1787827022.225270:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278016 00000100:00100000:2.0:1787827022.225278:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134277888 00000100:00100000:2.0:1787827022.225284:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134277888 00000100:00100000:3.0:1787827022.225352:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 432 00000100:00100000:2.0:1787827022.225356:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 531 00000100:00100000:1.0:1787827022.225362:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 433 00000100:00100000:3.0:1787827022.225366:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134278016:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827022.225381:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134278144:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827022.225388:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134277888:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827022.225471:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134278144:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 98us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827022.225483:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134277888:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827022.225483:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134278016:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827022.225484:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 433 00000100:00100000:3.0:1787827022.225500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 432 00000100:00080000:3.0:1787827022.225528:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827022.225531:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 531 00000100:00080000:3.0:1787827022.225542:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827022.418051:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827022.418144:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278272 00000100:00100000:2.0:1787827022.418159:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278272 00002000:00100000:2.0:1787827022.418248:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (880803840->884998143) req@ffff8d53477dc3c0 x1874672134278272/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/0 e 0 to 0 dl 1787827033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827022.418261:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc3c0 with x1874672134278272 ext(880803840->884998143) 00002000:00010000:2.0:1787827022.418268:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc3c0 00000100:00100000:2.0:1787827022.418308:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 504 00000100:00100000:2.0:1787827022.418325:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134278272:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827022.433530:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134278272:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15190us (15475us total) trans 30064771509 rc 0/0 00000100:00100000:2.0:1787827022.433557:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 504 00002000:00100000:2.0:1787827022.433576:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (880803840->884998143) req@ffff8d53477dc3c0 x1874672134278272/t30064771509(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/448 e 0 to 0 dl 1787827033 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827022.433589:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc3c0 with x1874672134278272 ext(880803840->884998143) 00002000:00010000:2.0:1787827022.433596:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc3c0 00000100:00100000:3.0:1787827022.636270:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827022.636388:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278400 00000100:00100000:0.0:1787827022.636397:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278400 00002000:00100000:0.0:1787827022.636440:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (884998144->889192447) req@ffff8d547fbe0b40 x1874672134278400/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/0 e 0 to 0 dl 1787827033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827022.636451:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe0b40 with x1874672134278400 ext(884998144->889192447) 00002000:00010000:0.0:1787827022.636456:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe0b40 00000100:00100000:0.0:1787827022.636487:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 505 00000100:00100000:0.0:1787827022.636496:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134278400:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827022.654178:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134278400:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17674us (17909us total) trans 30064771510 rc 0/0 00000100:00100000:1.0:1787827022.654191:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 505 00002000:00100000:1.0:1787827022.654202:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (884998144->889192447) req@ffff8d547fbe0b40 x1874672134278400/t30064771510(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/448 e 0 to 0 dl 1787827033 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827022.654209:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe0b40 with x1874672134278400 ext(884998144->889192447) 00002000:00010000:1.0:1787827022.654240:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe0b40 00000100:00100000:3.0:1787827022.849915:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827022.849999:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278528 00000100:00100000:2.0:1787827022.850007:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278528 00002000:00100000:2.0:1787827022.850047:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (889192448->893386751) req@ffff8d547fbe30c0 x1874672134278528/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/0 e 0 to 0 dl 1787827033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827022.850055:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe30c0 with x1874672134278528 ext(889192448->893386751) 00002000:00010000:2.0:1787827022.850059:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe30c0 00000100:00100000:2.0:1787827022.850084:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 506 00000100:00100000:2.0:1787827022.850119:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134278528:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827022.863773:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134278528:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13660us (13857us total) trans 30064771511 rc 0/0 00000100:00100000:3.0:1787827022.863786:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 506 00002000:00100000:3.0:1787827022.863799:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (889192448->893386751) req@ffff8d547fbe30c0 x1874672134278528/t30064771511(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:623/0 lens 488/448 e 0 to 0 dl 1787827033 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827022.863810:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe30c0 with x1874672134278528 ext(889192448->893386751) 00002000:00010000:3.0:1787827022.863817:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe30c0 00000100:00100000:2.0:1787827022.929361:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143778432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827022.929369:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143778560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827022.929380:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143778304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827022.929444:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827022.929453:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827022.929479:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778432 00000100:00100000:3.0:1787827022.929486:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778432 00000100:00100000:2.0:1787827022.929539:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778304 00000100:00100000:2.0:1787827022.929544:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778304 00000100:00100000:1.0:1787827022.929555:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827022.929561:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787827022.929574:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143778432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827022.929591:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778560 00000100:00100000:2.0:1787827022.929594:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787827022.929596:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778560 00002000:00000024:3.0:1787827022.929602:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827022.929605:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143778304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787827022.929629:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827022.929642:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787827022.929652:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143778560:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827022.929662:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143778432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (218us total) trans 0 rc 0/0 00002000:00000024:1.0:1787827022.929665:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827022.929675:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787827022.929692:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143778304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827022.929699:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1787827022.929701:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827022.929720:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143778560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827022.929728:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:3.0:1787827022.929746:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe1680 x1874672143778432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827022.929759:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143778304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827022.929761:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143778432:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787827022.929778:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dcf00 x1874672143778560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827022.929793:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143778560:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787827023.057404:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827023.081829:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827023.081945:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278656 00000100:00100000:3.0:1787827023.081958:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278656 00000100:00080000:0.0:1787827023.082016:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787827023.082030:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (893386752->897581055) req@ffff8d53477dfc00 x1874672134278656/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/0 e 0 to 0 dl 1787827034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827023.082059:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dfc00 with x1874672134278656 ext(893386752->897581055) 00002000:00010000:3.0:1787827023.082066:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dfc00 00000100:00100000:3.0:1787827023.082100:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 507 00000100:00100000:3.0:1787827023.082121:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134278656:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827023.097196:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134278656:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15078us (15365us total) trans 30064771512 rc 0/0 00000100:00100000:2.0:1787827023.097212:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 507 00002000:00100000:2.0:1787827023.097258:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (893386752->897581055) req@ffff8d53477dfc00 x1874672134278656/t30064771512(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/448 e 0 to 0 dl 1787827034 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827023.097269:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dfc00 with x1874672134278656 ext(893386752->897581055) 00002000:00010000:2.0:1787827023.097276:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dfc00 00000100:00100000:3.0:1787827023.290307:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827023.290377:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278784 00000100:00100000:1.0:1787827023.290390:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278784 00002000:00100000:1.0:1787827023.290439:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (897581056->901775359) req@ffff8d547fbe1680 x1874672134278784/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/0 e 0 to 0 dl 1787827034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827023.290450:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe1680 with x1874672134278784 ext(897581056->901775359) 00002000:00010000:1.0:1787827023.290455:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe1680 00000100:00100000:1.0:1787827023.290488:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 508 00000100:00100000:1.0:1787827023.290497:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134278784:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827023.301942:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134278784:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11436us (11634us total) trans 30064771513 rc 0/0 00000100:00100000:1.0:1787827023.301956:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 508 00002000:00100000:1.0:1787827023.301970:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (897581056->901775359) req@ffff8d547fbe1680 x1874672134278784/t30064771513(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/448 e 0 to 0 dl 1787827034 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827023.301990:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe1680 with x1874672134278784 ext(897581056->901775359) 00002000:00010000:1.0:1787827023.301996:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe1680 00000100:00100000:0.0:1787827023.441464:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143778688:0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.441475:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143778816:0@lo:400:kworker.0 00000100:00100000:2.0:1787827023.441532:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143778944:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.441540:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827023.441548:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827023.441580:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143779072:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.441602:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143779200:0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.441603:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143779328:0@lo:400:kworker.0 00000100:00100000:3.0:1787827023.441623:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827023.441648:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143779584:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.441655:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827023.441660:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827023.441687:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143779712:0@lo:400:kworker.0 00000100:00100000:3.0:1787827023.441688:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827023.441693:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143779840:0@lo:400:kworker.0 00000100:00100000:3.0:1787827023.441715:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143780096:0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.441729:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827023.441741:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827023.441763:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778816 00000100:00100000:3.0:1787827023.441769:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778816 00000100:00100000:1.0:1787827023.441771:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779328 00000100:00100000:0.0:1787827023.441776:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143780224:0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.441776:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779328 00000100:00100000:0.0:1787827023.441818:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827023.441818:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779072 00000100:00100000:3.0:1787827023.441822:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779072 00000100:00100000:1.0:1787827023.441826:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779840 00000100:00100000:1.0:1787827023.441831:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779840 00000100:00100000:1.0:1787827023.441868:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787827023.441877:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778688 00000100:00100000:1.0:1787827023.441880:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143779328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.441883:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778688 00000100:00100000:2.0:1787827023.441889:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827023.441919:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143779456:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.441923:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1787827023.441942:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143778688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.441945:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143779328:12345-0@lo:400:kworker.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827023.441955:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827023.441958:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787827023.441980:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779456 00000100:00100000:1.0:1787827023.441984:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779456 00000100:00100000:2.0:1787827023.441993:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143779968:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.441995:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143778688:12345-0@lo:400:kworker.0 Request processed in 55us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827023.442005:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1787827023.442013:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787827023.442022:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143779840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827023.442031:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827023.442043:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779200 00000100:00100000:0.0:1787827023.442048:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779200 00000100:00100000:1.0:1787827023.442066:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143779840:12345-0@lo:400:kworker.0 Request processed in 45us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827023.442074:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787827023.442082:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143778944 00000100:00100000:0.0:1787827023.442086:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143778944 00000100:00100000:1.0:1787827023.442089:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779968 00000100:00100000:3.0:1787827023.442093:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1787827023.442100:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779968 00000100:00100000:3.0:1787827023.442118:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143778816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.442127:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787827023.442135:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787827023.442137:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143779200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442144:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143779456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827023.442160:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143778816:12345-0@lo:400:kworker.0 Request processed in 57us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827023.442168:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1787827023.442186:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779584 00000100:00100000:3.0:1787827023.442189:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779584 00000100:00100000:0.0:1787827023.442191:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143779200:12345-0@lo:400:kworker.0 Request processed in 55us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827023.442200:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143779456:12345-0@lo:400:kworker.0 Request processed in 56us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827023.442201:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787827023.442206:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143779712 00000100:00100000:3.0:1787827023.442211:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143779712 00000100:00100000:1.0:1787827023.442234:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787827023.442252:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787827023.442255:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780224 00000100:00100000:1.0:1787827023.442257:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787827023.442261:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780224 00000100:00100000:0.0:1787827023.442263:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143778944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442270:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143779968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827023.442291:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1787827023.442301:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143779072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442318:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143779968:12345-0@lo:400:kworker.0 Request processed in 52us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827023.442321:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143778944:12345-0@lo:400:kworker.0 Request processed in 60us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827023.442331:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787827023.442334:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787827023.442340:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143779072:12345-0@lo:400:kworker.0 Request processed in 39us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827023.442348:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00080000:1.0:1787827023.442353:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827023.442360:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827023.442365:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827023.442367:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1787827023.442376:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1787827023.442381:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143779584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442385:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1787827023.442389:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143779712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442399:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143780224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.442432:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143779584:12345-0@lo:400:kworker.0 Request processed in 56us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827023.442439:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1787827023.442444:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143779712:12345-0@lo:400:kworker.0 Request processed in 56us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827023.442451:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143780224:12345-0@lo:400:kworker.0 Request processed in 55us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827023.442456:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1787827023.442463:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1787827023.442490:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143779200:0@lo:400:kworker.0 00000100:00100000:3.0:1787827023.442495:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827023.442518:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143778944:0@lo:400:kworker.0 00010000:00080000:0.0:1787827023.442525:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c7c00 x1874672143779712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787827023.442538:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c5680 x1874672143779456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827023.442540:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143779712:0@lo:400:kworker.0 00000100:00100000:3.0:1787827023.442543:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143779072:0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442559:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143779456:0@lo:400:kworker.0 00010000:00080000:0.0:1787827023.442564:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c4000 x1874672143780224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827023.442568:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143779584:0@lo:400:kworker.0 00010000:00080000:1.0:1787827023.442577:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c6580 x1874672143779968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827023.442585:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143780224:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.442603:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143778688:0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442605:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143779968:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.442650:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780096 00000100:00100000:1.0:1787827023.442653:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143779328:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.442656:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780096 00000100:00100000:1.0:1787827023.442662:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143779840:0@lo:400:kworker.0 00000100:00100000:1.0:1787827023.442671:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143778816:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.442702:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1787827023.442711:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143780096:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787827023.442719:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827023.442757:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143780096:12345-0@lo:400:kworker.0 Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827023.442764:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1787827023.442777:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143780096:0@lo:400:kworker.0 00000100:00100000:0.0:1787827023.505480:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827023.505538:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134278912 00000100:00100000:2.0:1787827023.505548:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134278912 00002000:00100000:2.0:1787827023.505601:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (901775360->905969663) req@ffff8d53477dd2c0 x1874672134278912/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/0 e 0 to 0 dl 1787827034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827023.505613:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dd2c0 with x1874672134278912 ext(901775360->905969663) 00002000:00010000:2.0:1787827023.505618:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dd2c0 00000100:00100000:2.0:1787827023.505653:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 509 00000100:00100000:2.0:1787827023.505663:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134278912:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827023.522935:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134278912:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17263us (17452us total) trans 30064771514 rc 0/0 00000100:00100000:2.0:1787827023.522950:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 509 00002000:00100000:2.0:1787827023.522964:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (901775360->905969663) req@ffff8d53477dd2c0 x1874672134278912/t30064771514(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/448 e 0 to 0 dl 1787827034 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827023.522976:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dd2c0 with x1874672134278912 ext(901775360->905969663) 00002000:00010000:2.0:1787827023.522982:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dd2c0 00000100:00100000:1.0:1787827023.729405:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827023.729476:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279040 00000100:00100000:2.0:1787827023.729485:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279040 00002000:00100000:2.0:1787827023.729535:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (905969664->910163967) req@ffff8d547fb470c0 x1874672134279040/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/0 e 0 to 0 dl 1787827034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827023.729560:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb470c0 with x1874672134279040 ext(905969664->910163967) 00002000:00010000:2.0:1787827023.729577:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb470c0 00000100:00100000:2.0:1787827023.729609:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 510 00000100:00100000:2.0:1787827023.729649:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134279040:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827023.741407:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134279040:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11752us (12000us total) trans 30064771515 rc 0/0 00000100:00100000:2.0:1787827023.741421:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 510 00002000:00100000:2.0:1787827023.741434:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (905969664->910163967) req@ffff8d547fb470c0 x1874672134279040/t30064771515(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/448 e 0 to 0 dl 1787827034 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827023.741446:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb470c0 with x1874672134279040 ext(905969664->910163967) 00002000:00010000:2.0:1787827023.741452:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb470c0 00000100:00100000:1.0:1787827023.940256:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827023.940372:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279168 00000100:00100000:0.0:1787827023.940387:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279168 00002000:00100000:0.0:1787827023.940447:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (910163968->914358271) req@ffff8d547fb45a40 x1874672134279168/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/0 e 0 to 0 dl 1787827034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827023.940457:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb45a40 with x1874672134279168 ext(910163968->914358271) 00002000:00010000:0.0:1787827023.940462:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb45a40 00000100:00100000:0.0:1787827023.940497:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 511 00000100:00100000:0.0:1787827023.940505:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2392:x1874672134279168:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827023.951432:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2392:x1874672134279168:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10916us (11172us total) trans 30064771516 rc 0/0 00000100:00100000:2.0:1787827023.951447:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 511 00002000:00100000:2.0:1787827023.951465:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (910163968->914358271) req@ffff8d547fb45a40 x1874672134279168/t30064771516(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:624/0 lens 488/448 e 0 to 0 dl 1787827034 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827023.951477:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb45a40 with x1874672134279168 ext(910163968->914358271) 00002000:00010000:2.0:1787827023.951483:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb45a40 00000100:00100000:2.0:1787827023.953397:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787827023.953417:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143780352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827023.953474:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827023.953527:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780352 00000100:00100000:0.0:1787827023.953535:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780352 00000100:00100000:0.0:1787827023.953579:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787827023.953589:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143780352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827023.953618:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827023.953665:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143780352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827023.953671:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787827023.953718:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143780352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827024.081342:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827024.149521:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827024.149578:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279296 00000100:00100000:2.0:1787827024.149587:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279296 00002000:00100000:2.0:1787827024.149632:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (914358272->918552575) req@ffff8d547fb46d00 x1874672134279296/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/0 e 0 to 0 dl 1787827035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827024.149655:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb46d00 with x1874672134279296 ext(914358272->918552575) 00002000:00010000:2.0:1787827024.149660:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb46d00 00000100:00100000:2.0:1787827024.149685:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 512 00000100:00100000:2.0:1787827024.149692:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2390:x1874672134279296:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827024.162489:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2390:x1874672134279296:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12787us (12967us total) trans 30064771517 rc 0/0 00000100:00100000:2.0:1787827024.162503:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 512 00002000:00100000:2.0:1787827024.162516:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (914358272->918552575) req@ffff8d547fb46d00 x1874672134279296/t30064771517(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/448 e 0 to 0 dl 1787827035 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827024.162525:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb46d00 with x1874672134279296 ext(914358272->918552575) 00002000:00010000:2.0:1787827024.162531:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb46d00 00000100:00100000:0.0:1787827024.354180:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827024.354250:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279424 00000100:00100000:1.0:1787827024.354258:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279424 00002000:00100000:1.0:1787827024.354301:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (918552576->922746879) req@ffff8d53477dc780 x1874672134279424/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/0 e 0 to 0 dl 1787827035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827024.354313:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc780 with x1874672134279424 ext(918552576->922746879) 00002000:00010000:1.0:1787827024.354319:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc780 00000100:00100000:1.0:1787827024.354343:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 513 00000100:00100000:1.0:1787827024.354357:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134279424:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827024.365471:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134279424:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11105us (11284us total) trans 30064771518 rc 0/0 00000100:00100000:2.0:1787827024.365486:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 513 00002000:00100000:2.0:1787827024.365499:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (918552576->922746879) req@ffff8d53477dc780 x1874672134279424/t30064771518(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/448 e 0 to 0 dl 1787827035 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827024.365509:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dc780 with x1874672134279424 ext(918552576->922746879) 00002000:00010000:2.0:1787827024.365516:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dc780 00000100:00100000:1.0:1787827024.550071:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827024.550137:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279552 00000100:00100000:3.0:1787827024.550146:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279552 00002000:00100000:3.0:1787827024.550193:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (922746880->926941183) req@ffff8d547fb44780 x1874672134279552/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/0 e 0 to 0 dl 1787827035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827024.550202:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44780 with x1874672134279552 ext(922746880->926941183) 00002000:00010000:3.0:1787827024.550207:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44780 00000100:00100000:3.0:1787827024.550258:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 514 00000100:00100000:3.0:1787827024.550265:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134279552:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827024.560929:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134279552:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10657us (10860us total) trans 30064771519 rc 0/0 00000100:00100000:2.0:1787827024.560944:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 514 00002000:00100000:2.0:1787827024.560954:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (922746880->926941183) req@ffff8d547fb44780 x1874672134279552/t30064771519(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/448 e 0 to 0 dl 1787827035 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827024.560969:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fb44780 with x1874672134279552 ext(922746880->926941183) 00002000:00010000:2.0:1787827024.560974:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fb44780 00000100:00100000:3.0:1787827024.760362:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827024.760484:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279680 00000100:00100000:2.0:1787827024.760494:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279680 00002000:00100000:2.0:1787827024.760536:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (926941184->931135487) req@ffff8d547f9c61c0 x1874672134279680/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/0 e 0 to 0 dl 1787827035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827024.760547:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c61c0 with x1874672134279680 ext(926941184->931135487) 00002000:00010000:2.0:1787827024.760551:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c61c0 00000100:00100000:2.0:1787827024.760585:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 515 00000100:00100000:2.0:1787827024.760594:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2390:x1874672134279680:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827024.773894:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2390:x1874672134279680:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13293us (13533us total) trans 30064771520 rc 0/0 00000100:00100000:2.0:1787827024.773908:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 515 00002000:00100000:2.0:1787827024.773921:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (926941184->931135487) req@ffff8d547f9c61c0 x1874672134279680/t30064771520(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/448 e 0 to 0 dl 1787827035 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827024.773932:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c61c0 with x1874672134279680 ext(926941184->931135487) 00002000:00010000:2.0:1787827024.773938:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c61c0 00000100:00100000:3.0:1787827024.961845:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827024.961907:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279808 00000100:00100000:1.0:1787827024.961918:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279808 00002000:00100000:1.0:1787827024.961976:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (931135488->935329791) req@ffff8d547f9c7840 x1874672134279808/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/0 e 0 to 0 dl 1787827035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827024.961988:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7840 with x1874672134279808 ext(931135488->935329791) 00002000:00010000:1.0:1787827024.961994:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7840 00000100:00100000:1.0:1787827024.962034:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 516 00000100:00100000:1.0:1787827024.962044:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2391:x1874672134279808:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827024.974200:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2391:x1874672134279808:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12147us (12355us total) trans 30064771521 rc 0/0 00000100:00100000:1.0:1787827024.974212:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 516 00002000:00100000:1.0:1787827024.974248:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (931135488->935329791) req@ffff8d547f9c7840 x1874672134279808/t30064771521(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:625/0 lens 488/448 e 0 to 0 dl 1787827035 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827024.974258:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7840 with x1874672134279808 ext(931135488->935329791) 00002000:00010000:1.0:1787827024.974264:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7840 00010000:00010000:0.0:1787827025.105614:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827025.180184:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827025.180261:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134279936 00000100:00100000:2.0:1787827025.180273:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134279936 00002000:00100000:2.0:1787827025.180328:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (935329792->939524095) req@ffff8d53477df840 x1874672134279936/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/0 e 0 to 0 dl 1787827036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827025.180339:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df840 with x1874672134279936 ext(935329792->939524095) 00002000:00010000:2.0:1787827025.180345:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df840 00000100:00100000:2.0:1787827025.180390:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 517 00000100:00100000:2.0:1787827025.180402:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134279936:12345-192.168.203.6@tcp:4:iozone.0 00000100:00080000:3.0:1787827025.180521:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827025.195676:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2393:x1874672134279936:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15266us (15496us total) trans 30064771522 rc 0/0 00000100:00100000:1.0:1787827025.195689:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 517 00002000:00100000:1.0:1787827025.195700:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (935329792->939524095) req@ffff8d53477df840 x1874672134279936/t30064771522(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/448 e 0 to 0 dl 1787827036 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827025.195708:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477df840 with x1874672134279936 ext(935329792->939524095) 00002000:00010000:1.0:1787827025.195712:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477df840 00000100:00100000:0.0:1787827025.403052:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827025.403127:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280064 00000100:00100000:2.0:1787827025.403137:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280064 00002000:00100000:2.0:1787827025.403184:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (939524096->943718399) req@ffff8d53477dcf00 x1874672134280064/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/0 e 0 to 0 dl 1787827036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827025.403194:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dcf00 with x1874672134280064 ext(939524096->943718399) 00002000:00010000:2.0:1787827025.403200:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dcf00 00000100:00100000:3.0:1787827025.403260:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 518 00000100:00100000:3.0:1787827025.403273:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134280064:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827025.418827:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2392:x1874672134280064:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15547us (15774us total) trans 30064771523 rc 0/0 00000100:00100000:2.0:1787827025.418842:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 518 00002000:00100000:2.0:1787827025.418856:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (939524096->943718399) req@ffff8d53477dcf00 x1874672134280064/t30064771523(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/448 e 0 to 0 dl 1787827036 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827025.418867:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53477dcf00 with x1874672134280064 ext(939524096->943718399) 00002000:00010000:2.0:1787827025.418873:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53477dcf00 00000100:00100000:0.0:1787827025.489367:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143780608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827025.489413:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143780480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827025.489443:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827025.489489:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780608 00000100:00100000:3.0:1787827025.489497:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780608 00000100:00100000:2.0:1787827025.489502:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827025.489555:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780480 00000100:00080000:0.0:1787827025.489556:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827025.489560:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780480 00000100:00100000:3.0:1787827025.489568:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787827025.489577:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143780608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827025.489594:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2535424 granted 559175104 pending 71720960 free 2849767424 avail 2618245120 00000100:00080000:2.0:1787827025.489595:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827025.489604:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787827025.489612:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143780480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787827025.489623:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2535424 granted 559175104 pending 71720960 free 2849767424 avail 2618245120 00000100:00100000:3.0:1787827025.489637:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143780608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827025.489643:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787827025.489670:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143780608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827025.489676:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143780480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827025.489698:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787827025.489710:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143780480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827025.613509:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827025.613590:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280192 00000100:00100000:2.0:1787827025.613600:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280192 00002000:00100000:2.0:1787827025.613643:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (943718400->947912703) req@ffff8d547fe28000 x1874672134280192/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/0 e 0 to 0 dl 1787827036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827025.613654:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe28000 with x1874672134280192 ext(943718400->947912703) 00002000:00010000:2.0:1787827025.613660:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe28000 00000100:00100000:2.0:1787827025.613697:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 519 00000100:00100000:2.0:1787827025.613707:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2390:x1874672134280192:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827025.626416:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2390:x1874672134280192:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12702us (12907us total) trans 30064771524 rc 0/0 00000100:00100000:2.0:1787827025.626431:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 519 00002000:00100000:2.0:1787827025.626456:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (943718400->947912703) req@ffff8d547fe28000 x1874672134280192/t30064771524(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/448 e 0 to 0 dl 1787827036 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827025.626468:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe28000 with x1874672134280192 ext(943718400->947912703) 00002000:00010000:2.0:1787827025.626474:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe28000 00000100:00100000:0.0:1787827025.840616:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827025.840683:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280320 00000100:00100000:2.0:1787827025.840690:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280320 00002000:00100000:2.0:1787827025.840729:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (947912704->952107007) req@ffff8d547fe283c0 x1874672134280320/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/0 e 0 to 0 dl 1787827036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827025.840737:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe283c0 with x1874672134280320 ext(947912704->952107007) 00002000:00010000:2.0:1787827025.840741:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe283c0 00000100:00100000:2.0:1787827025.840762:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 520 00000100:00100000:2.0:1787827025.840768:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2391:x1874672134280320:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827025.851731:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2391:x1874672134280320:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10948us (11110us total) trans 30064771525 rc 0/0 00000100:00100000:2.0:1787827025.851742:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 520 00002000:00100000:2.0:1787827025.851753:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (947912704->952107007) req@ffff8d547fe283c0 x1874672134280320/t30064771525(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:626/0 lens 488/448 e 0 to 0 dl 1787827036 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827025.851761:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe283c0 with x1874672134280320 ext(947912704->952107007) 00002000:00010000:2.0:1787827025.851773:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe283c0 00000100:00100000:0.0:1787827026.054586:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827026.054654:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280448 00000100:00100000:1.0:1787827026.054663:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280448 00002000:00100000:1.0:1787827026.054707:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (952107008->956301311) req@ffff8d547fe29680 x1874672134280448/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/0 e 0 to 0 dl 1787827037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827026.054719:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe29680 with x1874672134280448 ext(952107008->956301311) 00002000:00010000:1.0:1787827026.054724:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe29680 00000100:00100000:1.0:1787827026.054756:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 521 00000100:00100000:1.0:1787827026.054776:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134280448:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827026.069595:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2393:x1874672134280448:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14812us (15009us total) trans 30064771526 rc 0/0 00000100:00100000:1.0:1787827026.069610:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 521 00002000:00100000:1.0:1787827026.069623:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (952107008->956301311) req@ffff8d547fe29680 x1874672134280448/t30064771526(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/448 e 0 to 0 dl 1787827037 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827026.069634:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe29680 with x1874672134280448 ext(952107008->956301311) 00002000:00010000:1.0:1787827026.069640:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe29680 00010000:00010000:2.0:1787827026.129408:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827026.278387:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827026.278462:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280576 00000100:00100000:2.0:1787827026.278473:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280576 00002000:00100000:2.0:1787827026.278522:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (956301312->960495615) req@ffff8d547f9c6580 x1874672134280576/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/0 e 0 to 0 dl 1787827037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827026.278534:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6580 with x1874672134280576 ext(956301312->960495615) 00002000:00010000:2.0:1787827026.278539:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6580 00000100:00100000:2.0:1787827026.278581:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 522 00000100:00100000:2.0:1787827026.278590:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134280576:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827026.290815:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134280576:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12216us (12427us total) trans 30064771527 rc 0/0 00000100:00100000:1.0:1787827026.290830:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 522 00002000:00100000:1.0:1787827026.290843:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (956301312->960495615) req@ffff8d547f9c6580 x1874672134280576/t30064771527(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/448 e 0 to 0 dl 1787827037 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827026.290853:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6580 with x1874672134280576 ext(956301312->960495615) 00002000:00010000:1.0:1787827026.290859:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6580 00000100:00100000:3.0:1787827026.496645:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827026.497018:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280704 00000100:00100000:2.0:1787827026.497032:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280704 00002000:00100000:2.0:1787827026.497097:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (960495616->964689919) req@ffff8d547f9c4000 x1874672134280704/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/0 e 0 to 0 dl 1787827037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827026.497110:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c4000 with x1874672134280704 ext(960495616->964689919) 00002000:00010000:2.0:1787827026.497115:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c4000 00000100:00100000:2.0:1787827026.497155:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 523 00000100:00100000:2.0:1787827026.497165:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134280704:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827026.517441:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134280704:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 20268us (20810us total) trans 30064771528 rc 0/0 00000100:00100000:2.0:1787827026.517455:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 523 00002000:00100000:2.0:1787827026.517470:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (960495616->964689919) req@ffff8d547f9c4000 x1874672134280704/t30064771528(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/448 e 0 to 0 dl 1787827037 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827026.517482:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c4000 with x1874672134280704 ext(960495616->964689919) 00002000:00010000:2.0:1787827026.517498:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c4000 00000100:00100000:0.0:1787827026.735411:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827026.735520:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280832 00000100:00100000:1.0:1787827026.735529:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280832 00002000:00100000:1.0:1787827026.735573:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (964689920->968884223) req@ffff8d547fe2bc00 x1874672134280832/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/0 e 0 to 0 dl 1787827037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827026.735584:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2bc00 with x1874672134280832 ext(964689920->968884223) 00002000:00010000:1.0:1787827026.735589:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2bc00 00000100:00100000:1.0:1787827026.735617:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 524 00000100:00100000:1.0:1787827026.735689:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2392:x1874672134280832:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827026.751708:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2392:x1874672134280832:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16072us (16295us total) trans 30064771529 rc 0/0 00000100:00100000:1.0:1787827026.751720:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 524 00002000:00100000:1.0:1787827026.751733:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (964689920->968884223) req@ffff8d547fe2bc00 x1874672134280832/t30064771529(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/448 e 0 to 0 dl 1787827037 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827026.751744:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2bc00 with x1874672134280832 ext(964689920->968884223) 00002000:00010000:1.0:1787827026.751750:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2bc00 00000100:00100000:0.0:1787827026.945052:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827026.945129:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134280960 00000100:00100000:2.0:1787827026.945139:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134280960 00002000:00100000:2.0:1787827026.945184:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (968884224->973078527) req@ffff8d547fe2b840 x1874672134280960/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/0 e 0 to 0 dl 1787827037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827026.945195:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2b840 with x1874672134280960 ext(968884224->973078527) 00002000:00010000:2.0:1787827026.945201:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2b840 00000100:00100000:1.0:1787827026.945295:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 525 00000100:00100000:1.0:1787827026.945311:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+52:2393:x1874672134280960:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827026.957412:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134280960:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12094us (12356us total) trans 30064771530 rc 0/0 00000100:00100000:1.0:1787827026.957434:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 525 00002000:00100000:1.0:1787827026.957447:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (968884224->973078527) req@ffff8d547fe2b840 x1874672134280960/t30064771530(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:627/0 lens 488/448 e 0 to 0 dl 1787827037 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827026.957456:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2b840 with x1874672134280960 ext(968884224->973078527) 00002000:00010000:1.0:1787827026.957470:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2b840 00010000:00010000:2.0:1787827027.153437:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827027.170790:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827027.170876:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281088 00000100:00100000:0.0:1787827027.170888:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281088 00000100:00080000:2.0:1787827027.170938:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1787827027.170960:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (973078528->977272831) req@ffff8d547fe2f0c0 x1874672134281088/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/0 e 0 to 0 dl 1787827038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827027.170970:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2f0c0 with x1874672134281088 ext(973078528->977272831) 00002000:00010000:0.0:1787827027.170990:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2f0c0 00000100:00100000:0.0:1787827027.171025:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 526 00000100:00100000:0.0:1787827027.171036:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2392:x1874672134281088:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827027.187871:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+56:2392:x1874672134281088:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16829us (17090us total) trans 30064771531 rc 0/0 00000100:00100000:1.0:1787827027.187883:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 526 00002000:00100000:1.0:1787827027.187895:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (973078528->977272831) req@ffff8d547fe2f0c0 x1874672134281088/t30064771531(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/448 e 0 to 0 dl 1787827038 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827027.187905:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2f0c0 with x1874672134281088 ext(973078528->977272831) 00002000:00010000:1.0:1787827027.187912:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2f0c0 00000001:00080000:3.0:1787827027.188538:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771531 is committed 00000100:00100000:2.0:1787827027.345114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827027.345166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827027.345192:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281216 00000100:00100000:0.0:1787827027.345202:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281216 00000100:00100000:3.0:1787827027.345249:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281344 00000100:00100000:3.0:1787827027.345253:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281344 00000100:00100000:2.0:1787827027.345263:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00080000:2.0:1787827027.345289:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827027.345317:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281472 00000100:00100000:0.0:1787827027.345322:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 533 00000100:00100000:3.0:1787827027.345323:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281472 00000100:00100000:2.0:1787827027.345332:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 440 00000100:00100000:0.0:1787827027.345339:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134281216:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827027.345348:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134281344:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827027.345359:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 441 00000100:00100000:3.0:1787827027.345368:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134281472:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827027.345429:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134281472:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 63us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827027.345431:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+11:2391:x1874672134281344:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827027.345438:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134281216:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827027.345442:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 441 00000100:00100000:2.0:1787827027.345453:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 440 00000100:00100000:0.0:1787827027.345455:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 533 00000100:00080000:3.0:1787827027.345471:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827027.386066:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827027.386147:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281600 00000100:00100000:2.0:1787827027.386164:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281600 00002000:00100000:2.0:1787827027.386262:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (977272832->981467135) req@ffff8d547fe292c0 x1874672134281600/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/0 e 0 to 0 dl 1787827038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827027.386274:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe292c0 with x1874672134281600 ext(977272832->981467135) 00002000:00010000:2.0:1787827027.386279:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe292c0 00000100:00100000:2.0:1787827027.386312:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 527 00000100:00100000:2.0:1787827027.386340:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134281600:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:3.0:1787827027.400316:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134281600:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13962us (14249us total) trans 30064771532 rc 0/0 00000100:00100000:3.0:1787827027.400345:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 527 00002000:00100000:3.0:1787827027.400358:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (977272832->981467135) req@ffff8d547fe292c0 x1874672134281600/t30064771532(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/448 e 0 to 0 dl 1787827038 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827027.400367:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe292c0 with x1874672134281600 ext(977272832->981467135) 00002000:00010000:3.0:1787827027.400373:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe292c0 00000100:00100000:2.0:1787827027.617868:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827027.617949:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281728 00000100:00100000:1.0:1787827027.617962:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281728 00002000:00100000:1.0:1787827027.618028:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (981467136->985661439) req@ffff8d547fa612c0 x1874672134281728/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/0 e 0 to 0 dl 1787827038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827027.618040:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa612c0 with x1874672134281728 ext(981467136->985661439) 00002000:00010000:1.0:1787827027.618047:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa612c0 00000100:00100000:1.0:1787827027.618092:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 528 00000100:00100000:1.0:1787827027.618104:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134281728:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827027.632922:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134281728:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14807us (15054us total) trans 30064771533 rc 0/0 00000100:00100000:1.0:1787827027.632939:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 528 00002000:00100000:1.0:1787827027.632956:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (981467136->985661439) req@ffff8d547fa612c0 x1874672134281728/t30064771533(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/448 e 0 to 0 dl 1787827038 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827027.632969:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa612c0 with x1874672134281728 ext(981467136->985661439) 00002000:00010000:1.0:1787827027.632978:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa612c0 00000100:00100000:3.0:1787827027.849184:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827027.849291:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281856 00000100:00100000:2.0:1787827027.849305:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281856 00002000:00100000:2.0:1787827027.849360:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (985661440->989855743) req@ffff8d547f9c5680 x1874672134281856/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/0 e 0 to 0 dl 1787827038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827027.849372:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c5680 with x1874672134281856 ext(985661440->989855743) 00002000:00010000:2.0:1787827027.849377:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c5680 00000100:00100000:2.0:1787827027.849423:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 529 00000100:00100000:2.0:1787827027.849434:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134281856:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827027.864979:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134281856:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15538us (15796us total) trans 30064771534 rc 0/0 00000100:00100000:1.0:1787827027.865003:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 529 00002000:00100000:1.0:1787827027.865016:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (985661440->989855743) req@ffff8d547f9c5680 x1874672134281856/t30064771534(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:628/0 lens 488/448 e 0 to 0 dl 1787827038 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827027.865027:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c5680 with x1874672134281856 ext(985661440->989855743) 00002000:00010000:1.0:1787827027.865033:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c5680 00000100:00100000:3.0:1787827028.049449:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787827028.049464:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143780736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827028.049484:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143780864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827028.049545:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827028.049578:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827028.049596:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780736 00000100:00100000:2.0:1787827028.049606:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780736 00000100:00100000:2.0:1787827028.049656:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787827028.049667:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143780736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787827028.049698:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827028.049758:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143780736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827028.049765:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787827028.049807:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780864 00000100:00100000:0.0:1787827028.049808:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827028.049811:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780864 00000100:00100000:0.0:1787827028.049818:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143780992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827028.049855:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787827028.049874:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827028.049926:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143780736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827028.049985:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143780992 00000100:00100000:2.0:1787827028.049990:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143780992 00000100:00100000:3.0:1787827028.050007:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787827028.050025:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143780864:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787827028.050028:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827028.050037:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787827028.050047:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143780992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787827028.050065:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787827028.050066:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827028.050144:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143780864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827028.050157:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00080000:0.0:1787827028.050194:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c7c00 x1874672143780864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827028.050210:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143780992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827028.050242:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143780864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827028.050250:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00010000:00080000:3.0:1787827028.050299:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2a580 x1874672143780992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827028.050321:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143780992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827028.069886:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827028.069948:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134281984 00000100:00100000:1.0:1787827028.069958:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134281984 00002000:00100000:1.0:1787827028.070008:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (989855744->994050047) req@ffff8d547fe2a940 x1874672134281984/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/0 e 0 to 0 dl 1787827039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827028.070018:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2a940 with x1874672134281984 ext(989855744->994050047) 00002000:00010000:1.0:1787827028.070024:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2a940 00000100:00100000:1.0:1787827028.070057:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 530 00000100:00100000:1.0:1787827028.070067:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134281984:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827028.083667:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134281984:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13591us (13778us total) trans 30064771535 rc 0/0 00000100:00100000:1.0:1787827028.083683:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 530 00002000:00100000:1.0:1787827028.083696:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (989855744->994050047) req@ffff8d547fe2a940 x1874672134281984/t30064771535(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/448 e 0 to 0 dl 1787827039 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827028.083707:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe2a940 with x1874672134281984 ext(989855744->994050047) 00002000:00010000:1.0:1787827028.083722:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe2a940 00010000:00010000:2.0:1787827028.177445:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827028.288491:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827028.288653:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134282112 00000100:00100000:2.0:1787827028.288668:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134282112 00002000:00100000:2.0:1787827028.288722:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (994050048->998244351) req@ffff8d547f9c7c00 x1874672134282112/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/0 e 0 to 0 dl 1787827039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827028.288734:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7c00 with x1874672134282112 ext(994050048->998244351) 00002000:00010000:2.0:1787827028.288740:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7c00 00000100:00100000:2.0:1787827028.288769:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 531 00000100:00100000:2.0:1787827028.288779:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2393:x1874672134282112:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:0.0:1787827028.305368:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134282112:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16584us (16879us total) trans 30064771536 rc 0/0 00000100:00100000:0.0:1787827028.305378:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 531 00002000:00100000:0.0:1787827028.305390:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (994050048->998244351) req@ffff8d547f9c7c00 x1874672134282112/t30064771536(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/448 e 0 to 0 dl 1787827039 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827028.305415:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c7c00 with x1874672134282112 ext(994050048->998244351) 00002000:00010000:0.0:1787827028.305421:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c7c00 00000100:00100000:3.0:1787827028.503537:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827028.503688:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134282240 00000100:00100000:2.0:1787827028.503696:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134282240 00002000:00100000:2.0:1787827028.503745:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (998244352->1002438655) req@ffff8d547f9c6940 x1874672134282240/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/0 e 0 to 0 dl 1787827039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827028.503757:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6940 with x1874672134282240 ext(998244352->1002438655) 00002000:00010000:2.0:1787827028.503763:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6940 00000100:00100000:2.0:1787827028.503798:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 532 00000100:00100000:2.0:1787827028.503809:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2392:x1874672134282240:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827028.517819:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2392:x1874672134282240:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14001us (14287us total) trans 30064771537 rc 0/0 00000100:00100000:1.0:1787827028.517842:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 532 00002000:00100000:1.0:1787827028.517861:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (998244352->1002438655) req@ffff8d547f9c6940 x1874672134282240/t30064771537(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/448 e 0 to 0 dl 1787827039 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827028.517872:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c6940 with x1874672134282240 ext(998244352->1002438655) 00002000:00010000:1.0:1787827028.517878:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c6940 00000100:00100000:2.0:1787827028.561416:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143781120:0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.561455:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143781248:0@lo:400:kworker.0 00000100:00100000:0.0:1787827028.561464:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143781376:0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.561483:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827028.561508:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827028.561515:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827028.561551:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143781760:0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.561553:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143781632:0@lo:400:kworker.0 00000100:00100000:0.0:1787827028.561555:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143781888:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.561560:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143781120 00000100:00100000:1.0:1787827028.561568:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143781120 00000100:00100000:2.0:1787827028.561598:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827028.561607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827028.561619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143781248 00000100:00100000:3.0:1787827028.561624:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143781248 00000100:00100000:1.0:1787827028.561628:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1787827028.561630:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143782144:0@lo:400:kworker.0 00000100:00100000:0.0:1787827028.561638:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143782400:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.561644:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143781120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.561668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1787827028.561673:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827028.561678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827028.561682:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143781248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827028.561695:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787827028.561703:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143781504:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.561708:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143781120:12345-0@lo:400:kworker.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827028.561709:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143782656:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.561723:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1787827028.561738:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827028.561739:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143781248:12345-0@lo:400:kworker.0 Request processed in 56us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827028.561749:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1787827028.561767:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827028.561769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782144 00000100:00100000:0.0:1787827028.561770:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143782016:0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.561775:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782144 00000100:00100000:1.0:1787827028.561800:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143781888 00000100:00100000:0.0:1787827028.561805:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827028.561809:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143781120:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.561815:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143781888 00000100:00100000:3.0:1787827028.561816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143781504 00000100:00100000:3.0:1787827028.561822:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143781504 00000100:00100000:0.0:1787827028.561825:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143782528:0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.561847:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782656 00000100:00100000:3.0:1787827028.561851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782656 00000100:00100000:1.0:1787827028.561856:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782400 00000100:00100000:2.0:1787827028.561857:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782016 00000100:00100000:0.0:1787827028.561858:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827028.561863:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782400 00000100:00100000:2.0:1787827028.561863:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782016 00000100:00100000:3.0:1787827028.561876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782528 00000100:00100000:3.0:1787827028.561881:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782528 00000100:00100000:0.0:1787827028.561904:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1787827028.561905:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787827028.561912:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1787827028.561917:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143782144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.561924:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143781504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.561927:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143781888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.561932:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1787827028.561944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143782656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827028.561955:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143782144:12345-0@lo:400:kworker.0 Request processed in 42us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827028.561961:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1787827028.561976:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1787827028.561983:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143782016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.561988:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143781504:12345-0@lo:400:kworker.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827028.561999:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143781888:12345-0@lo:400:kworker.0 Request processed in 68us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827028.561999:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1787827028.562001:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143782656:12345-0@lo:400:kworker.0 Request processed in 57us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827028.562013:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143782016:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827028.562017:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787827028.562018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1787827028.562031:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1787827028.562039:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1787827028.562042:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143782528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.562044:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1787827028.562047:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787827028.562052:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827028.562057:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143782400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.562086:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143782528:12345-0@lo:400:kworker.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827028.562093:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1787827028.562105:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143781504:0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.562116:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827028.562122:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143782016:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.562126:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143782400:12345-0@lo:400:kworker.0 Request processed in 70us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827028.562133:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143781760 00000100:00100000:1.0:1787827028.562137:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787827028.562138:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143781760 00000100:00100000:0.0:1787827028.562139:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143782528:0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.562148:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143782272:0@lo:400:kworker.0 00010000:00080000:0.0:1787827028.562158:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0de00 x1874672143781888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827028.562166:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143781888:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.562179:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00010000:00080000:0.0:1787827028.562182:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0c000 x1874672143782400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827028.562187:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827028.562195:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143781760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827028.562197:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143782400:0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.562199:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143781376 00000100:00100000:2.0:1787827028.562207:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143781376 00000100:00100000:3.0:1787827028.562250:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143781248:0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.562264:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143781632 00000100:00100000:2.0:1787827028.562271:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143781632 00000100:00100000:1.0:1787827028.562272:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143781760:12345-0@lo:400:kworker.0 Request processed in 79us (156us total) trans 0 rc 0/0 00010000:00080000:0.0:1787827028.562277:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0f840 x1874672143782144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827028.562284:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143781760:0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.562287:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787827028.562294:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143782144:0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.562302:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787827028.562310:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782272 00010000:00080000:0.0:1787827028.562312:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0ed00 x1874672143782656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827028.562315:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782272 00000100:00100000:2.0:1787827028.562316:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143781376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827028.562329:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143782656:0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.562336:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787827028.562347:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143781632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827028.562354:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787827028.562365:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143782272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.562376:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143781376:12345-0@lo:400:kworker.0 Request processed in 65us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827028.562392:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143781376:0@lo:400:kworker.0 00000100:00100000:2.0:1787827028.562396:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787827028.562401:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143781632:12345-0@lo:400:kworker.0 Request processed in 54us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827028.562410:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787827028.562421:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143782272:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827028.562430:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787827028.562433:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143781632:0@lo:400:kworker.0 00000100:00080000:2.0:1787827028.562437:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827028.562472:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143782272:0@lo:400:kworker.0 00000100:00100000:3.0:1787827028.716930:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827028.717333:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134282368 00000100:00100000:1.0:1787827028.717347:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134282368 00002000:00100000:1.0:1787827028.717406:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1002438656->1006632959) req@ffff8d53492bd2c0 x1874672134282368/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/0 e 0 to 0 dl 1787827039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827028.717419:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bd2c0 with x1874672134282368 ext(1002438656->1006632959) 00002000:00010000:1.0:1787827028.717425:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bd2c0 00000100:00100000:1.0:1787827028.717464:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 533 00000100:00100000:1.0:1787827028.717475:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2393:x1874672134282368:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827028.733351:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2393:x1874672134282368:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15870us (16422us total) trans 30064771538 rc 0/0 00000100:00100000:1.0:1787827028.733371:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 533 00002000:00100000:1.0:1787827028.733382:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1002438656->1006632959) req@ffff8d53492bd2c0 x1874672134282368/t30064771538(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/448 e 0 to 0 dl 1787827039 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827028.733389:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492bd2c0 with x1874672134282368 ext(1002438656->1006632959) 00002000:00010000:1.0:1787827028.733394:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492bd2c0 00000100:00100000:2.0:1787827028.969311:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827028.969377:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134282496 00000100:00100000:0.0:1787827028.969390:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134282496 00002000:00100000:0.0:1787827028.969475:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1006632960->1010827263) req@ffff8d547fa603c0 x1874672134282496/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/0 e 0 to 0 dl 1787827039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827028.969485:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa603c0 with x1874672134282496 ext(1006632960->1010827263) 00002000:00010000:0.0:1787827028.969492:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa603c0 00000100:00100000:0.0:1787827028.969524:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 534 00000100:00100000:0.0:1787827028.969534:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+20:2392:x1874672134282496:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827028.982715:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2392:x1874672134282496:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13168us (13405us total) trans 30064771539 rc 0/0 00000100:00100000:1.0:1787827028.982729:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 534 00002000:00100000:1.0:1787827028.982742:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1006632960->1010827263) req@ffff8d547fa603c0 x1874672134282496/t30064771539(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:629/0 lens 488/448 e 0 to 0 dl 1787827039 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827028.982752:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa603c0 with x1874672134282496 ext(1006632960->1010827263) 00002000:00010000:1.0:1787827028.982758:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa603c0 00000100:00100000:0.0:1787827029.073399:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827029.073421:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143782784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827029.073494:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827029.073541:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782784 00000100:00100000:2.0:1787827029.073550:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782784 00000100:00100000:2.0:1787827029.073600:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787827029.073611:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143782784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787827029.073644:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787827029.073701:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143782784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827029.073709:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787827029.073749:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143782784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827029.193004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827029.193062:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134282624 00000100:00100000:3.0:1787827029.193081:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134282624 00002000:00100000:3.0:1787827029.193133:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (1010827264->1015021567) req@ffff8d547fa62940 x1874672134282624/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/0 e 0 to 0 dl 1787827040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:2.0:1787827029.193135:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787827029.193145:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62940 with x1874672134282624 ext(1010827264->1015021567) 00002000:00010000:3.0:1787827029.193151:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62940 00000100:00100000:3.0:1787827029.193176:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 535 00000100:00100000:3.0:1787827029.193183:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+22:2393:x1874672134282624:12345-192.168.203.6@tcp:4:iozone.0 00010000:00010000:0.0:1787827029.201336:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827029.204971:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134282624:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11773us (11959us total) trans 30064771540 rc 0/0 00000100:00100000:3.0:1787827029.204985:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 535 00002000:00100000:3.0:1787827029.204998:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (1010827264->1015021567) req@ffff8d547fa62940 x1874672134282624/t30064771540(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/448 e 0 to 0 dl 1787827040 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827029.205008:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62940 with x1874672134282624 ext(1010827264->1015021567) 00002000:00010000:3.0:1787827029.205015:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62940 00000100:00100000:2.0:1787827029.410542:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827029.411073:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134282752 00000100:00100000:1.0:1787827029.411083:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134282752 00002000:00100000:1.0:1787827029.411132:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1015021568->1019215871) req@ffff8d547fa63c00 x1874672134282752/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/0 e 0 to 0 dl 1787827040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827029.411143:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa63c00 with x1874672134282752 ext(1015021568->1019215871) 00002000:00010000:1.0:1787827029.411149:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa63c00 00000100:00100000:1.0:1787827029.411178:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 536 00000100:00100000:1.0:1787827029.411189:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+24:2393:x1874672134282752:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827029.422291:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134282752:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11097us (11752us total) trans 30064771541 rc 0/0 00000100:00100000:1.0:1787827029.422313:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 536 00002000:00100000:1.0:1787827029.422324:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1015021568->1019215871) req@ffff8d547fa63c00 x1874672134282752/t30064771541(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/448 e 0 to 0 dl 1787827040 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827029.422331:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa63c00 with x1874672134282752 ext(1015021568->1019215871) 00002000:00010000:1.0:1787827029.422336:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa63c00 00000100:00100000:2.0:1787827029.633336:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827029.633414:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134282880 00000100:00100000:1.0:1787827029.633422:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134282880 00002000:00100000:1.0:1787827029.633467:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1019215872->1023410175) req@ffff8d547fa61680 x1874672134282880/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/0 e 0 to 0 dl 1787827040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827029.633478:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa61680 with x1874672134282880 ext(1019215872->1023410175) 00002000:00010000:1.0:1787827029.633483:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa61680 00000100:00100000:1.0:1787827029.633518:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 537 00000100:00100000:1.0:1787827029.633531:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+26:2393:x1874672134282880:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827029.646586:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2393:x1874672134282880:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 13043us (13243us total) trans 30064771542 rc 0/0 00000100:00100000:2.0:1787827029.646600:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 537 00002000:00100000:2.0:1787827029.646614:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1019215872->1023410175) req@ffff8d547fa61680 x1874672134282880/t30064771542(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/448 e 0 to 0 dl 1787827040 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827029.646623:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa61680 with x1874672134282880 ext(1019215872->1023410175) 00002000:00010000:2.0:1787827029.646630:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa61680 00000100:00100000:0.0:1787827029.849915:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827029.849976:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283008 00000100:00100000:1.0:1787827029.849986:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283008 00002000:00100000:1.0:1787827029.850035:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1023410176->1027604479) req@ffff8d546f6a0000 x1874672134283008/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/0 e 0 to 0 dl 1787827040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827029.850047:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0000 with x1874672134283008 ext(1023410176->1027604479) 00002000:00010000:1.0:1787827029.850053:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0000 00000100:00100000:1.0:1787827029.850097:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 538 00000100:00100000:1.0:1787827029.850107:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+28:2392:x1874672134283008:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827029.866301:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2392:x1874672134283008:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16090us (16290us total) trans 30064771543 rc 0/0 00000100:00100000:2.0:1787827029.866317:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 538 00002000:00100000:2.0:1787827029.866344:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1023410176->1027604479) req@ffff8d546f6a0000 x1874672134283008/t30064771543(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:630/0 lens 488/448 e 0 to 0 dl 1787827040 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827029.866355:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a0000 with x1874672134283008 ext(1023410176->1027604479) 00002000:00010000:2.0:1787827029.866362:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a0000 00000100:00100000:0.0:1787827030.077929:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827030.077980:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283136 00000100:00100000:2.0:1787827030.077988:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283136 00002000:00100000:2.0:1787827030.078025:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1027604480->1031798783) req@ffff8d546f6a03c0 x1874672134283136/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/0 e 0 to 0 dl 1787827041 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827030.078033:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a03c0 with x1874672134283136 ext(1027604480->1031798783) 00002000:00010000:2.0:1787827030.078037:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a03c0 00000100:00100000:2.0:1787827030.078073:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 539 00000100:00100000:2.0:1787827030.078084:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+30:2393:x1874672134283136:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827030.090258:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2393:x1874672134283136:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12164us (12323us total) trans 30064771544 rc 0/0 00000100:00100000:2.0:1787827030.090272:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 539 00002000:00100000:2.0:1787827030.090293:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1027604480->1031798783) req@ffff8d546f6a03c0 x1874672134283136/t30064771544(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/448 e 0 to 0 dl 1787827041 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827030.090303:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a03c0 with x1874672134283136 ext(1027604480->1031798783) 00002000:00010000:2.0:1787827030.090309:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a03c0 00010000:00010000:2.0:1787827030.225402:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827030.290865:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827030.290931:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283264 00000100:00100000:2.0:1787827030.290952:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283264 00002000:00100000:2.0:1787827030.290999:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (1031798784->1035993087) req@ffff8d546f6a2580 x1874672134283264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/0 e 0 to 0 dl 1787827041 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827030.291029:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a2580 with x1874672134283264 ext(1031798784->1035993087) 00002000:00010000:2.0:1787827030.291034:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a2580 00000100:00100000:2.0:1787827030.291080:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 540 00000100:00100000:2.0:1787827030.291090:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+32:2392:x1874672134283264:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827030.304083:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2392:x1874672134283264:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12985us (13219us total) trans 30064771545 rc 0/0 00000100:00100000:2.0:1787827030.304096:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 540 00002000:00100000:2.0:1787827030.304109:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (1031798784->1035993087) req@ffff8d546f6a2580 x1874672134283264/t30064771545(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/448 e 0 to 0 dl 1787827041 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827030.304121:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a2580 with x1874672134283264 ext(1031798784->1035993087) 00002000:00010000:2.0:1787827030.304127:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a2580 00000100:00100000:0.0:1787827030.502008:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827030.502088:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283392 00000100:00100000:2.0:1787827030.502099:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283392 00002000:00100000:2.0:1787827030.502146:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1035993088->1040187391) req@ffff8d546f6a3480 x1874672134283392/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/0 e 0 to 0 dl 1787827041 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827030.502157:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a3480 with x1874672134283392 ext(1035993088->1040187391) 00002000:00010000:2.0:1787827030.502162:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a3480 00000100:00100000:2.0:1787827030.502197:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 541 00000100:00100000:2.0:1787827030.502207:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+34:2393:x1874672134283392:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827030.514794:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2393:x1874672134283392:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 12578us (12784us total) trans 30064771546 rc 0/0 00000100:00100000:1.0:1787827030.514814:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 541 00002000:00100000:1.0:1787827030.514825:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x11:0x0] (1035993088->1040187391) req@ffff8d546f6a3480 x1874672134283392/t30064771546(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/448 e 0 to 0 dl 1787827041 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827030.514832:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546f6a3480 with x1874672134283392 ext(1035993088->1040187391) 00002000:00010000:1.0:1787827030.514836:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546f6a3480 00000100:00100000:0.0:1787827030.609411:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143782912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827030.609411:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143783040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827030.609483:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827030.609523:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827030.609551:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783040 00000100:00100000:3.0:1787827030.609557:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783040 00000100:00100000:2.0:1787827030.609560:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143782912 00000100:00100000:2.0:1787827030.609567:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143782912 00000100:00080000:1.0:1787827030.609594:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827030.609618:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787827030.609638:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787827030.609643:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143783040:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827030.609651:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143782912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827030.609672:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2535424 granted 550737344 pending 63283200 free 2849767424 avail 2618245120 00002000:00000024:2.0:1787827030.609675:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2535424 granted 550737344 pending 63283200 free 2849767424 avail 2618245120 00000100:00100000:2.0:1787827030.609735:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143782912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827030.609737:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143783040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827030.609748:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787827030.609759:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787827030.609777:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143782912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827030.609810:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143783040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827030.725250:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827030.725292:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283520 00000100:00100000:1.0:1787827030.725299:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283520 00002000:00100000:1.0:1787827030.725338:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1040187392->1044381695) req@ffff8d546e16c780 x1874672134283520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/0 e 0 to 0 dl 1787827041 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827030.725349:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16c780 with x1874672134283520 ext(1040187392->1044381695) 00002000:00010000:1.0:1787827030.725355:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16c780 00000100:00100000:1.0:1787827030.725383:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 542 00000100:00100000:1.0:1787827030.725391:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+36:2392:x1874672134283520:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827030.737270:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2392:x1874672134283520:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11868us (12044us total) trans 30064771547 rc 0/0 00000100:00100000:1.0:1787827030.737281:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 542 00002000:00100000:1.0:1787827030.737291:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (1040187392->1044381695) req@ffff8d546e16c780 x1874672134283520/t30064771547(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/448 e 0 to 0 dl 1787827041 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827030.737311:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16c780 with x1874672134283520 ext(1040187392->1044381695) 00002000:00010000:1.0:1787827030.737315:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16c780 00000100:00100000:3.0:1787827030.925011:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827030.925086:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283648 00000100:00100000:2.0:1787827030.925095:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283648 00002000:00100000:2.0:1787827030.925134:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (1044381696->1048575999) req@ffff8d53492be1c0 x1874672134283648/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/0 e 0 to 0 dl 1787827041 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827030.925142:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be1c0 with x1874672134283648 ext(1044381696->1048575999) 00002000:00010000:2.0:1787827030.925146:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be1c0 00000100:00100000:2.0:1787827030.925178:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 543 00000100:00100000:2.0:1787827030.925187:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+38:2391:x1874672134283648:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827030.935401:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2391:x1874672134283648:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 10206us (10387us total) trans 30064771548 rc 0/0 00000100:00100000:2.0:1787827030.935412:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 543 00002000:00100000:2.0:1787827030.935423:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x11:0x0] (1044381696->1048575999) req@ffff8d53492be1c0 x1874672134283648/t30064771548(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:631/0 lens 488/448 e 0 to 0 dl 1787827041 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827030.935431:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d53492be1c0 with x1874672134283648 ext(1044381696->1048575999) 00002000:00010000:2.0:1787827030.935436:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d53492be1c0 00000100:00100000:0.0:1787827031.128439:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827031.128506:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283776 00000100:00100000:1.0:1787827031.128516:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283776 00002000:00100000:1.0:1787827031.128576:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1048576000->1052770303) req@ffff8d546e16f480 x1874672134283776/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/0 e 0 to 0 dl 1787827042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:2.0:1787827031.128583:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787827031.128594:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16f480 with x1874672134283776 ext(1048576000->1052770303) 00002000:00010000:1.0:1787827031.128600:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16f480 00000100:00100000:1.0:1787827031.128628:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 544 00000100:00100000:1.0:1787827031.128638:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+40:2390:x1874672134283776:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827031.140496:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2390:x1874672134283776:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 11850us (12059us total) trans 30064771549 rc 0/0 00000100:00100000:1.0:1787827031.140509:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 544 00002000:00100000:1.0:1787827031.140522:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x11:0x0] (1048576000->1052770303) req@ffff8d546e16f480 x1874672134283776/t30064771549(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/448 e 0 to 0 dl 1787827042 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827031.140532:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16f480 with x1874672134283776 ext(1048576000->1052770303) 00002000:00010000:1.0:1787827031.140538:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16f480 00010000:00010000:2.0:1787827031.249405:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827031.344779:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827031.344826:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134283904 00000100:00100000:1.0:1787827031.344836:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134283904 00002000:00100000:1.0:1787827031.344883:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1052770304->1056964607) req@ffff8d5343b0da40 x1874672134283904/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/0 e 0 to 0 dl 1787827042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827031.344893:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0da40 with x1874672134283904 ext(1052770304->1056964607) 00002000:00010000:1.0:1787827031.344898:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0da40 00000100:00100000:1.0:1787827031.344944:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 545 00000100:00100000:1.0:1787827031.344953:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+42:2393:x1874672134283904:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827031.354395:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2393:x1874672134283904:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 9433us (9611us total) trans 30064771550 rc 0/0 00000100:00100000:1.0:1787827031.354408:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 545 00002000:00100000:1.0:1787827031.354421:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1052770304->1056964607) req@ffff8d5343b0da40 x1874672134283904/t30064771550(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/448 e 0 to 0 dl 1787827042 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827031.354429:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0da40 with x1874672134283904 ext(1052770304->1056964607) 00002000:00010000:1.0:1787827031.354434:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0da40 00000100:00100000:2.0:1787827031.544323:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827031.544428:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134284032 00000100:00100000:1.0:1787827031.544438:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134284032 00002000:00100000:1.0:1787827031.544487:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1056964608->1061158911) req@ffff8d547fa62d00 x1874672134284032/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/0 e 0 to 0 dl 1787827042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827031.544495:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62d00 with x1874672134284032 ext(1056964608->1061158911) 00002000:00010000:1.0:1787827031.544499:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62d00 00000100:00100000:1.0:1787827031.544533:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 546 00000100:00100000:1.0:1787827031.544542:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+44:2390:x1874672134284032:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827031.559715:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2390:x1874672134284032:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15163us (15391us total) trans 30064771551 rc 0/0 00000100:00100000:1.0:1787827031.559837:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 546 00002000:00100000:1.0:1787827031.559850:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (1056964608->1061158911) req@ffff8d547fa62d00 x1874672134284032/t30064771551(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/448 e 0 to 0 dl 1787827042 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827031.559859:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa62d00 with x1874672134284032 ext(1056964608->1061158911) 00002000:00010000:1.0:1787827031.559875:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa62d00 00000100:00100000:2.0:1787827031.754726:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827031.754859:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134284160 00000100:00100000:0.0:1787827031.754881:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134284160 00002000:00100000:0.0:1787827031.754939:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1061158912->1065353215) req@ffff8d547fa60000 x1874672134284160/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/0 e 0 to 0 dl 1787827042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827031.754970:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa60000 with x1874672134284160 ext(1061158912->1065353215) 00002000:00010000:0.0:1787827031.754976:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa60000 00000100:00100000:0.0:1787827031.755017:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 547 00000100:00100000:0.0:1787827031.755027:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+46:2392:x1874672134284160:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827031.772302:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2392:x1874672134284160:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 17254us (17567us total) trans 30064771552 rc 0/0 00000100:00100000:2.0:1787827031.772338:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 547 00002000:00100000:2.0:1787827031.772360:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (1061158912->1065353215) req@ffff8d547fa60000 x1874672134284160/t30064771552(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/448 e 0 to 0 dl 1787827042 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827031.772372:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fa60000 with x1874672134284160 ext(1061158912->1065353215) 00002000:00010000:2.0:1787827031.772388:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fa60000 00000100:00100000:0.0:1787827031.985752:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827031.985867:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134284288 00000100:00100000:2.0:1787827031.985877:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134284288 00002000:00100000:2.0:1787827031.985926:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (1065353216->1069547519) req@ffff8d5343b0f480 x1874672134284288/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/0 e 0 to 0 dl 1787827042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827031.985937:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0f480 with x1874672134284288 ext(1065353216->1069547519) 00002000:00010000:2.0:1787827031.985942:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0f480 00000100:00100000:2.0:1787827031.985979:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 548 00000100:00100000:2.0:1787827031.985988:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+48:2393:x1874672134284288:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827032.000409:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+50:2393:x1874672134284288:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 14411us (14654us total) trans 30064771553 rc 0/0 00000100:00100000:2.0:1787827032.000427:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 548 00002000:00100000:2.0:1787827032.000441:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x11:0x0] (1065353216->1069547519) req@ffff8d5343b0f480 x1874672134284288/t30064771553(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:632/0 lens 488/448 e 0 to 0 dl 1787827042 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827032.000453:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343b0f480 with x1874672134284288 ext(1065353216->1069547519) 00002000:00010000:2.0:1787827032.000459:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343b0f480 00000100:00100000:1.0:1787827032.226067:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827032.226117:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827032.226207:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134284416 00000100:00100000:3.0:1787827032.226276:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134284416 00002000:00100000:3.0:1787827032.226325:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1069547520->1073741823) req@ffff8d547fe0cf00 x1874672134284416/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:633/0 lens 488/0 e 0 to 0 dl 1787827043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827032.226336:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0cf00 with x1874672134284416 ext(1069547520->1073741823) 00002000:00010000:3.0:1787827032.226342:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0cf00 00000100:00100000:3.0:1787827032.226360:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134284544 00000100:00100000:3.0:1787827032.226363:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134284544 00002000:00100000:3.0:1787827032.226378:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (500805632->503316479) req@ffff8d547fe0d680 x1874672134284544/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:633/0 lens 488/0 e 0 to 0 dl 1787827043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827032.226386:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0d680 with x1874672134284544 ext(500805632->503316479) 00002000:00010000:3.0:1787827032.226389:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0d680 00000100:00100000:3.0:1787827032.226417:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 549 00000100:00100000:3.0:1787827032.226427:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+51:2390:x1874672134284416:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:1.0:1787827032.226472:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 550 00000100:00100000:1.0:1787827032.226490:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+51:2393:x1874672134284544:12345-192.168.203.6@tcp:4:iozone.0 00000100:00100000:2.0:1787827032.241486:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+56:2390:x1874672134284416:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 15052us (15435us total) trans 30064771554 rc 0/0 00000100:00100000:2.0:1787827032.241522:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 549 00002000:00100000:2.0:1787827032.241536:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x11:0x0] (1069547520->1073741823) req@ffff8d547fe0cf00 x1874672134284416/t30064771554(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:633/0 lens 488/448 e 0 to 0 dl 1787827043 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827032.241548:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0cf00 with x1874672134284416 ext(1069547520->1073741823) 00002000:00010000:2.0:1787827032.241555:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0cf00 00000100:00100000:1.0:1787827032.242794:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134284544:12345-192.168.203.6@tcp:4:iozone.0 Request processed in 16307us (16673us total) trans 30064771555 rc 0/0 00000100:00100000:1.0:1787827032.242806:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 550 00002000:00100000:1.0:1787827032.242814:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x11:0x0] (500805632->503316479) req@ffff8d547fe0d680 x1874672134284544/t30064771555(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:633/0 lens 488/448 e 0 to 0 dl 1787827043 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827032.242823:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fe0d680 with x1874672134284544 ext(500805632->503316479) 00002000:00010000:1.0:1787827032.242826:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fe0d680 00000100:00100000:2.0:1787827032.244427:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827032.244485:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134284672 00000100:00100000:1.0:1787827032.244494:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134284672 00000100:00100000:1.0:1787827032.244541:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 197 00000100:00100000:1.0:1787827032.244551:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+54:2393:x1874672134284672:12345-192.168.203.6@tcp:16:iozone.0 00000001:00080000:3.0:1787827032.245433:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771555 is committed 00000100:00100000:1.0:1787827032.245600:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134284672:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 1050us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827032.245605:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 197 00000100:00100000:0.0:1787827032.251136:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827032.251199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134284928 00000100:00100000:3.0:1787827032.251209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134284928 00000100:00100000:3.0:1787827032.251312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 139 00000100:00080000:2.0:1787827032.251325:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827032.251325:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+11:18296:x1874672134284928:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:3.0:1787827032.251358:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827032.251375:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a79542f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251444:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251454:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251463:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251480:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251488:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251494:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251589:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078a00/0xc0fefc09a7954306 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251596:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078a00/0xc0fefc09a7954306 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251603:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078a00/0xc0fefc09a7954306 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787827032.251612:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 1073741824 00010000:00010000:3.0:1787827032.251710:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251718:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251724:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251730:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827032.251734:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251741:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251752:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:3.0:1787827032.251755:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787827032.251759:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251765:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a79542f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251777:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251783:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251788:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251803:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827032.251806:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251812:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251821:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d54745a6e00) 00010000:00010000:3.0:1787827032.251824:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787827032.251826:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251832:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a79542ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251871:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a79542f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675c3 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251885:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078a00/0xc0fefc09a7954306 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675c3 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.251893:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:3.0:1787827032.251895:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787827032.251898:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e078a00, rc 0) 00000100:00100000:3.0:1787827032.251953:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+13:18296:x1874672134284928:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 632us (827us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787827032.251961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 139 00000100:00100000:0.0:1787827032.253127:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827032.253284:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827032.253356:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134285184 00000100:00100000:1.0:1787827032.253363:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134285184 00000100:00100000:3.0:1787827032.253397:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134285056 00000100:00100000:1.0:1787827032.253406:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 198 00000100:00100000:1.0:1787827032.253415:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134285184:12345-192.168.203.6@tcp:16:iozone.0 00000100:00100000:3.0:1787827032.253424:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134285056 00000100:00100000:3.0:1787827032.253479:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:1.0:1787827032.253480:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134285184:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827032.253491:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+13:2392:x1874672134285056:12345-192.168.203.6@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787827032.253494:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 198 00010000:00010000:3.0:1787827032.253506:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827032.253530:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078a00/0xc0fefc09a7954306 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675c3 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827032.253546:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:3.0:1787827032.253551:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787827032.253575:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2392:x1874672134285056:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 88us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827032.253583:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 36 00010000:00010000:2.0:1787827032.273369:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827032.465029:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827032.465086:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827032.465094:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134285312 00000100:00100000:0.0:1787827032.465103:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134285312 00000100:00100000:2.0:1787827032.465117:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827032.465149:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 535 00000100:00100000:3.0:1787827032.465151:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134285440 00000100:00100000:0.0:1787827032.465158:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134285312:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827032.465158:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134285440 00000100:00100000:2.0:1787827032.465167:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827032.465182:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134285568 00000100:00100000:1.0:1787827032.465187:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134285568 00000100:00100000:2.0:1787827032.465190:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134285696 00000100:00100000:2.0:1787827032.465195:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134285696 00000100:00100000:3.0:1787827032.465205:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 448 00000100:00100000:3.0:1787827032.465248:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134285440:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827032.465250:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134285312:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827032.465255:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 228 00000100:00100000:0.0:1787827032.465266:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 535 00000100:00100000:1.0:1787827032.465273:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 449 00000100:00100000:2.0:1787827032.465273:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134285696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827032.465286:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134285568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827032.465295:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2390:x1874672134285440:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827032.465303:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 448 00000100:00100000:2.0:1787827032.465314:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134285696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827032.465319:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 228 00000100:00100000:1.0:1787827032.465324:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134285568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827032.465333:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 449 00000100:00080000:1.0:1787827032.465354:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827033.169390:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787827033.169412:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143783168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827033.169475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827033.169547:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143783424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827033.169570:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827033.169590:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143783296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827033.169611:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827033.169660:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783296 00000100:00100000:3.0:1787827033.169668:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783296 00000100:00100000:2.0:1787827033.169693:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783168 00000100:00100000:0.0:1787827033.169694:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783424 00000100:00100000:2.0:1787827033.169700:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783168 00000100:00100000:0.0:1787827033.169701:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783424 00000100:00100000:3.0:1787827033.169726:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787827033.169738:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143783296:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827033.169753:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787827033.169763:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143783424:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1787827033.169770:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:0.0:1787827033.169794:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827033.169810:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787827033.169822:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143783168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827033.169830:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143783296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827033.169838:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143783424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (265us total) trans 0 rc 0/0 00002000:00000024:2.0:1787827033.169838:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827033.169848:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787827033.169860:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:0.0:1787827033.169874:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827033.169881:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143783168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827033.169898:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:1.0:1787827033.169961:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343474b40 x1874672143783168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827033.169979:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143783168:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787827033.169990:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b130c0 x1874672143783424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827033.170001:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143783424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827033.170012:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143783296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787827033.297412:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827033.682130:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143783552:0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682156:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143783680:0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682173:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143783808:0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682244:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143783936:0@lo:400:kworker.0 00000100:00100000:1.0:1787827033.682245:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827033.682253:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827033.682288:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783552 00000100:00100000:0.0:1787827033.682295:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827033.682297:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783552 00000100:00100000:1.0:1787827033.682312:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143784064:0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682314:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143784192:0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682324:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143784448:0@lo:400:kworker.0 00000100:00100000:2.0:1787827033.682351:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1787827033.682366:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827033.682367:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143783552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682375:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783680 00000100:00100000:0.0:1787827033.682380:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783680 00000100:00100000:3.0:1787827033.682385:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827033.682400:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143784576:0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682417:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784192 00000100:00100000:0.0:1787827033.682421:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784192 00000100:00100000:3.0:1787827033.682426:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143784704:0@lo:400:kworker.0 00000100:00100000:2.0:1787827033.682467:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143783552:12345-0@lo:400:kworker.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827033.682472:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1787827033.682473:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827033.682486:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1787827033.682487:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143783680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827033.682487:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1787827033.682503:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143784192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827033.682521:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143783552:0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682542:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143783680:12345-0@lo:400:kworker.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827033.682551:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1787827033.682555:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143784192:12345-0@lo:400:kworker.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827033.682556:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784576 00000100:00100000:2.0:1787827033.682562:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784576 00000100:00100000:1.0:1787827033.682565:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784064 00000100:00100000:3.0:1787827033.682566:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1787827033.682571:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784064 00000100:00100000:0.0:1787827033.682581:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783936 00000100:00100000:0.0:1787827033.682587:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783936 00000100:00100000:3.0:1787827033.682598:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827033.682610:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784704 00000100:00100000:2.0:1787827033.682615:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784704 00000100:00100000:1.0:1787827033.682617:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787827033.682626:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787827033.682629:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682640:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143783936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682647:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143783680:0@lo:400:kworker.0 00000100:00100000:2.0:1787827033.682650:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1787827033.682662:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143784576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682672:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143784192:0@lo:400:kworker.0 00000100:00100000:1.0:1787827033.682683:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143784064:12345-0@lo:400:kworker.0 Request processed in 56us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827033.682687:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787827033.682692:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787827033.682695:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143783936:12345-0@lo:400:kworker.0 Request processed in 58us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827033.682696:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143784320:0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682709:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787827033.682714:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143784576:12345-0@lo:400:kworker.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827033.682716:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1787827033.682727:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1787827033.682732:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143784704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682733:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787827033.682736:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827033.682744:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787827033.682747:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827033.682748:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784320 00000100:00100000:2.0:1787827033.682753:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784320 00000100:00100000:0.0:1787827033.682762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827033.682789:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143783808 00000100:00100000:1.0:1787827033.682795:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143784704:12345-0@lo:400:kworker.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827033.682795:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143783808 00000100:00100000:3.0:1787827033.682795:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00080000:0.0:1787827033.682802:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827033.682806:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1787827033.682813:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143784320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682820:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827033.682823:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1787827033.682834:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143783808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827033.682853:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143783936:0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682866:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143784320:12345-0@lo:400:kworker.0 Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827033.682868:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143784064:0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682878:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1787827033.682889:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143784576:0@lo:400:kworker.0 00000100:00100000:2.0:1787827033.682896:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143783808:12345-0@lo:400:kworker.0 Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827033.682900:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143783808:0@lo:400:kworker.0 00000100:00100000:2.0:1787827033.682909:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1787827033.682929:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784448 00000100:00100000:1.0:1787827033.682934:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784448 00010000:00080000:3.0:1787827033.682949:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd52c0 x1874672143784320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827033.682969:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143784320:0@lo:400:kworker.0 00000100:00100000:1.0:1787827033.682974:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00010000:00080000:3.0:1787827033.682984:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd7480 x1874672143784704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827033.682992:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143784448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827033.682998:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143784704:0@lo:400:kworker.0 00000100:00100000:1.0:1787827033.683056:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143784448:12345-0@lo:400:kworker.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827033.683063:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1787827033.683273:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827033.683785:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143784448:0@lo:400:kworker.0 00000100:00100000:2.0:1787827034.193485:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143784832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827034.193554:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827034.193611:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784832 00000100:00100000:3.0:1787827034.193619:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784832 00000100:00100000:3.0:1787827034.193672:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787827034.193681:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143784832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827034.193722:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827034.193781:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143784832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827034.193788:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787827034.193816:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143784832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827034.250776:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827034.250850:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134285824 00000100:00100000:2.0:1787827034.250861:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134285824 00000100:00080000:0.0:1787827034.250917:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827034.250938:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 199 00000100:00100000:2.0:1787827034.250957:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134285824:12345-192.168.203.6@tcp:16:iozone.0 00000100:00100000:2.0:1787827034.251082:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134285824:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827034.251091:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 199 00000100:00100000:0.0:1787827034.253140:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827034.253190:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134286080 00000100:00100000:3.0:1787827034.253200:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134286080 00000100:00100000:3.0:1787827034.253294:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:3.0:1787827034.253303:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:18296:x1874672134286080:12345-192.168.203.6@tcp:35:iozone.0 00000100:00100000:3.0:1787827034.253509:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+13:18296:x1874672134286080:12345-192.168.203.6@tcp:35:iozone.0 Request processed in 207us (374us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787827034.253517:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00080000:0.0:1787827034.253580:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827034.257938:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827034.258056:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134286336 00000100:00100000:1.0:1787827034.258066:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134286336 00000100:00100000:1.0:1787827034.258191:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 140 00000100:00100000:1.0:1787827034.258202:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+13:18296:x1874672134286336:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:1.0:1787827034.258263:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827034.258283:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113a00/0xc0fefc09a7954314 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675ca expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258352:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258367:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258379:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258392:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258398:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258403:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258537:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954329 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258546:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954329 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258553:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954329 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787827034.258562:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 1073741824 00010000:00010000:1.0:1787827034.258631:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258639:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258646:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258660:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827034.258663:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258670:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258682:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827034.258685:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827034.258688:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258704:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795431b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258716:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258738:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258743:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258748:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827034.258750:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258755:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258763:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d5458a66900) 00010000:00010000:1.0:1787827034.258765:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827034.258767:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258772:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113600/0xc0fefc09a7954322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258812:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113a00/0xc0fefc09a7954314 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ca expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258825:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954329 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ca expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827034.258839:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:1.0:1787827034.258841:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787827034.258843:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345113000, rc 0) 00000100:00100000:1.0:1787827034.258919:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+15:18296:x1874672134286336:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 708us (979us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787827034.258927:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 140 00000100:00100000:1.0:1787827034.261395:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827034.261486:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827034.261568:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134286592 00000100:00100000:0.0:1787827034.261577:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134286592 00000100:00100000:0.0:1787827034.261627:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 37 00000100:00100000:0.0:1787827034.261641:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+15:2392:x1874672134286592:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787827034.261655:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827034.261678:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a7954329 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ca expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827034.261695:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:0.0:1787827034.261700:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787827034.261822:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2392:x1874672134286592:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 182us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827034.261830:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 37 00000100:00100000:3.0:1787827034.262100:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134286464 00000100:00100000:3.0:1787827034.262105:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134286464 00000100:00100000:3.0:1787827034.262139:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 200 00000100:00100000:3.0:1787827034.262147:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134286464:12345-192.168.203.6@tcp:16:iozone.0 00000100:00100000:3.0:1787827034.262253:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134286464:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 106us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827034.262261:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 200 00010000:00010000:2.0:1787827034.321492:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827035.345391:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827035.730523:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143784960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827035.730603:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827035.730642:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143785088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827035.730660:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143784960 00000100:00100000:3.0:1787827035.730671:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143784960 00000100:00080000:0.0:1787827035.730715:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827035.730736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827035.730779:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143785088 00000100:00100000:3.0:1787827035.730783:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143785088 00000100:00100000:3.0:1787827035.730833:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00080000:1.0:1787827035.730834:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827035.730846:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143784960:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827035.730871:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787827035.730883:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143785088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827035.730884:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 2849767424 avail 2618245120 00002000:00000024:1.0:1787827035.730901:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 2849767424 avail 2618245120 00000100:00100000:1.0:1787827035.730953:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143785088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827035.730964:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143784960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827035.730965:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787827035.730977:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787827035.731010:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143784960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827035.731056:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143785088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787827036.369556:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827036.370706:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827036.370805:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134286720 00000100:00100000:0.0:1787827036.370819:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134286720 00000100:00080000:1.0:1787827036.370888:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827036.370904:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 201 00000100:00100000:0.0:1787827036.370936:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134286720:12345-192.168.203.6@tcp:16:iozone.0 00000100:00100000:0.0:1787827036.371060:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134286720:12345-192.168.203.6@tcp:16:iozone.0 Request processed in 127us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827036.371067:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 201 00000100:00100000:2.0:1787827036.372098:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827036.372147:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134286976 00000100:00100000:3.0:1787827036.372153:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134286976 00000100:00080000:1.0:1787827036.372202:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827036.372206:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:3.0:1787827036.372245:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450469450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+14:18296:x1874672134286976:12345-192.168.203.6@tcp:35:iozone.0 00000100:00100000:3.0:1787827036.372461:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450469450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+15:18296:x1874672134286976:12345-192.168.203.6@tcp:35:iozone.0 Request processed in 246us (364us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787827036.372469:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:1.0:1787827036.373692:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827036.373736:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134287104 00000100:00100000:3.0:1787827036.373742:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134287104 00000100:00100000:3.0:1787827036.373779:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 141 00000100:00100000:3.0:1787827036.373786:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+15:18296:x1874672134287104:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:3.0:1787827036.373801:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827036.373824:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078a00/0xc0fefc09a7954337 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.373899:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.373911:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.373923:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.373938:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.373945:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.373953:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.374056:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.374065:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.374072:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.374102:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.374122:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 16 pid: 6485 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827036.374135:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6485:1874672143785216:192.168.203.6@tcp:104: 00000100:00100000:3.0:1787827036.374248:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5443e6a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827036.375077:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6485:1874672143785216:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787827036.375099:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827036.375486:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827036.375529:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134287360 00000100:00100000:3.0:1787827036.375535:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134287360 00000100:00100000:3.0:1787827036.375615:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:3.0:1787827036.375625:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:10863:x1874672134287360:12345-192.168.203.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787827036.375839:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:10863:x1874672134287360:12345-192.168.203.6@tcp:35:ldlm_bl.0 Request processed in 215us (354us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1787827036.375847:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:1.0:1787827036.376845:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827036.376904:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134287488 00000100:00100000:3.0:1787827036.376914:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134287488 00010000:00010000:3.0:1787827036.376959:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 18 pid: 6485 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827036.376989:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:3.0:1787827036.376996:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+18:2391:x1874672134287488:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787827036.377006:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827036.377033:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 18 pid: 6485 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.377043:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 18 pid: 6485 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.377059:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79541d9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x10:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467599 expref: 18 pid: 6485 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.377071:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:3.0:1787827036.377075:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.377081:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.377086:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827036.377107:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787827036.377150:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+17:2391:x1874672134287488:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 153us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827036.377155:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 69 00010000:00010000:2.0:1787827036.377157:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377171:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787827036.377266:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 1073741824 00000004:00200000:2.0:1787827036.377272:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787827036.377297:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377313:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377324:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377345:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377353:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377360:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827036.377365:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377374:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377389:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827036.377392:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827036.377396:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377403:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078c00/0xc0fefc09a795433e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377420:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377426:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377432:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377438:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827036.377446:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377453:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377461:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d54745a6e00) 00010000:00010000:2.0:1787827036.377464:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827036.377467:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377473:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078e00/0xc0fefc09a7954345 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377514:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078a00/0xc0fefc09a7954337 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675d1 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377529:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675d1 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.377537:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:2.0:1787827036.377540:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787827036.377542:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e079800, rc 0) 00000100:00100000:2.0:1787827036.377592:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+16:18296:x1874672134287104:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 3806us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827036.377601:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 141 00000100:00100000:1.0:1787827036.379259:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827036.379318:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134287744 00000100:00100000:2.0:1787827036.379327:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134287744 00000100:00100000:2.0:1787827036.379383:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 142 00000100:00100000:2.0:1787827036.379393:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+16:18296:x1874672134287744:12345-192.168.203.6@tcp:36:iozone.0 00010000:00010000:2.0:1787827036.379471:0:22268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787827036.379493:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079800/0xc0fefc09a795434c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675d1 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379513:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79542e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675bc expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379527:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795420a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ae expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379541:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a79541f5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a0 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379552:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d5450fb5d00) 00010000:00010000:2.0:1787827036.379562:0:22268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787827036.379587:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379600:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379609:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379632:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379640:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379659:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379749:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379757:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.379765:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787827036.380104:0:22268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9280 00000004:00080000:2.0:1787827036.380121:0:22268:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411242905164ns, next at 412242902168ns, rc = 0 00010000:00010000:2.0:1787827036.380178:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380192:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380201:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380209:0:22268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380248:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380254:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380297:0:22268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787827036.380320:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380327:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380338:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380344:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827036.380348:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380355:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380369:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d53428e3500) 00010000:00010000:2.0:1787827036.380372:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787827036.380375:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380381:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954361 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380397:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380410:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380426:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380433:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827036.380437:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380445:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827036.380446:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787827036.380463:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380465:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827036.380472:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827036.380476:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380496:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954353 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827036.380503:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2e00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:0.0:1787827036.380512:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787827036.380515:0:22268:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020f3b8e9 reply state 000000005f811d6d transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827036.380532:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380535:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827036.380559:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428e3b00) 00010000:00010000:0.0:1787827036.380563:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8d53428e3500) 00010000:00010000:2.0:1787827036.380563:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787827036.380570:0:22268:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787827036.380571:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787827036.380579:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827036.380587:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2e00/0xc0fefc09a7954368 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827036.380611:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827036.380613:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827036.380618:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827036.380651:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+14:18296:x1874672134287744:12345-192.168.203.6@tcp:36:iozone.0 Request processed in 1258us (1433us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787827036.380661:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 142 00000100:00100000:0.0:1787827037.338761:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827037.338837:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134287872 00000100:00100000:2.0:1787827037.338846:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134287872 00000100:00100000:2.0:1787827037.338907:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00100000:2.0:1787827037.338916:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:18296:x1874672134287872:12345-192.168.203.6@tcp:101:iozone.0 00010000:00010000:2.0:1787827037.338939:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827037.338959:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795436f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675d8 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339031:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339045:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339056:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339107:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339115:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339121:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339156:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339163:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339187:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339193:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827037.339196:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339204:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339255:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827037.339259:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827037.339263:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339270:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954376 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339282:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339288:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339294:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339299:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827037.339302:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339316:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339325:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3caf3138 (ffff8d53428e3000) 00010000:00010000:2.0:1787827037.339327:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827037.339330:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339335:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795437d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3caf3138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339365:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795436f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675d8 expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339375:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827037.339378:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827037.339381:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a795436f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675d8 expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827037.339389:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3a00, rc 0) 00000100:00100000:2.0:1787827037.339444:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:18296:x1874672134287872:12345-192.168.203.6@tcp:101:iozone.0 Request processed in 529us (691us total) trans 0 rc 301/301 00000100:00100000:2.0:1787827037.339451:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 143 00010000:00010000:2.0:1787827037.393470:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827037.585051:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827037.585199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827037.585258:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827037.585279:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288256 00000100:00100000:3.0:1787827037.585289:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288256 00000100:00100000:1.0:1787827037.585310:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827037.585339:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288384 00000100:00100000:1.0:1787827037.585344:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288384 00000100:00100000:2.0:1787827037.585354:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288128 00000100:00100000:2.0:1787827037.585361:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288128 00000100:00100000:1.0:1787827037.585402:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 231 00000100:00100000:3.0:1787827037.585410:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 456 00000100:00100000:1.0:1787827037.585416:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134288384:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827037.585421:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 457 00000100:00100000:3.0:1787827037.585426:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134288256:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827037.585435:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134288128:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827037.585546:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288000 00000100:00100000:0.0:1787827037.585551:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288000 00000100:00100000:3.0:1787827037.585555:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134288256:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827037.585576:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 456 00000100:00100000:0.0:1787827037.585584:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 537 00000100:00080000:3.0:1787827037.585599:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827037.585604:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134288000:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827037.585637:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134288000:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 38us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827037.585653:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 537 00000100:00100000:2.0:1787827037.585662:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2390:x1874672134288128:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 227us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827037.585669:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 457 00000100:00100000:1.0:1787827037.585760:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134288384:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 348us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827037.585768:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 231 00000001:02000400:1.0:1787827038.082846:0:22325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: iozone rc=0 00000100:00100000:1.0:1787827038.094461:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827038.094508:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288512 00000100:00100000:2.0:1787827038.094518:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288512 00000100:00080000:1.0:1787827038.094570:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827038.094598:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 144 00000100:00100000:2.0:1787827038.094609:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+14:19240:x1874672134288512:12345-192.168.203.6@tcp:101:rm.0 00010000:00010000:2.0:1787827038.094629:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827038.094650:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954384 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675df expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094710:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094725:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094736:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094748:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094756:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094763:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094796:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094810:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094818:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094825:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827038.094830:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094839:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094853:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827038.094857:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827038.094861:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094869:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a795438b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094881:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094888:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094895:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094901:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827038.094911:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094919:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094929:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428e3b00) 00010000:00010000:2.0:1787827038.094932:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827038.094935:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094942:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a7954392 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094978:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954384 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675df expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.094989:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827038.094992:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827038.094996:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3a00/0xc0fefc09a7954384 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675df expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.095019:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3a00, rc 0) 00000100:00100000:2.0:1787827038.095074:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+14:19240:x1874672134288512:12345-192.168.203.6@tcp:101:rm.0 Request processed in 467us (621us total) trans 0 rc 301/301 00000100:00100000:2.0:1787827038.095083:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 144 00000100:00100000:3.0:1787827038.096093:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827038.096134:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288640 00000100:00100000:0.0:1787827038.096140:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288640 00000100:00100000:0.0:1787827038.096181:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 145 00000100:00100000:0.0:1787827038.096191:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:19240:x1874672134288640:12345-192.168.203.6@tcp:101:rm.0 00010000:00010000:0.0:1787827038.096202:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827038.096232:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954399 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675e6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096269:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096279:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096287:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096296:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096302:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096308:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096342:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096348:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096354:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096360:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827038.096364:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096371:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096380:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787827038.096383:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827038.096386:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096392:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1a00/0xc0fefc09a79543a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096402:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096408:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096414:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096426:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827038.096429:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096436:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096444:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428e3b00) 00010000:00010000:0.0:1787827038.096446:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827038.096449:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096456:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1400/0xc0fefc09a79543a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096477:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954399 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675e6 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096485:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787827038.096487:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827038.096491:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954399 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675e6 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.096513:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0000, rc 0) 00000100:00100000:0.0:1787827038.096547:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:19240:x1874672134288640:12345-192.168.203.6@tcp:101:rm.0 Request processed in 358us (457us total) trans 0 rc 301/301 00000100:00100000:0.0:1787827038.096553:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 145 00000100:00100000:0.0:1787827038.289341:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143785472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827038.289348:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143785344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827038.289354:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827038.289373:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143785600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827038.289422:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827038.289427:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827038.289452:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143785344 00000100:00100000:2.0:1787827038.289465:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143785344 00000100:00100000:3.0:1787827038.289466:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143785472 00000100:00100000:3.0:1787827038.289471:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143785472 00000100:00080000:1.0:1787827038.289500:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827038.289505:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827038.289518:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143785600 00000100:00100000:2.0:1787827038.289522:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787827038.289524:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143785600 00000100:00100000:1.0:1787827038.289527:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787827038.289537:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143785344:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827038.289539:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143785472:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787827038.289559:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827038.289565:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00002000:00000024:1.0:1787827038.289573:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1787827038.289573:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827038.289574:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143785600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787827038.289590:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827038.289631:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143785472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827038.289639:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143785600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827038.289640:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143785344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827038.289649:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787827038.289657:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787827038.289659:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00010000:00080000:0.0:1787827038.289678:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd6580 x1874672143785600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827038.289699:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143785600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827038.289709:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143785344:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1787827038.289713:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5341f60000 x1874672143785472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827038.289730:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143785472:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1787827038.290338:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000004:00080000:3.0:1787827038.290345:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00010000:00010000:0.0:1787827038.290377:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.290389:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.290398:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.290405:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827038.290410:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.290419:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827038.290440:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd178b560 (ffff8d53428e3b00) 00010000:00010000:0.0:1787827038.290444:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787827038.290444:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787827038.290452:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827038.290458:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143785728:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787827038.290463:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a795435a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827038.290501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827038.290537:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143785728 00000100:00100000:3.0:1787827038.290542:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143785728 00000100:00080000:0.0:1787827038.290578:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827038.290585:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787827038.290594:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e39b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143785728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787827038.290622:0:8401:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:17 count 1 00002000:00010000:3.0:1787827038.290650:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 1073741824, mtime: 0x6a901358, atime: 0x0, ctime: 0x6a901358, blocks: 0x200008 00010000:00010000:3.0:1787827038.290657:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827038.290675:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 5 pid: 21553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827038.290696:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x11:0x0].0x0 since=413s v=(0 0) 00010000:00010000:3.0:1787827038.290701:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787827038.290706:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 4/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827038.290741:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 5 pid: 21553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827038.290751:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 5 pid: 21553 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827038.290759:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143785856:192.168.203.6@tcp:104: 00000100:00100000:3.0:1787827038.290812:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54472196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827038.291888:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1874672143785856:192.168.203.6@tcp:104: 00010000:00010000:2.0:1787827038.291903:0:8401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827038.292081:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827038.292107:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288768 00000100:00100000:2.0:1787827038.292113:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288768 00010000:00010000:2.0:1787827038.292144:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 6 pid: 21553 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787827038.292160:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827038.292171:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:2.0:1787827038.292179:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134288768:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787827038.292190:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827038.292194:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 6 pid: 21553 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292205:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 6 pid: 21553 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292269:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000910ef035/0xc0fefc09a79542c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675a7 expref: 6 pid: 21553 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292281:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787827038.292285:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787827038.292289:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292298:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292318:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827038.292349:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134288768:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 170us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827038.292358:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 70 00010000:00010000:2.0:1787827038.292384:0:8401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292393:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292403:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292411:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827038.292440:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787827038.292459:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827038.292537:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827038.292547:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079600 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787827038.292552:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827038.292560:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827038.292598:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827038.292599:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e39b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143785728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2002us (2094us total) trans 30064771556 rc 0/0 00010000:00010000:3.0:1787827038.292614:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a79543ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827038.292615:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00010000:3.0:1787827038.292657:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827038.292660:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827038.292663:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787827038.292811:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d534355e580/2, rc 0, transno 30064771556 00000100:00100000:1.0:1787827038.292820:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143785728:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787827038.417370:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827038.801468:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143785984:0@lo:400:kworker.0 00000100:00100000:0.0:1787827038.801547:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827038.801599:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143785984 00000100:00100000:2.0:1787827038.801608:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143785984 00000100:00100000:2.0:1787827038.801674:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1787827038.801686:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143785984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827038.801718:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827038.801728:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143786112:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.801745:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143785984:12345-0@lo:400:kworker.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827038.801754:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1787827038.801762:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827038.801804:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143785984:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.801824:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143786112 00000100:00100000:2.0:1787827038.801829:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143786112 00000100:00100000:2.0:1787827038.801880:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1787827038.801891:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143786112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.801947:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143786112:12345-0@lo:400:kworker.0 Request processed in 59us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827038.801956:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1787827038.801977:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143786240:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.801984:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143786624:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802034:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827038.802046:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143786496:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802068:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143786624 00000100:00100000:2.0:1787827038.802073:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143786624 00000100:00100000:0.0:1787827038.802080:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827038.802106:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143787008:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802111:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1787827038.802120:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143786624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827038.802142:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827038.802171:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143786624:12345-0@lo:400:kworker.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827038.802179:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1787827038.802182:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143786112:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802194:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787008 00000100:00100000:2.0:1787827038.802199:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787008 00000100:00100000:0.0:1787827038.802241:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143786496 00000100:00100000:0.0:1787827038.802247:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143786496 00000100:00100000:2.0:1787827038.802262:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1787827038.802272:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143787008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827038.802289:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787827038.802299:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143786496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802312:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143787008:12345-0@lo:400:kworker.0 Request processed in 42us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827038.802319:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00080000:2.0:1787827038.802340:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827038.802343:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143786496:12345-0@lo:400:kworker.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00080000:2.0:1787827038.802346:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787827038.802351:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827038.802352:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787827038.802397:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143786624:0@lo:400:kworker.0 00000100:00100000:0.0:1787827038.802421:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143786496:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802436:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143786368:0@lo:400:kworker.0 00010000:00080000:0.0:1787827038.802438:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f81c000 x1874672143787008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827038.802453:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143787008:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802474:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827038.802505:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143786368 00000100:00100000:0.0:1787827038.802511:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143786368 00000100:00100000:2.0:1787827038.802512:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143786880:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802543:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827038.802547:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787827038.802557:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143786368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802577:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143786880 00000100:00100000:2.0:1787827038.802582:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143786880 00000100:00100000:0.0:1787827038.802609:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143786368:12345-0@lo:400:kworker.0 Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827038.802618:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787827038.802625:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1787827038.802634:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143786880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827038.802655:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143786368:0@lo:400:kworker.0 00000100:00100000:2.0:1787827038.802675:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143786880:12345-0@lo:400:kworker.0 Request processed in 41us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827038.802676:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143786880:0@lo:400:kworker.0 00000004:00080000:1.0:1787827038.802680:0:22422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413665464087ns, next at 412242902168ns, rc = 0 00000100:00100000:2.0:1787827038.802690:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00080000:00080000:1.0:1787827038.802697:0:22422:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1787827038.802711:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1787827038.802804:0:22422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 413665588327ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787827038.802809:0:22422:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1787827038.802890:0:22422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413665674142ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787827038.802897:0:22422:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787827038.802946:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827038.802977:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343474780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143786752:0@lo:400:kworker.0 00000004:00080000:1.0:1787827038.802990:0:22422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 413665774573ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787827038.803012:0:22422:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787827038.803025:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827038.803044:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143786240 00000100:00100000:2.0:1787827038.803050:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143786240 00000100:00100000:2.0:1787827038.803080:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143786752 00000100:00100000:2.0:1787827038.803083:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143786752 00000100:00100000:1.0:1787827038.803126:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00080000:3.0:1787827038.803132:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827038.803139:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143786240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827038.803164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1787827038.803176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143786752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827038.803193:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143786240:12345-0@lo:400:kworker.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827038.803201:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1787827038.803259:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143786240:0@lo:400:kworker.0 00010000:00080000:2.0:1787827038.803273:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343474780 x1874672143786752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827038.803283:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343474780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143786752:0@lo:400:kworker.0 00000100:00100000:3.0:1787827038.803391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143786752:12345-0@lo:400:kworker.0 Request processed in 216us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827038.803401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000004:00080000:0.0:1787827038.803570:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000004:00080000:3.0:1787827038.803618:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000004:00080000:1.0:1787827038.804070:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1787827038.804326:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000100:00100000:2.0:1787827039.313403:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143787136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827039.313470:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827039.313527:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787136 00000100:00100000:0.0:1787827039.313535:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787136 00000100:00100000:0.0:1787827039.313583:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787827039.313593:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143787136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827039.313624:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827039.313670:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143787136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827039.313677:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787827039.313721:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143787136:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787827039.441402:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827040.465409:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827040.849477:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787827040.849501:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143787264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827040.849581:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827040.849623:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787264 00000100:00100000:3.0:1787827040.849631:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787264 00000100:00080000:2.0:1787827040.849692:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827040.849697:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787827040.849711:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143787264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787827040.849739:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827040.849785:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143787392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827040.849795:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143787264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827040.849803:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787827040.849822:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827040.849866:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143787264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827040.849869:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787392 00000100:00100000:1.0:1787827040.849875:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787392 00000100:00100000:1.0:1787827040.849922:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787827040.849930:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143787392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787827040.849943:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1787827040.849950:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827040.850003:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143787392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827040.850011:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787827040.850036:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143787392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787827041.489361:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827042.513374:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827042.705017:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827042.705064:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827042.705089:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289024 00000100:00100000:3.0:1787827042.705093:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827042.705098:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289024 00000100:00100000:0.0:1787827042.705128:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134288896 00000100:00100000:0.0:1787827042.705135:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134288896 00000100:00100000:3.0:1787827042.705141:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827042.705152:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289152 00000100:00100000:1.0:1787827042.705157:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289152 00000100:00100000:2.0:1787827042.705163:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 464 00000100:00100000:2.0:1787827042.705174:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2393:x1874672134289024:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827042.705183:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 539 00000100:00080000:3.0:1787827042.705188:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827042.705194:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827042.705198:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 465 00000100:00100000:0.0:1787827042.705199:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134288896:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827042.705209:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134289152:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827042.705266:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2393:x1874672134289024:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827042.705270:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134288896:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827042.705275:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 464 00000100:00100000:1.0:1787827042.705283:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134289152:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827042.705287:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 539 00000100:00100000:1.0:1787827042.705292:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 465 00000100:00100000:3.0:1787827042.705307:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289280 00000100:00100000:3.0:1787827042.705312:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289280 00000100:00100000:3.0:1787827042.705363:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 233 00000100:00100000:3.0:1787827042.705374:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134289280:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827042.705407:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134289280:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00080000:2.0:1787827042.705411:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827042.705415:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 233 00000100:00100000:2.0:1787827043.409421:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143787520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827043.409486:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827043.409523:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787827043.409540:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143787776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827043.409548:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787520 00000100:00100000:2.0:1787827043.409551:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827043.409557:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787520 00000100:00100000:2.0:1787827043.409576:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143787648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827043.409582:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827043.409611:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787827043.409618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827043.409627:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143787520:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827043.409637:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787776 00000100:00100000:1.0:1787827043.409642:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787776 00000004:00000024:0.0:1787827043.409660:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827043.409673:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787648 00000100:00100000:2.0:1787827043.409678:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787648 00000100:00100000:1.0:1787827043.409702:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787827043.409714:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143787776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827043.409719:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787827043.409731:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143787520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827043.409732:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143787648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787827043.409738:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827043.409750:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00002000:00000024:2.0:1787827043.409751:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787827043.409762:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787827043.409806:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa69680 x1874672143787648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827043.409808:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143787776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827043.409809:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143787648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (191us total) trans 0 rc 0/0 00010000:00080000:0.0:1787827043.409818:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534355f480 x1874672143787776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827043.409829:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787827043.409840:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787827043.409848:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143787648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827043.409853:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143787776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827043.409871:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143787520:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787827043.537354:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827043.921424:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827043.921443:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827043.921454:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143787904:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.921461:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143788416:0@lo:400:kworker.0 00000100:00100000:2.0:1787827043.921533:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827043.921534:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143788160:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.921535:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827043.921585:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827043.921592:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143788288:0@lo:400:kworker.0 00000100:00100000:2.0:1787827043.921597:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143788800:0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.921613:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143788672:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.921639:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827043.921652:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827043.921657:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827043.921695:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143788928:0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.921698:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787827043.921708:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143788032:0@lo:400:kworker.0 00000100:00100000:2.0:1787827043.921710:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143787904 00000100:00100000:2.0:1787827043.921717:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143787904 00000100:00100000:1.0:1787827043.921731:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827043.921755:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827043.921774:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1787827043.921779:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143788544:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.921784:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788416 00000100:00100000:2.0:1787827043.921789:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143787904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.921790:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788416 00000100:00100000:0.0:1787827043.921807:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827043.921827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788160 00000100:00100000:1.0:1787827043.921832:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788800 00000100:00100000:1.0:1787827043.921836:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788800 00000100:00100000:3.0:1787827043.921841:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788160 00000100:00100000:0.0:1787827043.921849:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143789056:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.921863:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787827043.921863:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143787904:12345-0@lo:400:kworker.0 Request processed in 79us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827043.921886:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1787827043.921892:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827043.921892:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143788416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827043.921915:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788672 00000100:00100000:3.0:1787827043.921919:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788672 00000100:00100000:0.0:1787827043.921938:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788928 00000100:00100000:0.0:1787827043.921944:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788928 00000100:00100000:2.0:1787827043.921950:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788288 00000100:00100000:3.0:1787827043.921955:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788032 00000100:00100000:2.0:1787827043.921957:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788288 00000100:00100000:1.0:1787827043.921979:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143788416:12345-0@lo:400:kworker.0 Request processed in 106us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827043.921988:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787827043.921991:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143788544 00000100:00100000:0.0:1787827043.921994:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788544 00000100:00100000:1.0:1787827043.922016:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787827043.922033:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787827043.922034:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143788800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922038:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789056 00000100:00100000:0.0:1787827043.922043:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789056 00000100:00100000:2.0:1787827043.922053:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143788288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922080:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1787827043.922085:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143788800:12345-0@lo:400:kworker.0 Request processed in 61us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827043.922085:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143788032 00000100:00100000:1.0:1787827043.922099:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787827043.922101:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143788160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827043.922114:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143788288:12345-0@lo:400:kworker.0 Request processed in 65us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827043.922128:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1787827043.922139:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787827043.922145:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1787827043.922152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143788672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922161:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143788160:12345-0@lo:400:kworker.0 Request processed in 66us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827043.922161:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143788928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922174:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1787827043.922191:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1787827043.922201:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143788544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827043.922202:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143788800:0@lo:400:kworker.0 00000100:00100000:2.0:1787827043.922267:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143787904:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.922305:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143788928:12345-0@lo:400:kworker.0 Request processed in 146us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827043.922307:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143788672:12345-0@lo:400:kworker.0 Request processed in 153us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827043.922319:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1787827043.922320:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143788544:12345-0@lo:400:kworker.0 Request processed in 118us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827043.922330:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1787827043.922340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1787827043.922348:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143789056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922354:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1787827043.922367:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1787827043.922381:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143788032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827043.922402:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143789056:12345-0@lo:400:kworker.0 Request processed in 64us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827043.922411:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1787827043.922434:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143788032:12345-0@lo:400:kworker.0 Request processed in 57us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827043.922437:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143788544:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.922443:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00080000:2.0:1787827043.922460:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787827043.922466:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787827043.922469:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74d680 x1874672143789056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787827043.922471:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827043.922497:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143789056:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.922500:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143788928:0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922523:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143788160:0@lo:400:kworker.0 00000100:00100000:1.0:1787827043.922526:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143788416:0@lo:400:kworker.0 00010000:00080000:0.0:1787827043.922546:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e1680 x1874672143788672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827043.922548:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143788288:0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922564:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143788672:0@lo:400:kworker.0 00000100:00100000:0.0:1787827043.922592:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143788032:0@lo:400:kworker.0 00000001:00080000:3.0:1787827043.923170:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771556 is committed 00000100:00100000:2.0:1787827044.433381:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143789184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827044.433455:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827044.433504:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789184 00000100:00100000:0.0:1787827044.433513:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789184 00000100:00100000:0.0:1787827044.433550:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787827044.433558:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143789184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827044.433584:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827044.433620:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143789184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827044.433626:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787827044.433665:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143789184:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827044.561393:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827045.585355:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827045.969331:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143789312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827045.969394:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827045.969449:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789312 00000100:00100000:2.0:1787827045.969458:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789312 00000100:00100000:1.0:1787827045.969469:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827045.969477:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143789440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827045.969503:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787827045.969507:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827045.969520:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789440 00000100:00100000:2.0:1787827045.969529:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789440 00000100:00100000:1.0:1787827045.969544:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787827045.969555:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143789312:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827045.969568:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787827045.969579:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143789440:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787827045.969591:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787827045.969593:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00002000:00000024:2.0:1787827045.969593:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827045.969653:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143789312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827045.969662:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143789440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827045.969664:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787827045.969675:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771556 gen 2 00000100:00100000:2.0:1787827045.969680:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000004:00080000:0.0:1787827045.969681:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d534355e580, transno 30064771556 00000100:00100000:0.0:1787827045.969697:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143789440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827045.969711:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143789312:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787827046.609354:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827047.633550:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827047.826422:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827047.826469:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827047.826516:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827047.826542:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827047.826553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289536 00000100:00100000:1.0:1787827047.826563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289536 00000100:00100000:0.0:1787827047.826565:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289792 00000100:00100000:0.0:1787827047.826571:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289792 00000100:00100000:2.0:1787827047.826574:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289664 00000100:00100000:2.0:1787827047.826580:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289664 00000100:00100000:2.0:1787827047.826650:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 472 00000100:00100000:2.0:1787827047.826662:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2390:x1874672134289536:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827047.826663:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289408 00000100:00100000:1.0:1787827047.826664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 473 00000100:00100000:3.0:1787827047.826670:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289408 00000100:00100000:1.0:1787827047.826691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134289664:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827047.826707:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 541 00000100:00100000:3.0:1787827047.826717:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134289408:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827047.826751:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2390:x1874672134289536:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827047.826753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134289664:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827047.826762:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 472 00000100:00100000:3.0:1787827047.826765:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134289408:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827047.826771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 473 00000100:00100000:3.0:1787827047.826781:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 541 00000100:00080000:1.0:1787827047.826820:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827047.826825:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827047.826829:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827047.826960:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 236 00000100:00100000:0.0:1787827047.826968:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134289792:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827047.827009:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134289792:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827047.827016:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 236 00000001:02000400:1.0:1787827048.230633:0:22908:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 6: Fail OST before obd_destroy ========================================================== 06:37:27 (1787827047) 00000100:00100000:2.0:1787827048.529441:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143789696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827048.529442:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143789568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827048.529492:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143789824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827048.529529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827048.529530:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827048.529595:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789568 00000100:00100000:0.0:1787827048.529603:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789568 00000100:00080000:1.0:1787827048.529645:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827048.529653:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789696 00000100:00100000:0.0:1787827048.529659:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787827048.529660:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789696 00000100:00100000:0.0:1787827048.529672:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143789568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827048.529681:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827048.529703:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00002000:00000024:0.0:1787827048.529705:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827048.529715:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789824 00000100:00100000:3.0:1787827048.529715:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143789696:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827048.529721:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789824 00000004:00000024:3.0:1787827048.529743:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00080000:1.0:1787827048.529750:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827048.529759:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143789568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827048.529767:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787827048.529773:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787827048.529778:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143789824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787827048.529792:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827048.529799:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143789696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (275us total) trans 0 rc 0/0 00010000:00080000:1.0:1787827048.529801:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5444f09680 x1874672143789568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827048.529815:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787827048.529828:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143789568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827048.529841:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143789824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827048.529850:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00080000:0.0:1787827048.529867:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5453268780 x1874672143789824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827048.529876:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143789696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827048.529885:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143789824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787827048.657522:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827049.041401:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143789952:0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.041472:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827049.041513:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143790080:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041520:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143789952 00000100:00100000:3.0:1787827049.041528:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143789952 00000100:00100000:1.0:1787827049.041552:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827049.041585:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1787827049.041591:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790080 00000100:00100000:0.0:1787827049.041595:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790080 00000100:00100000:3.0:1787827049.041595:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143789952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.041638:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1787827049.041644:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143790080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041645:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143789952:12345-0@lo:400:kworker.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827049.041651:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1787827049.041656:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787827049.041667:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143790208:0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.041679:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143790080:12345-0@lo:400:kworker.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827049.041685:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1787827049.041703:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827049.041719:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143789952:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041719:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790208 00000100:00100000:3.0:1787827049.041723:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790208 00000100:00100000:1.0:1787827049.041742:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143790080:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041751:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1787827049.041759:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143790208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041813:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143790208:12345-0@lo:400:kworker.0 Request processed in 55us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827049.041819:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1787827049.041851:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143790336:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041874:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143790720:0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.041888:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827049.041900:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827049.041914:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143790848:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041922:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787827049.041940:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790720 00000100:00100000:3.0:1787827049.041942:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143790592:0@lo:400:kworker.0 00000100:00100000:2.0:1787827049.041946:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790720 00000100:00100000:0.0:1787827049.041951:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827049.041967:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827049.041972:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787827049.041978:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143790464:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.041984:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143791104:0@lo:400:kworker.0 00000100:00100000:2.0:1787827049.041991:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790592 00000100:00100000:2.0:1787827049.041996:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790592 00000100:00100000:0.0:1787827049.042002:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827049.042004:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827049.042019:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143790976:0@lo:400:kworker.0 00000100:00100000:2.0:1787827049.042021:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1787827049.042029:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790848 00000100:00100000:3.0:1787827049.042034:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790848 00000100:00100000:2.0:1787827049.042035:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143790720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.042046:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827049.042064:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790464 00000100:00100000:3.0:1787827049.042068:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790464 00000100:00100000:0.0:1787827049.042074:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790336 00000100:00100000:0.0:1787827049.042077:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790336 00000100:00100000:2.0:1787827049.042088:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143790720:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827049.042094:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787827049.042099:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787827049.042102:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143790848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.042108:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143790336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827049.042114:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1787827049.042132:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143791104 00000100:00100000:2.0:1787827049.042136:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143791104 00000100:00100000:0.0:1787827049.042150:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143790336:12345-0@lo:400:kworker.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827049.042152:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143790848:12345-0@lo:400:kworker.0 Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827049.042156:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143790976 00000100:00100000:0.0:1787827049.042159:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787827049.042160:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787827049.042161:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143790976 00000100:00100000:3.0:1787827049.042177:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787827049.042185:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1787827049.042187:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143790464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.042194:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143790848:0@lo:400:kworker.0 00000100:00100000:2.0:1787827049.042197:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143790592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.042207:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143790336:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.042240:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143790464:12345-0@lo:400:kworker.0 Request processed in 56us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827049.042242:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143790464:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.042256:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787827049.042269:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143790592:12345-0@lo:400:kworker.0 Request processed in 76us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827049.042278:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1787827049.042286:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143791104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.042318:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143791104:12345-0@lo:400:kworker.0 Request processed in 33us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827049.042976:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1787827049.042984:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1787827049.042989:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1787827049.042994:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143790976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.043021:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143790592:0@lo:400:kworker.0 00000100:00080000:2.0:1787827049.043026:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827049.043032:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143790976:12345-0@lo:400:kworker.0 Request processed in 39us (985us total) trans 0 rc 0/0 00000100:00080000:2.0:1787827049.043034:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787827049.043034:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e12c0 x1874672143791104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827049.043040:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00080000:2.0:1787827049.043040:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827049.043047:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143791104:0@lo:400:kworker.0 00010000:00080000:3.0:1787827049.043060:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e1680 x1874672143790720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827049.043068:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143790208:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.043071:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143790720:0@lo:400:kworker.0 00000100:00100000:0.0:1787827049.043075:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143790976:0@lo:400:kworker.0 00000100:00100000:3.0:1787827049.553522:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143791232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787827049.553611:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827049.553690:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143791232 00000100:00100000:1.0:1787827049.553704:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143791232 00000100:00100000:1.0:1787827049.553766:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787827049.553778:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143791232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787827049.553814:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827049.553901:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143791232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827049.553909:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787827049.553964:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143791232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787827049.681441:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827050.705360:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827051.089360:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787827051.089382:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143791360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827051.089455:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827051.089498:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143791360 00000100:00100000:2.0:1787827051.089507:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143791360 00000100:00100000:1.0:1787827051.089517:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143791488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827051.089551:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787827051.089570:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827051.089597:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143791488 00000100:00100000:2.0:1787827051.089602:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143791488 00000100:00100000:0.0:1787827051.089624:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787827051.089639:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143791360:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827051.089646:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00002000:00000024:0.0:1787827051.089668:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827051.089668:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143791488:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787827051.089668:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787827051.089687:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827051.089729:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143791360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827051.089737:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143791488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827051.089738:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787827051.089749:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787827051.089851:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143791360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827051.089865:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143791488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787827051.729468:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827052.753425:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827052.945280:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827052.945324:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827052.945360:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827052.945364:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134289920 00000100:00100000:3.0:1787827052.945375:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134289920 00000100:00100000:1.0:1787827052.945383:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290176 00000100:00100000:1.0:1787827052.945389:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290176 00000100:00100000:2.0:1787827052.945396:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827052.945446:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290048 00000100:00100000:3.0:1787827052.945447:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 543 00000100:00100000:1.0:1787827052.945451:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290048 00000100:00100000:3.0:1787827052.945461:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134289920:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827052.945465:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 480 00000100:00100000:0.0:1787827052.945478:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134290176:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827052.945486:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 481 00000100:00100000:1.0:1787827052.945494:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134290048:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827052.945508:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290304 00000100:00100000:2.0:1787827052.945524:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290304 00000100:00100000:3.0:1787827052.945533:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134289920:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827052.945541:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134290176:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827052.945541:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134290048:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827052.945547:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 543 00000100:00100000:1.0:1787827052.945556:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 481 00000100:00100000:0.0:1787827052.945563:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 480 00000100:00100000:2.0:1787827052.945567:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 239 00000100:00100000:2.0:1787827052.945578:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134290304:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787827052.945581:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787827052.945586:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827052.945589:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827052.945612:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134290304:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827052.945620:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 239 00000100:00100000:1.0:1787827053.649343:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143791616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827053.649347:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143791744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827053.649364:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143791872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827053.649421:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827053.649426:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827053.649456:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143791744 00000100:00100000:1.0:1787827053.649464:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143791744 00000100:00100000:0.0:1787827053.649514:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827053.649524:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143791616 00000100:00100000:3.0:1787827053.649525:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143791872 00000100:00100000:1.0:1787827053.649529:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143791616 00000100:00100000:3.0:1787827053.649531:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143791872 00000100:00100000:0.0:1787827053.649556:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787827053.649566:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787827053.649571:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143791744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827053.649577:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787827053.649580:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143791616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827053.649591:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143791872:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1787827053.649603:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787827053.649603:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787827053.649616:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827053.649669:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143791616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827053.649677:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143791744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827053.649685:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143791872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827053.649694:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787827053.649698:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787827053.649703:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:1.0:1787827053.649726:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787827053.649745:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243da40 x1874672143791616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827053.649766:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143791616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827053.649766:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143791872:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1787827053.649773:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6a940 x1874672143791744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827053.649791:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143791744:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787827053.777371:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827054.161528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143792000:0@lo:400:kworker.0 00000100:00100000:2.0:1787827054.161540:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143792256:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.161592:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143792384:0@lo:400:kworker.0 00000100:00100000:1.0:1787827054.161614:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827054.161615:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827054.161647:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143792128:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.161656:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827054.161697:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827054.161697:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143792512:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.161698:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143792896:0@lo:400:kworker.0 00000100:00100000:2.0:1787827054.161703:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143792768:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.161721:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143792640:0@lo:400:kworker.0 00000100:00100000:1.0:1787827054.161747:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827054.161752:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827054.161762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827054.161774:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792384 00000100:00100000:1.0:1787827054.161777:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143793024:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.161782:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792384 00000100:00100000:2.0:1787827054.161794:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143793280:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.161796:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143793408:0@lo:400:kworker.0 00000100:00100000:1.0:1787827054.161812:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827054.161835:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827054.161840:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143793536:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.161846:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792128 00000100:00100000:0.0:1787827054.161852:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792128 00000100:00100000:2.0:1787827054.161853:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827054.161878:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792896 00000100:00100000:1.0:1787827054.161882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827054.161882:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792256 00000100:00100000:0.0:1787827054.161888:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792896 00000100:00100000:3.0:1787827054.161907:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792256 00000100:00100000:2.0:1787827054.161940:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792768 00000100:00100000:3.0:1787827054.161945:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792512 00000100:00100000:2.0:1787827054.161946:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792768 00000100:00100000:0.0:1787827054.161951:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793024 00000100:00100000:3.0:1787827054.161951:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792512 00000100:00100000:1.0:1787827054.161956:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792000 00000100:00100000:0.0:1787827054.161957:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793024 00000100:00100000:1.0:1787827054.161964:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792000 00000100:00100000:2.0:1787827054.161984:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793280 00000100:00100000:2.0:1787827054.161989:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793280 00000100:00100000:0.0:1787827054.161991:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793408 00000100:00100000:0.0:1787827054.161996:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793408 00000100:00100000:3.0:1787827054.162003:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787827054.162011:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1787827054.162017:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143792256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162021:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793536 00000100:00100000:2.0:1787827054.162025:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787827054.162026:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793536 00000100:00100000:1.0:1787827054.162026:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143792000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827054.162039:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143792768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162045:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1787827054.162053:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143792384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162093:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143792256:12345-0@lo:400:kworker.0 Request processed in 79us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827054.162095:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143792000:12345-0@lo:400:kworker.0 Request processed in 75us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827054.162104:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143792768:12345-0@lo:400:kworker.0 Request processed in 67us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827054.162110:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787827054.162115:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143792384:12345-0@lo:400:kworker.0 Request processed in 59us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827054.162115:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1787827054.162131:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1787827054.162135:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787827054.162137:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787827054.162151:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1787827054.162164:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143792128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827054.162164:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787827054.162166:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143792512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827054.162170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1787827054.162179:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143793280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827054.162188:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143792896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162267:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143792512:12345-0@lo:400:kworker.0 Request processed in 119us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827054.162269:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143792128:12345-0@lo:400:kworker.0 Request processed in 110us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827054.162280:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143793280:12345-0@lo:400:kworker.0 Request processed in 100us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827054.162283:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787827054.162286:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143792896:12345-0@lo:400:kworker.0 Request processed in 99us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827054.162287:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1787827054.162296:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787827054.162311:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1787827054.162320:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1787827054.162323:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143793024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787827054.162343:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787827054.162350:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787827054.162350:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9d0780 x1874672143792768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827054.162358:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1787827054.162365:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143793024:12345-0@lo:400:kworker.0 Request processed in 44us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827054.162374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143793408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162375:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143792768:0@lo:400:kworker.0 00000100:00100000:2.0:1787827054.162379:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1787827054.162389:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1787827054.162393:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143793536:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787827054.162399:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9d3840 x1874672143793280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827054.162409:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143793280:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162430:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143792384:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162432:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143792256:0@lo:400:kworker.0 00000100:00100000:2.0:1787827054.162444:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143793536:12345-0@lo:400:kworker.0 Request processed in 54us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827054.162450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f700780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143793408:12345-0@lo:400:kworker.0 Request processed in 78us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827054.162455:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1787827054.162457:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143792896:0@lo:400:kworker.0 00000100:00100000:1.0:1787827054.162468:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1787827054.162476:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143793408:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162490:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827054.162519:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143792512:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162524:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143792640 00000100:00100000:3.0:1787827054.162527:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143793152:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162529:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143792640 00010000:00080000:1.0:1787827054.162536:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9d2940 x1874672143793024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827054.162547:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143793024:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162562:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787827054.162564:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c0000 x1874672143793536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827054.162574:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143793536:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162575:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793152 00000100:00100000:0.0:1787827054.162581:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793152 00000100:00100000:1.0:1787827054.162594:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143792000:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162602:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143792128:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162613:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787827054.162624:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143792640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.162638:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787827054.162649:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143793152:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787827054.162669:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827054.162673:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143792640:12345-0@lo:400:kworker.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827054.162682:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787827054.162697:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143793152:12345-0@lo:400:kworker.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827054.162705:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787827054.162716:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143792640:0@lo:400:kworker.0 00000100:00100000:0.0:1787827054.162731:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143793152:0@lo:400:kworker.0 00000100:00100000:3.0:1787827054.673437:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143793664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787827054.673498:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827054.673553:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793664 00000100:00100000:0.0:1787827054.673560:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793664 00000100:00100000:0.0:1787827054.673834:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787827054.673845:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143793664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827054.673873:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827054.673928:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143793664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827054.673934:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787827054.673968:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143793664:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827054.801491:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827055.825397:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827056.209451:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143793920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827056.209451:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143793792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827056.209531:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827056.209532:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827056.209830:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793792 00000100:00100000:1.0:1787827056.209838:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793792 00000100:00100000:0.0:1787827056.209848:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143793920 00000100:00100000:0.0:1787827056.209852:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143793920 00000100:00080000:2.0:1787827056.209887:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827056.209907:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787827056.209917:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143793920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787827056.209945:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827056.209963:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787827056.209971:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54765ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143793792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787827056.209981:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827056.210003:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343474780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143793920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827056.210011:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787827056.210014:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54765ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143793792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827056.210021:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787827056.210053:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143793920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827056.210112:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143793792:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787827056.852054:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787827057.415102:0:23150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432277885261ns, next at 412242902168ns, rc = 0 00080000:00080000:0.0:1787827057.415116:0:23150:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787827057.415182:0:23150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 432277966652ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787827057.415186:0:23150:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787827057.415254:0:23150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 432278038964ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787827057.415258:0:23150:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787827057.415328:0:23150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 432278112336ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787827057.415334:0:23150:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1787827057.415945:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000004:00080000:3.0:1787827057.416402:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:1.0:1787827057.416675:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787827057.416701:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000100:00100000:3.0:1787827057.869314:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827057.869389:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290432 00000100:00100000:0.0:1787827057.869406:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290432 00000100:00080000:2.0:1787827057.869473:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827057.869697:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 146 00000100:00100000:0.0:1787827057.869710:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+7:20498:x1874672134290432:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787827057.869768:0:22268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827057.869853:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+7:20498:x1874672134290432:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 148us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827057.869860:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 146 00000100:00100000:0.0:1787827057.871983:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827057.872049:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290560 00000100:00100000:3.0:1787827057.872060:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290560 00000100:00080000:2.0:1787827057.872116:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827057.872130:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:3.0:1787827057.872140:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:20498:x1874672134290560:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787827057.872182:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827057.872274:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:20498:x1874672134290560:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827057.872288:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 147 00010000:00010000:3.0:1787827057.873314:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827057.875341:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827057.877974:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290688 00000100:00100000:0.0:1787827057.877994:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290688 00000100:00080000:3.0:1787827057.878089:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827057.878127:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 277 00000100:00100000:0.0:1787827057.878139:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:20498:x1874672134290688:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:0.0:1787827057.878175:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 489137600 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827057.878313:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:20498:x1874672134290688:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 173us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827057.878323:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 277 00000100:00100000:2.0:1787827057.887284:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827057.887993:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290816 00000100:00100000:3.0:1787827057.888003:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290816 00000100:00100000:3.0:1787827057.888046:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 203 00000100:00100000:3.0:1787827057.888055:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134290816:12345-192.168.203.6@tcp:8:lfs.0 00010000:00080000:3.0:1787827057.888087:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1787827057.888119:0:8402:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a79543b5 00002000:00100000:3.0:1787827057.888131:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d5343518800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787827057.888148:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787827057.888238:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787827057.888268:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d534351f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787827057.888340:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134290816:12345-192.168.203.6@tcp:8:lfs.0 Request processed in 285us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827057.888346:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 203 00000100:00100000:2.0:1787827057.890692:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827057.890738:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134290944 00000100:00100000:3.0:1787827057.890746:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134290944 00000100:00080000:2.0:1787827057.890796:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827057.890810:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 278 00000100:00100000:3.0:1787827057.890819:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:20498:x1874672134290944:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787827057.890841:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827057.890905:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:20498:x1874672134290944:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827057.890923:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 278 00000100:00100000:2.0:1787827057.911133:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827057.911185:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134291200 00000100:00100000:0.0:1787827057.911194:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134291200 00000100:00100000:0.0:1787827057.911267:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:0.0:1787827057.911278:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:20502:x1874672134291200:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:0.0:1787827057.911298:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827057.911318:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a79543bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675ed expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.911413:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.911427:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.911450:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.911468:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.911477:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.911483:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827057.911696:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143794048:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787827057.911746:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827057.911787:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787827057.911802:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794048 00000100:00100000:2.0:1787827057.911806:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794048 00000004:00080000:0.0:1787827057.911819:0:6487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x12:0x0], index 0: 0 00000100:00100000:2.0:1787827057.911838:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787827057.911845:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143794048:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787827057.911894:0:19008:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1787827057.912019:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79543d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912030:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79543d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912039:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79543d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912079:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912088:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912095:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912103:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827057.912113:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912121:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912132:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787827057.912135:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827057.912138:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912143:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787827057.912153:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b4bb1c6 reply state 0000000042b099a6 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912160:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912165:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xad0f7562 (ffff8d54531bcb00) 00010000:00010000:0.0:1787827057.912167:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787827057.912169:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787827057.912191:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a79543bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ed expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912201:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79543d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ed expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.912206:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff8d54531bcd00) 00010000:00010000:0.0:1787827057.912208:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787827057.912231:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1000, rc 0) 00000100:00100000:0.0:1787827057.912279:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:20502:x1874672134291200:12345-192.168.203.6@tcp:101:dd.0 Request processed in 1003us (1151us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787827057.912288:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:2.0:1787827057.914377:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827057.914431:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134291328 00000100:00100000:0.0:1787827057.914437:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134291328 00000100:00100000:0.0:1787827057.914477:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 205 00000100:00100000:0.0:1787827057.914485:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:20502:x1874672134291328:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:0.0:1787827057.914498:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827057.914517:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787827057.914888:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787827057.914910:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1787827057.914915:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787827057.914924:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 6 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.914942:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 6 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827057.914953:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0600, rc 0) 00000100:00100000:0.0:1787827057.915001:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:20502:x1874672134291328:12345-192.168.203.6@tcp:101:dd.0 Request processed in 516us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827057.915009:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 205 00000100:00100000:2.0:1787827057.922595:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143794048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10745us (10843us total) trans 30064771557 rc 0/0 00000100:00100000:2.0:1787827057.922608:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787827057.922635:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143794048:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787827057.922653:0:9503:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x12:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1787827058.066048:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827058.066119:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134291456 00000100:00100000:3.0:1787827058.066128:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134291456 00000100:00100000:3.0:1787827058.066179:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 545 00000100:00100000:3.0:1787827058.066189:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134291456:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827058.066291:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134291456:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 103us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827058.066299:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 545 00000100:00100000:2.0:1787827058.176315:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827058.176378:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134291584 00000100:00100000:0.0:1787827058.176387:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134291584 00002000:00100000:0.0:1787827058.176444:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x12:0x0] (0->4194303) req@ffff8d547f9c4f00 x1874672134291584/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:659/0 lens 488/0 e 0 to 0 dl 1787827069 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827058.176455:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c4f00 with x1874672134291584 ext(0->4194303) 00002000:00010000:0.0:1787827058.176461:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c4f00 00000100:00100000:0.0:1787827058.176489:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 551 00000100:00100000:0.0:1787827058.176505:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134291584:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:1.0:1787827058.193356:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134291584:12345-192.168.203.6@tcp:4:dd.0 Request processed in 16845us (17037us total) trans 30064771558 rc 0/0 00000100:00100000:1.0:1787827058.193372:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 551 00002000:00100000:1.0:1787827058.193387:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x12:0x0] (0->4194303) req@ffff8d547f9c4f00 x1874672134291584/t30064771558(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:659/0 lens 488/448 e 0 to 0 dl 1787827069 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827058.193395:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9c4f00 with x1874672134291584 ext(0->4194303) 00002000:00010000:1.0:1787827058.193401:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9c4f00 00000100:00100000:2.0:1787827058.250562:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827058.250628:0:16787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134291840 00000100:00100000:0.0:1787827058.250637:0:16787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134291840 00000100:00100000:0.0:1787827058.250693:0:16787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:0.0:1787827058.250701:0:16787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:20502:x1874672134291840:12345-192.168.203.6@tcp:35:dd.0 00000001:00080000:0.0:1787827058.250891:0:16787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000100:00100000:0.0:1787827058.250975:0:16787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+12:20502:x1874672134291840:12345-192.168.203.6@tcp:35:dd.0 Request processed in 275us (420us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1787827058.250984:0:16787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 42 00000020:00080000:0.0:1787827058.250989:0:16787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787827058.257262:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827058.257336:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134292096 00000100:00100000:0.0:1787827058.257344:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134292096 00000100:00100000:0.0:1787827058.257404:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 149 00000100:00100000:0.0:1787827058.257415:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:20503:x1874672134292096:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:0.0:1787827058.257442:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827058.257502:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a79543e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c34675fb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787827058.257598:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787827058.257691:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a79543e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675fb expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.257723:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:0.0:1787827058.257727:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787827058.257732:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0400/0xc0fefc09a79543e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675fb expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.257746:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0400, rc 0) 00000100:00100000:0.0:1787827058.257798:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+13:20503:x1874672134292096:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 385us (551us total) trans 4294967398 rc 301/301 00000100:00100000:0.0:1787827058.257805:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 149 00000100:00100000:2.0:1787827058.259664:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827058.259709:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134292224 00000100:00100000:0.0:1787827058.259718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134292224 00000100:00100000:0.0:1787827058.259767:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:0.0:1787827058.259776:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+13:20503:x1874672134292224:12345-192.168.203.6@tcp:34:lfs.0 00010000:00010000:0.0:1787827058.259837:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259854:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259880:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259893:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259901:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259923:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259982:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259988:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.259992:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787827058.260018:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11:0x0]: returning size 5242880 00000004:00200000:0.0:1787827058.260020:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787827058.260028:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260043:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260050:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260057:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260063:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827058.260067:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260075:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260095:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:0.0:1787827058.260097:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827058.260102:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260109:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a79543f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260120:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260126:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260132:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260137:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827058.260140:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260147:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260153:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xad0f7562 (ffff8d54531bcb00) 00010000:00010000:0.0:1787827058.260156:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827058.260159:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260165:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1800/0xc0fefc09a79543fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260186:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260192:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260196:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260199:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827058.260201:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260204:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260209:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff8d54531bcd00) 00010000:00010000:0.0:1787827058.260211:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827058.260229:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827058.260234:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0000/0xc0fefc09a7954402 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827058.260291:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+13:20503:x1874672134292224:12345-192.168.203.6@tcp:34:lfs.0 Request processed in 516us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827058.260299:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:2.0:1787827058.261263:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827058.261369:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134292480 00000100:00100000:3.0:1787827058.261375:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134292480 00000100:00100000:3.0:1787827058.261413:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:3.0:1787827058.261421:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+13:20503:x1874672134292480:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:3.0:1787827058.261562:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+14:20503:x1874672134292480:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 141us (299us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787827058.261571:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:3.0:1787827058.268732:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827058.268801:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134292736 00000100:00100000:2.0:1787827058.268810:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134292736 00000100:00100000:2.0:1787827058.268876:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:2.0:1787827058.268886:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+14:20504:x1874672134292736:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1787827058.268923:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827058.268943:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7954409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467602 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827058.269037:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954410 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827058.269050:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827058.269060:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787827058.269086:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787827058.269179:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2600/0xc0fefc09a7954409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467602 expref: 17 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827058.269195:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3400/0xc0fefc09a7954410 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467602 expref: 16 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827058.269203:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827058.269206:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787827058.269209:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3400, rc 0) 00000100:00100000:2.0:1787827058.269306:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:20504:x1874672134292736:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 421us (582us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787827058.269313:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:2.0:1787827058.270451:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827058.270500:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134292864 00000100:00100000:1.0:1787827058.270505:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134292864 00000100:00100000:1.0:1787827058.270533:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 152 00000100:00100000:1.0:1787827058.270548:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+16:20504:x1874672134292864:12345-192.168.203.6@tcp:34:lfs.0 00010000:00010000:1.0:1787827058.270591:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270601:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270609:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270616:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270621:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270650:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270709:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270718:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270724:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787827058.270753:0:22268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x11:0x0]: returning size 5242880 00000004:00200000:1.0:1787827058.270757:0:22268:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787827058.270765:0:22268:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270774:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270778:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270782:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270786:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827058.270788:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270792:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270806:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827058.270808:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827058.270811:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270815:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795441e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270821:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270824:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270828:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270831:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827058.270833:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270836:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270840:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xad0f7562 (ffff8d54531bcb00) 00010000:00010000:1.0:1787827058.270841:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827058.270843:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270846:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954425 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270859:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270876:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270880:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270883:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827058.270885:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270888:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270893:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff8d54531bcd00) 00010000:00010000:1.0:1787827058.270894:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827058.270896:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827058.270899:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795442c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827058.270949:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+16:20504:x1874672134292864:12345-192.168.203.6@tcp:34:lfs.0 Request processed in 408us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827058.270957:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 152 00000100:00100000:1.0:1787827058.276859:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827058.276927:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134292992 00000100:00100000:2.0:1787827058.276941:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134292992 00002000:00100000:2.0:1787827058.276985:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x12:0x0] (4194304->5242879) req@ffff8d534243e1c0 x1874672134292992/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:659/0 lens 488/0 e 0 to 0 dl 1787827069 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827058.276996:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243e1c0 with x1874672134292992 ext(4194304->5242879) 00002000:00010000:2.0:1787827058.277001:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243e1c0 00000100:00100000:2.0:1787827058.277035:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 552 00000100:00100000:2.0:1787827058.277044:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134292992:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:2.0:1787827058.281765:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134292992:12345-192.168.203.6@tcp:4:dd.0 Request processed in 4712us (4903us total) trans 30064771559 rc 0/0 00000100:00100000:2.0:1787827058.281779:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 552 00002000:00100000:2.0:1787827058.281801:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x12:0x0] (4194304->5242879) req@ffff8d534243e1c0 x1874672134292992/t30064771559(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:659/0 lens 488/448 e 0 to 0 dl 1787827069 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827058.281811:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534243e1c0 with x1874672134292992 ext(4194304->5242879) 00002000:00010000:2.0:1787827058.281817:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534243e1c0 00000100:00100000:2.0:1787827058.769381:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787827058.769406:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534243d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143794432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827058.769470:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827058.769531:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794432 00000100:00100000:2.0:1787827058.769531:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143794176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827058.769541:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794432 00000100:00100000:2.0:1787827058.769560:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827058.769579:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143794304:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787827058.769589:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827058.769598:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827058.769599:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794176 00000100:00100000:1.0:1787827058.769607:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794176 00000100:00100000:0.0:1787827058.769608:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794304 00000100:00100000:0.0:1787827058.769625:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794304 00000100:00100000:2.0:1787827058.769638:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787827058.769652:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143794432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787827058.769674:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827058.769677:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787827058.769687:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143794176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787827058.769715:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827058.769726:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143794432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827058.769735:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00080000:3.0:1787827058.769768:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534243d680 x1874672143794432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827058.769775:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143794176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827058.769790:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787827058.769801:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534243d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143794432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827058.769818:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143794176:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787827058.769939:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827058.769947:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787827058.769956:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143794304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787827058.769968:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827058.770003:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143794304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827058.770010:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00080000:3.0:1787827058.770024:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53439c3840 x1874672143794304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827058.770034:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53439c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143794304:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787827058.897401:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827059.281512:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143794560:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.281579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.281697:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794560 00000100:00100000:1.0:1787827059.281703:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794560 00000100:00100000:1.0:1787827059.281763:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1787827059.281772:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143794560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827059.281919:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143794944:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.281919:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143794560:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.281945:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143795072:0@lo:400:kworker.0 00000100:00100000:2.0:1787827059.281981:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143794688:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282009:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143794560:12345-0@lo:400:kworker.0 Request processed in 238us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.282016:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1787827059.282059:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143794816:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282083:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.282101:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143795328:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282117:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.282130:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143795840:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282145:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.282168:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795328 00000100:00100000:1.0:1787827059.282171:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795328 00000100:00100000:1.0:1787827059.282191:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795840 00000100:00100000:1.0:1787827059.282193:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795840 00000100:00100000:1.0:1787827059.282208:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787827059.282231:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143795328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282269:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143795328:12345-0@lo:400:kworker.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.282282:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787827059.282293:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787827059.282297:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143795840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282323:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143795840:12345-0@lo:400:kworker.0 Request processed in 26us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.282329:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:1.0:1787827059.282364:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a33c00 x1874672143795328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827059.282375:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143795328:0@lo:400:kworker.0 00010000:00080000:1.0:1787827059.282382:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b0b40 x1874672143795840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827059.282389:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143795840:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282414:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794816 00000100:00100000:1.0:1787827059.282417:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794816 00000100:00100000:1.0:1787827059.282436:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787827059.282447:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143794816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282484:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534243c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143794816:12345-0@lo:400:kworker.0 Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.282490:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787827059.282514:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143794816:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.282555:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827059.282567:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827059.282593:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143795584:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282607:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795072 00000100:00100000:1.0:1787827059.282610:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795072 00000100:00100000:1.0:1787827059.282635:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787827059.282641:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143795072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.282792:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.282802:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143795072:12345-0@lo:400:kworker.0 Request processed in 162us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.282809:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787827059.282813:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143796096:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.282835:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794944 00000100:00100000:3.0:1787827059.282835:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.282839:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794944 00000100:00100000:3.0:1787827059.282868:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143795072:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.282879:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787827059.282885:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143795456:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.282905:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.282934:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795584 00000100:00100000:1.0:1787827059.282937:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795584 00000100:00100000:3.0:1787827059.282941:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143795968:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.282960:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.282961:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796096 00000100:00100000:1.0:1787827059.282964:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796096 00000100:00100000:1.0:1787827059.282975:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795456 00000100:00100000:1.0:1787827059.282978:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795456 00000100:00100000:3.0:1787827059.282985:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795968 00000100:00100000:3.0:1787827059.282988:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795968 00000100:00100000:1.0:1787827059.282991:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1787827059.282996:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143794944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.283005:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1787827059.283010:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143795584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.283028:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53439c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143794944:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.283034:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1787827059.283037:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143795584:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827059.283043:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1787827059.283057:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1787827059.283060:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1787827059.283063:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143796096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.283065:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143795456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.283090:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143795456:12345-0@lo:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.283091:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143796096:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.283096:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1787827059.283104:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1787827059.283107:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1787827059.283112:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143795968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.283128:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143795456:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.283137:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143795968:12345-0@lo:400:kworker.0 Request processed in 25us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827059.283137:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143795968:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.283143:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00010000:00080000:3.0:1787827059.283146:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b3840 x1874672143796096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827059.283155:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143796096:0@lo:400:kworker.0 00000100:00080000:1.0:1787827059.283158:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787827059.283163:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d2b03c0 x1874672143795584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827059.283166:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827059.283170:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143795584:0@lo:400:kworker.0 00000100:00100000:2.0:1787827059.283247:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827059.283262:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143794944:0@lo:400:kworker.0 00000100:00100000:2.0:1787827059.283274:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143795200:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.283285:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143794688 00000100:00100000:3.0:1787827059.283289:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143794688 00000100:00100000:2.0:1787827059.283298:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827059.283310:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1787827059.283316:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827059.283320:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143795712:0@lo:400:kworker.0 00000100:00100000:2.0:1787827059.283340:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.283363:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795200 00000100:00100000:1.0:1787827059.283370:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795200 00000100:00100000:3.0:1787827059.283410:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143794688:12345-0@lo:400:kworker.0 Request processed in 93us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.283412:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143795712 00000100:00100000:1.0:1787827059.283417:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143795712 00000100:00100000:3.0:1787827059.283422:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1787827059.283439:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143794688:0@lo:400:kworker.0 00000100:00100000:1.0:1787827059.283451:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787827059.283459:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787827059.283464:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143795200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.283473:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143795712:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787827059.283543:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827059.283580:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143795200:12345-0@lo:400:kworker.0 Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.283588:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787827059.283593:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3618:x1874672143795712:12345-0@lo:400:kworker.0 Request processed in 122us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827059.283596:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143795200:0@lo:400:kworker.0 00000100:00100000:3.0:1787827059.283601:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787827059.283608:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143795712:0@lo:400:kworker.0 00000100:00100000:2.0:1787827059.793453:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143796224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827059.793527:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827059.793577:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796224 00000100:00100000:1.0:1787827059.793585:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796224 00000100:00100000:1.0:1787827059.793641:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787827059.793652:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143796224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787827059.793692:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827059.793747:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143796224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827059.793756:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787827059.793785:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143796224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787827059.921974:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827060.945388:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827061.330334:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827061.330354:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143796352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827061.330413:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827061.330474:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796352 00000100:00100000:3.0:1787827061.330482:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796352 00000100:00100000:1.0:1787827061.330572:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143796480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827061.330576:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787827061.330589:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143796352:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827061.330607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787827061.330619:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 490209856 pending 5292032 free 3918270464 avail 3686748160 00000100:00100000:1.0:1787827061.330640:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796480 00000100:00100000:1.0:1787827061.330645:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796480 00000100:00100000:3.0:1787827061.330672:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143796352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827061.330677:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787827061.330686:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787827061.330689:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143796480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787827061.330702:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 490209856 pending 5292032 free 3918270464 avail 3686748160 00000100:00100000:3.0:1787827061.330741:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d2b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143796352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827061.330742:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672143796480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827061.330754:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787827061.330796:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143796480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787827061.330854:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787827061.969384:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827062.993941:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827063.186915:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827063.186989:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827063.187023:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827063.187053:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827063.187100:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134293504 00000100:00100000:3.0:1787827063.187105:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827063.187115:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134293504 00000100:00100000:3.0:1787827063.187149:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134293248 00000100:00100000:3.0:1787827063.187157:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134293248 00000100:00100000:2.0:1787827063.187211:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134293632 00000100:00100000:3.0:1787827063.187255:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134293376 00000100:00100000:3.0:1787827063.187261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134293376 00000100:00100000:2.0:1787827063.187264:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134293632 00000100:00100000:3.0:1787827063.187298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 494 00000100:00100000:2.0:1787827063.187312:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 248 00000100:00100000:3.0:1787827063.187328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134293248:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827063.187329:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134293504:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827063.187428:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2392:x1874672134293504:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 105us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827063.187437:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 248 00000100:00100000:0.0:1787827063.187443:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134293120 00000100:00100000:0.0:1787827063.187449:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134293120 00000100:00100000:2.0:1787827063.187459:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 249 00000100:00100000:2.0:1787827063.187470:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134293632:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827063.187484:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 547 00000100:00100000:0.0:1787827063.187492:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134293120:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827063.187508:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 495 00000100:00100000:1.0:1787827063.187522:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134293376:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827063.187568:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+16:2393:x1874672134293248:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 242us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827063.187569:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134293376:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827063.187594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 494 00000100:00080000:3.0:1787827063.187659:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787827063.187665:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827063.187668:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787827063.187669:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827063.188425:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134293120:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 929us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827063.188425:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134293632:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 952us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827063.188439:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 547 00000100:00100000:2.0:1787827063.188455:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 249 00000100:00100000:1.0:1787827063.188609:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 495 00000100:00100000:3.0:1787827063.493580:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827063.493646:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134293760 00000100:00100000:2.0:1787827063.493720:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134293760 00000100:00100000:2.0:1787827063.493782:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 153 00000100:00100000:2.0:1787827063.493792:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:20590:x1874672134293760:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787827063.493838:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827063.493918:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+16:20590:x1874672134293760:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 117us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827063.493928:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 153 00000100:00100000:3.0:1787827063.495007:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827063.495078:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134293888 00000100:00100000:1.0:1787827063.495084:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134293888 00000100:00100000:1.0:1787827063.495127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:1.0:1787827063.495137:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:20590:x1874672134293888:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787827063.495159:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827063.495246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:20590:x1874672134293888:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827063.495256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 154 00000100:00100000:3.0:1787827063.497101:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827063.497335:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294016 00000100:00100000:0.0:1787827063.497342:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294016 00000100:00100000:0.0:1787827063.497372:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 283 00000100:00100000:0.0:1787827063.497378:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+10:20590:x1874672134294016:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:0.0:1787827063.497403:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 490209856 pending 5292032 free 3918270464 avail 3686748160 00000100:00100000:0.0:1787827063.497456:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+10:20590:x1874672134294016:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 77us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827063.497562:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 283 00000100:00100000:2.0:1787827063.498484:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827063.498575:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294144 00000100:00100000:1.0:1787827063.498582:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294144 00000100:00100000:1.0:1787827063.498622:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 284 00000100:00100000:1.0:1787827063.498631:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:20590:x1874672134294144:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787827063.498655:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827063.498703:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d2b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:20590:x1874672134294144:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827063.498710:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 284 00000100:00100000:1.0:1787827063.889499:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143796864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827063.889522:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143796736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827063.889562:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827063.889582:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827063.889633:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547faca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143796608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827063.889644:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796864 00000100:00100000:1.0:1787827063.889659:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796864 00000100:00100000:0.0:1787827063.889678:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827063.889706:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796736 00000100:00100000:1.0:1787827063.889715:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787827063.889718:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796736 00000100:00100000:0.0:1787827063.889723:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796608 00000100:00100000:1.0:1787827063.889726:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143796864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827063.889730:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796608 00000004:00000024:1.0:1787827063.889750:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827063.889795:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143796864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827063.889814:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00080000:2.0:1787827063.889817:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827063.889839:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787827063.889847:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143796736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827063.889856:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143796608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787827063.889874:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787827063.889881:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827063.889888:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787827063.889924:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143796608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827063.889931:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787827063.889966:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143796864:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1787827063.889979:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547faca1c0 x1874672143796608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827063.889981:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453335680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143796736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (404us total) trans 0 rc 0/0 00010000:00080000:2.0:1787827063.889994:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533352c0 x1874672143796736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827063.890010:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787827063.890036:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143796736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827063.890045:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547faca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143796608:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1787827063.890899:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00080000:1.0:1787827063.891081:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000001:00080000:3.0:1787827063.891200:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771559 is committed 00010000:00010000:0.0:1787827063.891206:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787827063.891267:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771557 is committed 00010000:00010000:0.0:1787827063.891298:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827063.891307:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827063.891314:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827063.891326:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827063.891334:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827063.891352:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xad0f7562 (ffff8d54531bcb00) 00010000:00010000:0.0:1787827063.891355:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827063.891359:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827063.891366:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1c00/0xc0fefc09a79543ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827064.018409:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787827064.160290:0:23392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: before_free: 7663128 after_dd_free: 7658008 took 0 seconds 00000100:00100000:3.0:1787827064.183872:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827064.183918:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294400 00000100:00100000:1.0:1787827064.183929:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294400 00000100:00100000:1.0:1787827064.183986:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 155 00000100:00100000:1.0:1787827064.183995:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+9:20726:x1874672134294400:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:1.0:1787827064.184039:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827064.184069:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a79543d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675ed expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184086:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff8d54531bcd00) 00010000:00010000:1.0:1787827064.184096:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827064.184116:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184129:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184138:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184148:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184159:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184163:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184275:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184284:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184302:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787827064.184555:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9344 00000004:00080000:1.0:1787827064.184567:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439047351676ns, next at 440047349071ns, rc = 0 00010000:00010000:1.0:1787827064.184628:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184638:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184646:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184654:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184660:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184678:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184704:0:6487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787827064.184720:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184726:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184731:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184736:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827064.184740:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184747:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184756:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff8d5458a66a00) 00010000:00010000:1.0:1787827064.184759:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787827064.184762:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184768:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954441 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184782:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184788:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184800:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184805:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827064.184808:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184814:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184835:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827064.184839:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827064.184841:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184847:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a7954433 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787827064.184857:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009f008ad reply state 00000000ad330430 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184870:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827064.184876:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xad0f7562 (ffff8d5458a66900) 00010000:00010000:1.0:1787827064.184878:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787827064.184880:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:1.0:1787827064.184893:0:6487:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=119, val=2147483648*** 00010000:00010000:3.0:1787827064.185158:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827064.185165:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827064.185172:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113c00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787827064.185176:0:10301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827064.185182:0:10301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827064.185191:0:10301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff8d5458a66a00) 00010000:00010000:3.0:1787827064.185193:0:10301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787827064.185195:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827064.185198:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113c00/0xc0fefc09a7954448 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827064.185228:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827064.185230:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827064.185232:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:1.0:1787827064.187250:0:6487:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8d547fac83c0 x1874672134294400/t4294967401(0) o36->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:665/0 lens 504/456 e 0 to 0 dl 1787827075 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827064.197137:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:20726:x1874672134294400:12345-192.168.203.6@tcp:36:rm.0 Request processed in 13136us (13265us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787827064.197149:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 155 00000100:00100000:0.0:1787827064.401427:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143797120:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.401430:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143796992:0@lo:400:kworker.0 00000100:00100000:2.0:1787827064.401460:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143797248:0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.401497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827064.401497:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827064.401520:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827064.401557:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143797632:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.401557:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143797504:0@lo:400:kworker.0 00000100:00100000:2.0:1787827064.401563:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbf70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143797760:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.401589:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827064.401608:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827064.401613:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143798016:0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.401616:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143797120 00000100:00100000:0.0:1787827064.401622:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143797120 00000100:00100000:3.0:1787827064.401642:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827064.401650:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787827064.401660:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143797376:0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.401675:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798016 00000100:00100000:3.0:1787827064.401676:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143796992 00000100:00100000:3.0:1787827064.401680:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143796992 00000100:00100000:0.0:1787827064.401681:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798016 00000100:00100000:2.0:1787827064.401690:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827064.401714:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143797376 00000100:00100000:3.0:1787827064.401715:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1787827064.401717:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143797376 00000100:00100000:2.0:1787827064.401720:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143797888:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.401727:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143796992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.401741:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1787827064.401749:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143797120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827064.401763:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827064.401777:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143796992:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827064.401779:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143797120:12345-0@lo:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827064.401787:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1787827064.401787:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1787827064.401807:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143797888 00000100:00100000:0.0:1787827064.401810:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143797888 00000100:00100000:2.0:1787827064.401818:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143798272:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.401833:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143797248 00000100:00100000:1.0:1787827064.401835:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143798400:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.401838:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143797248 00000100:00100000:0.0:1787827064.401842:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1787827064.401851:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143798016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827064.401868:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827064.401869:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143797504 00000100:00100000:3.0:1787827064.401873:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143797504 00000100:00100000:1.0:1787827064.401884:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827064.401901:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787827064.401903:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143798016:12345-0@lo:400:kworker.0 Request processed in 53us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827064.401909:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1787827064.401909:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143797248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.401923:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798400 00000100:00100000:0.0:1787827064.401925:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798400 00000100:00100000:0.0:1787827064.401941:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1787827064.401944:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143797248:12345-0@lo:400:kworker.0 Request processed in 37us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827064.401947:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143797376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.401950:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787827064.401970:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787827064.401976:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143797376:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827064.401976:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143797504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.401982:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1787827064.401995:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1787827064.402003:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1787827064.402003:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143797504:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827064.402009:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143797888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.402012:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143798400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402012:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787827064.402059:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143798400:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827064.402059:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143798528:0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.402068:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1787827064.402069:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143797888:12345-0@lo:400:kworker.0 Request processed in 63us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827064.402078:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1787827064.402088:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827064.402100:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798528 00000100:00100000:2.0:1787827064.402103:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143797760 00000100:00100000:1.0:1787827064.402105:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798528 00000100:00100000:2.0:1787827064.402109:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143797760 00000100:00100000:0.0:1787827064.402110:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143798400:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402113:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143797504:0@lo:400:kworker.0 00010000:00080000:3.0:1787827064.402125:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c5a40 x1874672143798016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827064.402136:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143798016:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402145:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143796992:0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.402156:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798272 00000100:00100000:0.0:1787827064.402159:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798272 00000100:00100000:2.0:1787827064.402164:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787827064.402175:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143797760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.402191:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787827064.402200:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143798272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402200:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1787827064.402210:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143798528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827064.402242:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143797760:12345-0@lo:400:kworker.0 Request processed in 68us (633us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827064.402252:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827064.402252:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1787827064.402259:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827064.402265:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143798272:12345-0@lo:400:kworker.0 Request processed in 64us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827064.402272:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143798528:12345-0@lo:400:kworker.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827064.402282:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827064.402286:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787827064.402286:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1787827064.402303:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143797632 00000100:00100000:0.0:1787827064.402307:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143797632 00010000:00080000:2.0:1787827064.402310:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533e4f00 x1874672143798272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827064.402316:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143798144:0@lo:400:kworker.0 00010000:00080000:3.0:1787827064.402324:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5341f60000 x1874672143798528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827064.402330:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143798272:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402344:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5341f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143798528:0@lo:400:kworker.0 00000100:00100000:1.0:1787827064.402353:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827064.402355:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787827064.402356:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143797376:0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.402378:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143797632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402378:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798144 00000100:00100000:3.0:1787827064.402382:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798144 00000100:00100000:1.0:1787827064.402392:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143797120:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402408:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787827064.402416:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143797632:12345-0@lo:400:kworker.0 Request processed in 43us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827064.402416:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143798144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827064.402419:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143797632:0@lo:400:kworker.0 00000100:00100000:0.0:1787827064.402427:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787827064.402460:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143797888:0@lo:400:kworker.0 00000100:00100000:3.0:1787827064.402471:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143798144:12345-0@lo:400:kworker.0 Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827064.402479:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787827064.402482:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771557 gen 2 00010000:00080000:2.0:1787827064.402483:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbf70c0 x1874672143797760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827064.402496:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbf70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143797760:0@lo:400:kworker.0 00000100:00080000:3.0:1787827064.402497:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827064.402498:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143798144:0@lo:400:kworker.0 00000100:00100000:2.0:1787827064.402517:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143797248:0@lo:400:kworker.0 00000100:00100000:2.0:1787827064.914633:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143798656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827064.914707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827064.914783:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798656 00000100:00100000:3.0:1787827064.914791:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798656 00000100:00100000:3.0:1787827064.914850:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787827064.914860:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143798656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827064.914891:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827064.915746:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143798656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 887us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827064.915755:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787827064.915829:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143798656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787827065.041378:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827066.065379:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787827066.449444:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441312226814ns, next at 442312224049ns, rc = 0 00000100:00100000:3.0:1787827066.449516:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143798784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827066.449570:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827066.449631:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798784 00000100:00100000:2.0:1787827066.449672:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798784 00000100:00100000:3.0:1787827066.449675:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787827066.449685:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5444f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143798912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827066.449712:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827066.449827:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143798912 00000100:00100000:2.0:1787827066.449833:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143798912 00000100:00100000:2.0:1787827066.449874:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787827066.449888:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143798784:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787827066.449898:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787827066.449928:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3918270464 avail 3686748160 00000100:00100000:3.0:1787827066.449937:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787827066.449952:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143798912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827066.449977:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3918270464 avail 3686748160 00000100:00100000:1.0:1787827066.450072:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143798784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827066.450142:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143798784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 256us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827066.450151:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787827066.450208:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143798912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827066.450238:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787827066.450343:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5444f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143798912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787827067.089492:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827068.113393:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827068.305664:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827068.305712:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827068.305750:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827068.305785:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294528 00000100:00100000:2.0:1787827068.305786:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827068.305811:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294528 00000100:00100000:1.0:1787827068.305828:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294912 00000100:00100000:1.0:1787827068.305834:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294912 00000100:00100000:2.0:1787827068.305840:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827068.305877:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 549 00000100:00100000:0.0:1787827068.305889:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134294528:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827068.305902:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295040 00000100:00100000:1.0:1787827068.305906:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295040 00000100:00100000:2.0:1787827068.305925:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:2.0:1787827068.305937:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134294912:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827068.305949:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 255 00000100:00100000:1.0:1787827068.305960:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134295040:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827068.305987:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134294528:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827068.305991:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134294912:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 55us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827068.306004:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 549 00000100:00100000:2.0:1787827068.306004:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:1.0:1787827068.306012:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134295040:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 53us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827068.306024:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 255 00000100:00100000:2.0:1787827068.306061:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294656 00000100:00100000:3.0:1787827068.306065:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294784 00000100:00080000:1.0:1787827068.306066:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827068.306067:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294656 00000100:00080000:1.0:1787827068.306073:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827068.306095:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294784 00000100:00080000:1.0:1787827068.306108:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827068.306119:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827068.306128:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 502 00000100:00100000:2.0:1787827068.306143:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134294656:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827068.306170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 503 00000100:00100000:2.0:1787827068.306184:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2390:x1874672134294656:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827068.306187:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134294784:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827068.306196:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 502 00000100:00100000:1.0:1787827068.306298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134294784:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 110us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827068.306306:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 503 00000100:00100000:0.0:1787827069.009403:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787827069.009426:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143799040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827069.009455:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787827069.009474:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143799296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827069.009509:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827069.009514:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.009562:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799296 00000100:00100000:1.0:1787827069.009576:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799296 00000100:00100000:0.0:1787827069.009591:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547faca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143799168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827069.009613:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799040 00000100:00100000:3.0:1787827069.009620:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799040 00000100:00100000:0.0:1787827069.009631:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787827069.009649:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827069.009674:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799168 00000100:00100000:0.0:1787827069.009679:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799168 00000100:00100000:3.0:1787827069.009689:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787827069.009695:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787827069.009703:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143799040:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827069.009711:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143799296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827069.009726:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787827069.009738:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143799168:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1787827069.009740:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:0.0:1787827069.009757:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787827069.009767:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827069.009809:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143799040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827069.009819:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787827069.009845:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143799168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827069.009863:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787827069.009868:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143799040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827069.009871:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143799296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (352us total) trans 0 rc 0/0 00000100:00080000:3.0:1787827069.009875:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827069.009890:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00080000:1.0:1787827069.009901:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547faca940 x1874672143799168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827069.009921:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547faca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143799168:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787827069.009937:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fac9e00 x1874672143799296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827069.009956:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143799296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787827069.137361:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827069.521473:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143799552:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.521474:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143799680:0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.521549:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143799808:0@lo:400:kworker.0 00000100:00100000:2.0:1787827069.521631:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143799424:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.521711:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827069.521713:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.521749:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827069.521800:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143800192:0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.521804:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143800320:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.521838:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.521846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827069.521863:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143800704:0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.521875:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143800832:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.521892:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.521925:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827069.521936:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799552 00000100:00100000:3.0:1787827069.521942:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799552 00000100:00100000:1.0:1787827069.521966:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799808 00000100:00100000:1.0:1787827069.521972:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799808 00000100:00100000:3.0:1787827069.521983:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800320 00000100:00100000:3.0:1787827069.521988:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800320 00000100:00100000:1.0:1787827069.522002:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800832 00000100:00100000:1.0:1787827069.522007:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800832 00000100:00100000:1.0:1787827069.522042:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1787827069.522055:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1787827069.522056:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143799552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522069:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143799808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522116:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143799552:12345-0@lo:400:kworker.0 Request processed in 66us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827069.522125:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5444f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143799808:12345-0@lo:400:kworker.0 Request processed in 58us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827069.522126:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1787827069.522137:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1787827069.522150:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1787827069.522159:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143800320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522162:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1787827069.522174:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522196:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143800320:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827069.522203:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1787827069.522256:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799680 00000100:00100000:3.0:1787827069.522260:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143800832:12345-0@lo:400:kworker.0 Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827069.522261:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799680 00000100:00100000:3.0:1787827069.522269:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1787827069.522291:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800192 00000100:00100000:3.0:1787827069.522294:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800192 00000100:00100000:1.0:1787827069.522305:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787827069.522309:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.522319:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143799680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522320:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800704 00000100:00100000:3.0:1787827069.522324:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800704 00000100:00100000:2.0:1787827069.522352:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143799936:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522352:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787827069.522362:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143800192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522373:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143799680:12345-0@lo:400:kworker.0 Request processed in 57us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827069.522388:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787827069.522394:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827069.522400:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143800192:12345-0@lo:400:kworker.0 Request processed in 39us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827069.522406:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787827069.522415:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799936 00000100:00100000:1.0:1787827069.522420:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799936 00000100:00100000:3.0:1787827069.522421:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787827069.522424:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143800448:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522433:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143800704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522455:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787827069.522461:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.522470:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143799936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522475:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143800704:12345-0@lo:400:kworker.0 Request processed in 42us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827069.522485:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143800960:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522487:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:3.0:1787827069.522509:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827069.522522:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.522529:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143799936:12345-0@lo:400:kworker.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827069.522538:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00080000:3.0:1787827069.522552:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e156940 x1874672143800192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827069.522567:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800448 00000100:00100000:0.0:1787827069.522573:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143799552:0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522574:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800448 00000100:00100000:3.0:1787827069.522579:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e156940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143800192:0@lo:400:kworker.0 00000100:00100000:2.0:1787827069.522588:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143799936:0@lo:400:kworker.0 00010000:00080000:3.0:1787827069.522597:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c9e00 x1874672143800704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827069.522600:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbf70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143800064:0@lo:400:kworker.0 00000100:00100000:3.0:1787827069.522608:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143800704:0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800960 00000100:00100000:1.0:1787827069.522617:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800960 00000100:00100000:2.0:1787827069.522623:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143799424 00000100:00100000:3.0:1787827069.522623:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143799680:0@lo:400:kworker.0 00000100:00100000:2.0:1787827069.522628:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143799424 00000100:00100000:0.0:1787827069.522634:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.522652:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1787827069.522662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143800448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827069.522670:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143800576:0@lo:400:kworker.0 00000100:00100000:2.0:1787827069.522671:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1787827069.522686:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143799424:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787827069.522688:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827069.522703:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1787827069.522705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827069.522713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143800448:12345-0@lo:400:kworker.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827069.522715:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143800960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1787827069.522742:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143799424:12345-0@lo:400:kworker.0 Request processed in 58us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827069.522748:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1787827069.522750:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800064 00000100:00100000:0.0:1787827069.522755:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800064 00000100:00100000:3.0:1787827069.522765:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143800960:12345-0@lo:400:kworker.0 Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827069.522774:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1787827069.522775:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143800320:0@lo:400:kworker.0 00000100:00100000:2.0:1787827069.522796:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143800576 00000100:00100000:2.0:1787827069.522800:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143800576 00000100:00100000:1.0:1787827069.522809:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143800832:0@lo:400:kworker.0 00000100:00100000:0.0:1787827069.522813:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787827069.522827:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143800064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827069.522832:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143799808:0@lo:400:kworker.0 00000100:00100000:2.0:1787827069.522838:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787827069.522856:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143800576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787827069.522864:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827069.522875:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143800064:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827069.522876:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143799424:0@lo:400:kworker.0 00000100:00100000:0.0:1787827069.522889:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:1.0:1787827069.522901:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492c83c0 x1874672143800448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827069.522911:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143800576:12345-0@lo:400:kworker.0 Request processed in 65us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827069.522918:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143800448:0@lo:400:kworker.0 00000100:00100000:2.0:1787827069.522922:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787827069.522929:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbf70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143800064:0@lo:400:kworker.0 00000100:00100000:0.0:1787827069.522952:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143800576:0@lo:400:kworker.0 00010000:00080000:1.0:1787827069.522953:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492cb840 x1874672143800960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827069.522967:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143800960:0@lo:400:kworker.0 00000100:00100000:2.0:1787827070.033603:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143801088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827070.033672:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827070.033727:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143801088 00000100:00100000:3.0:1787827070.033736:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143801088 00000100:00100000:3.0:1787827070.033795:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787827070.033805:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143801088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827070.033838:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827070.033906:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143801088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827070.033915:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787827070.033992:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143801088:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1787827070.034680:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000001:00080000:1.0:1787827070.034720:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1787827070.034725:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00010000:00010000:3.0:1787827070.034787:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.034799:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.034818:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.034825:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113800 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827070.034829:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.034838:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827070.034843:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787827070.034856:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xad0f7562 (ffff8d5458a66900) 00000100:00100000:2.0:1787827070.034857:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143801216:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787827070.034861:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787827070.034868:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.034875:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a795443a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827070.034898:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827070.034961:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143801216 00000100:00100000:3.0:1787827070.034966:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143801216 00000100:00100000:3.0:1787827070.035002:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787827070.035011:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143801216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787827070.035030:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:18 count 1 00010000:00010000:3.0:1787827070.035049:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.035067:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 5 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.035087:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x12:0x0].0x0 since=12s v=(0 0) 00010000:00010000:3.0:1787827070.035092:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787827070.035097:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.035121:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 5 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.035134:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 5 pid: 8399 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827070.035147:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547facb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1874672143801344:192.168.203.6@tcp:104: 00000100:00100000:3.0:1787827070.035207:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e1d2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787827070.036643:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547facb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1874672143801344:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787827070.036665:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827070.041320:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827070.041384:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295168 00000100:00100000:0.0:1787827070.041393:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295168 00010000:00010000:0.0:1787827070.041445:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 6 pid: 8399 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787827070.041446:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827070.041490:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 71 00000100:00100000:0.0:1787827070.041528:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547facb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134295168:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787827070.041545:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827070.041551:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 6 pid: 8399 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827070.041564:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 6 pid: 8399 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827070.041588:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8ff1fa/0xc0fefc09a79543df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675f4 expref: 6 pid: 8399 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827070.041603:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787827070.041616:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787827070.041622:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827070.041632:0:7428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827070.041662:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827070.041703:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827070.041715:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547facb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134295168:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 188us (401us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827070.041717:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827070.041731:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 71 00010000:00010000:1.0:1787827070.041734:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827070.041744:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827070.041763:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787827070.041804:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827070.041813:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.041825:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079600 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787827070.041836:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.041846:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.041858:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.041865:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529f0ddd/0xc0fefc09a795444f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827070.041884:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827070.041886:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827070.041887:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827070.041937:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143801216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6926us (7039us total) trans 30064771560 rc 0/0 00000100:00100000:1.0:1787827070.041946:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000004:00080000:2.0:1787827070.041974:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d534486d2c0/2, rc 0, transno 30064771560 00000100:00100000:2.0:1787827070.041980:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143801216:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787827070.163940:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827071.185344:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827071.569523:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143801472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827071.569606:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827071.569657:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143801472 00000100:00100000:1.0:1787827071.569666:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143801472 00000100:00100000:3.0:1787827071.569693:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143801600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827071.569730:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787827071.569731:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827071.569745:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143801472:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787827071.569765:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787827071.569808:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827071.569833:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143801600 00000100:00100000:0.0:1787827071.569839:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143801600 00000100:00100000:1.0:1787827071.569865:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143801472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827071.569872:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787827071.569883:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787827071.569902:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547faca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143801600:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787827071.569912:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827071.569913:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143801472:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787827071.569918:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827071.569964:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547faca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143801600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827071.569977:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787827071.569990:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143801600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787827072.209362:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827073.233367:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827073.425156:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827073.425201:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827073.425254:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295424 00000100:00100000:2.0:1787827073.425270:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295424 00000100:00100000:0.0:1787827073.425318:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00080000:1.0:1787827073.425324:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827073.425330:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295552 00000100:00100000:2.0:1787827073.425334:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295552 00000100:00100000:1.0:1787827073.425351:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 510 00000100:00100000:0.0:1787827073.425361:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827073.425371:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134295424:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827073.425373:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 511 00000100:00100000:2.0:1787827073.425391:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134295552:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827073.425407:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827073.425463:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134295424:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827073.425463:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134295552:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827073.425465:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827073.425477:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 511 00000100:00100000:1.0:1787827073.425489:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 510 00000100:00100000:2.0:1787827073.425517:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295680 00000100:00100000:2.0:1787827073.425535:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295680 00000100:00100000:1.0:1787827073.425548:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295808 00000100:00100000:1.0:1787827073.425554:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295808 00000100:00080000:0.0:1787827073.425591:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827073.425595:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827073.425649:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 260 00000100:00100000:1.0:1787827073.425658:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 261 00000100:00100000:2.0:1787827073.425663:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134295680:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827073.425671:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134295808:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827073.425713:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134295808:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827073.425715:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134295680:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827073.425718:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295296 00000100:00100000:3.0:1787827073.425725:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295296 00000100:00100000:1.0:1787827073.425730:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 261 00000100:00100000:2.0:1787827073.425737:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 260 00000100:00100000:3.0:1787827073.425782:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 551 00000100:00100000:3.0:1787827073.425793:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134295296:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827073.425832:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134295296:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827073.425841:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 551 00000100:00100000:2.0:1787827074.129451:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143801984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827074.129518:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827074.129572:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143801984 00000100:00100000:0.0:1787827074.129580:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143801984 00000100:00100000:2.0:1787827074.129593:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827074.129607:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545aa7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143801728:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787827074.129614:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827074.129625:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787827074.129637:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143801856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827074.129639:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827074.129650:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787827074.129661:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143801984:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827074.129670:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787827074.129691:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827074.129691:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143801728 00000100:00100000:2.0:1787827074.129697:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143801728 00000100:00100000:1.0:1787827074.129708:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143801856 00000100:00100000:1.0:1787827074.129711:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143801856 00000100:00100000:2.0:1787827074.129735:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787827074.129743:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143801728:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827074.129746:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787827074.129766:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143801984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827074.129770:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143801856:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:2.0:1787827074.129779:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827074.129783:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00002000:00000024:1.0:1787827074.129785:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787827074.129818:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827074.129832:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143801728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827074.129840:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787827074.129841:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545aa7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143801728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827074.129841:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143801856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827074.129855:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00080000:0.0:1787827074.129873:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fac8000 x1874672143801984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787827074.129887:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d54533e6580 x1874672143801856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827074.129890:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143801984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827074.129911:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143801856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787827074.257832:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827074.641892:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143802112:0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.641941:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143802368:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.641963:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827074.641975:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143802496:0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.641995:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827074.642014:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827074.642016:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143802624:0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.642027:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143802880:0@lo:400:kworker.0 00000100:00100000:1.0:1787827074.642040:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143803008:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642040:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827074.642057:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143803136:0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.642066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827074.642071:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827074.642102:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827074.642122:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143803520:0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.642132:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143803392:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642139:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143803648:0@lo:400:kworker.0 00000100:00100000:1.0:1787827074.642145:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827074.642194:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143802496 00000100:00100000:3.0:1787827074.642196:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143802240:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642200:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143802496 00000100:00100000:3.0:1787827074.642258:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143802112 00000100:00100000:3.0:1787827074.642262:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143802112 00000100:00100000:2.0:1787827074.642267:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803008 00000100:00100000:2.0:1787827074.642269:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803008 00000100:00100000:3.0:1787827074.642290:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1787827074.642291:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803136 00000100:00100000:2.0:1787827074.642294:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803136 00000100:00100000:3.0:1787827074.642299:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143802112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642304:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803520 00000100:00100000:2.0:1787827074.642306:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803520 00000100:00100000:2.0:1787827074.642318:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1787827074.642324:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143802496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642367:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143802496:12345-0@lo:400:kworker.0 Request processed in 42us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827074.642373:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1787827074.642376:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143802496:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642389:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1787827074.642400:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143803008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.642404:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827074.642454:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143802112:12345-0@lo:400:kworker.0 Request processed in 153us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827074.642456:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143803008:12345-0@lo:400:kworker.0 Request processed in 62us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827074.642462:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1787827074.642462:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1787827074.642490:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1787827074.642496:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143803136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.642502:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1787827074.642520:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143803520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642533:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143803136:12345-0@lo:400:kworker.0 Request processed in 37us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827074.642562:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143802880 00000100:00100000:1.0:1787827074.642566:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143802880 00000100:00100000:0.0:1787827074.642574:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143803520:12345-0@lo:400:kworker.0 Request processed in 59us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827074.642584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1787827074.642595:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143802368 00000100:00100000:3.0:1787827074.642599:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143802368 00000100:00100000:0.0:1787827074.642620:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803392 00000100:00100000:0.0:1787827074.642627:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803392 00000100:00100000:3.0:1787827074.642628:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143802624 00000100:00100000:3.0:1787827074.642633:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143802624 00000100:00100000:3.0:1787827074.642661:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787827074.642669:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143802368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.642682:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787827074.642694:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143803392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642696:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1787827074.642712:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143802368:12345-0@lo:400:kworker.0 Request processed in 44us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827074.642719:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787827074.642733:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787827074.642737:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143803008:0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.642739:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143802624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642759:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143803520:0@lo:400:kworker.0 00000100:00100000:0.0:1787827074.642779:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143803392:12345-0@lo:400:kworker.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827074.642789:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143802624:12345-0@lo:400:kworker.0 Request processed in 49us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827074.642790:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787827074.642805:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827074.642809:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787827074.642831:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d54533e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143802112:0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.642831:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803648 00000100:00100000:3.0:1787827074.642833:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803648 00000100:00100000:2.0:1787827074.642848:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143802624:0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.642860:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00010000:00080000:2.0:1787827074.642861:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa69680 x1874672143803136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827074.642866:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143803648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.642872:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143803136:0@lo:400:kworker.0 00000100:00080000:0.0:1787827074.642875:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827074.642881:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827074.642904:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143803648:12345-0@lo:400:kworker.0 Request processed in 38us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827074.642911:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00010000:00080000:0.0:1787827074.642921:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0fc000 x1874672143803392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827074.642951:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787827074.642957:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143802880:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787827074.642995:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5349265680 x1874672143803648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827074.643002:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827074.643005:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143803648:0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.643021:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143802752:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.643025:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143802240 00000100:00100000:2.0:1787827074.643028:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143802240 00000100:00100000:3.0:1787827074.643044:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827074.643046:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1787827074.643052:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547faca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143802240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.643058:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143803264:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.643079:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547faca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143802240:12345-0@lo:400:kworker.0 Request processed in 27us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827074.643085:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1787827074.643091:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827074.643108:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143802752 00000100:00100000:2.0:1787827074.643111:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143802752 00000100:00100000:3.0:1787827074.643116:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143802240:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.643133:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803264 00000100:00100000:3.0:1787827074.643136:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787827074.643137:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803264 00000100:00100000:0.0:1787827074.643140:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143803392:0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.643151:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143802752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.643158:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787827074.643162:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143802368:0@lo:400:kworker.0 00000100:00100000:2.0:1787827074.643169:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143803264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.643191:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143802752:12345-0@lo:400:kworker.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827074.643197:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787827074.643199:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e156940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143803264:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827074.643204:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1787827074.643244:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827074.643249:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143802752:0@lo:400:kworker.0 00000100:00100000:3.0:1787827074.643265:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143803264:0@lo:400:kworker.0 00000100:00100000:1.0:1787827074.643360:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143802880:12345-0@lo:400:kworker.0 Request processed in 400us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827074.643368:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00080000:0.0:1787827074.643379:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6bc00 x1874672143802880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827074.643391:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143802880:0@lo:400:kworker.0 00000100:00100000:2.0:1787827075.153688:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827075.153714:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143803776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827075.153793:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827075.153836:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803776 00000100:00100000:3.0:1787827075.153845:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803776 00000100:00100000:3.0:1787827075.153898:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787827075.153920:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143803776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827075.153963:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827075.154029:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143803776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827075.154036:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787827075.154077:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143803776:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787827075.281416:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787827076.179006:0:21538:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771560 is committed 00010000:00010000:3.0:1787827076.305399:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827076.689489:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143803904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827076.689593:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827076.689660:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143803904 00000100:00100000:3.0:1787827076.689671:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143803904 00000100:00100000:0.0:1787827076.689677:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143804032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827076.689708:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787827076.689729:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827076.689778:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804032 00000100:00100000:3.0:1787827076.689783:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804032 00000100:00100000:2.0:1787827076.689799:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787827076.689817:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1787827076.689829:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827076.689833:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143804032:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827076.689834:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143803904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787827076.689881:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923513344 avail 3691991040 00002000:00000024:2.0:1787827076.689882:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827076.689961:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143804032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827076.689975:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143803904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827076.689988:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787827076.689998:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143803904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827076.689999:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787827076.690010:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771560 gen 2 00000004:00080000:0.0:1787827076.690016:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d534486d2c0, transno 30064771560 00000100:00100000:0.0:1787827076.690031:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143804032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787827077.329434:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827078.353403:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827078.545518:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827078.545570:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827078.545617:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827078.545617:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134295936 00000100:00100000:2.0:1787827078.545633:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134295936 00000100:00100000:1.0:1787827078.545649:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296064 00000100:00100000:1.0:1787827078.545656:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296064 00000100:00100000:0.0:1787827078.545677:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827078.545714:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 553 00000100:00100000:3.0:1787827078.545717:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296320 00000100:00100000:2.0:1787827078.545740:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134295936:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827078.545741:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296320 00000100:00100000:1.0:1787827078.545747:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296192 00000100:00100000:1.0:1787827078.545755:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296192 00000100:00100000:1.0:1787827078.545818:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 518 00000100:00100000:2.0:1787827078.545837:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134295936:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827078.545838:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827078.545841:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134296064:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827078.545861:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 266 00000100:00100000:2.0:1787827078.545862:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 553 00000100:00100000:3.0:1787827078.545885:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134296320:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827078.545901:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134296064:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827078.545914:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 518 00000100:00100000:1.0:1787827078.545945:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 519 00000100:00100000:1.0:1787827078.545960:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134296192:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827078.545987:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296448 00000100:00100000:2.0:1787827078.545995:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296448 00000100:00100000:1.0:1787827078.546020:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134296192:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827078.546026:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134296320:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 132us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827078.546040:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 519 00000100:00100000:3.0:1787827078.546049:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 266 00000100:00100000:2.0:1787827078.546061:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 267 00000100:00100000:2.0:1787827078.546075:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134296448:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787827078.546105:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787827078.546115:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827078.546120:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787827078.546125:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827078.546132:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134296448:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827078.546140:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 267 00000100:00100000:0.0:1787827079.249374:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787827079.249374:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787827079.249408:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143804160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827079.249409:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143804416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827079.249508:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827079.249537:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804160 00000100:00100000:3.0:1787827079.249546:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804160 00000100:00080000:0.0:1787827079.249594:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827079.249617:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787827079.249630:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143804160:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827079.249654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787827079.249668:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827079.249706:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804416 00000100:00100000:0.0:1787827079.249711:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804416 00000100:00100000:2.0:1787827079.249733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143804288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827079.249740:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143804160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827079.249753:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787827079.249765:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787827079.249778:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827079.249785:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143804416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787827079.249796:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787827079.249824:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534355e940 x1874672143804160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827079.249832:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143804416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827079.249840:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787827079.249843:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804288 00000100:00100000:2.0:1787827079.249848:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804288 00000100:00100000:3.0:1787827079.249848:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143804160:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787827079.249856:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827079.249892:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787827079.249903:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143804288:12345-0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787827079.249908:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5349264000 x1874672143804416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827079.249923:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143804416:0@lo:13:osp-pre-1-0.0 00000004:00000024:2.0:1787827079.249937:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827079.249984:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54533e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143804288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827079.249991:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787827079.250020:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143804288:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787827079.377413:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827079.761480:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349267840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143804672:0@lo:400:kworker.0 00000100:00100000:3.0:1787827079.761491:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143804544:0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.761507:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143804800:0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.761564:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143804928:0@lo:400:kworker.0 00000100:00100000:2.0:1787827079.761599:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827079.761608:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827079.761648:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827079.761663:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804672 00000100:00100000:0.0:1787827079.761674:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804672 00000100:00100000:3.0:1787827079.761710:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349266940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143805056:0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.761723:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143805440:0@lo:400:kworker.0 00000100:00100000:2.0:1787827079.761724:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143805184:0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.761768:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1787827079.761788:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143804672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827079.761799:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827079.761812:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827079.761816:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804928 00000100:00100000:1.0:1787827079.761824:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804928 00000100:00100000:2.0:1787827079.761832:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143805696:0@lo:400:kworker.0 00000100:00100000:3.0:1787827079.761873:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143805568:0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.761888:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143804672:12345-0@lo:400:kworker.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827079.761892:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827079.761902:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787827079.761915:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1787827079.761922:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143804928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827079.761931:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804544 00000100:00100000:3.0:1787827079.761939:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804544 00000100:00100000:0.0:1787827079.761943:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805184 00000100:00100000:0.0:1787827079.761947:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805184 00000100:00100000:2.0:1787827079.761981:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349267840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143804672:0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.761996:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805696 00000100:00100000:0.0:1787827079.762000:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805696 00000100:00100000:3.0:1787827079.762017:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1787827079.762022:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143804928:12345-0@lo:400:kworker.0 Request processed in 105us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827079.762042:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143804544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.762044:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787827079.762056:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1787827079.762068:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1787827079.762079:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143805184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.762083:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143805696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827079.762108:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143804544:12345-0@lo:400:kworker.0 Request processed in 66us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827079.762115:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827079.762126:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1787827079.762172:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143805184:12345-0@lo:400:kworker.0 Request processed in 100us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827079.762182:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1787827079.762197:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143805696:12345-0@lo:400:kworker.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827079.762198:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143804928:0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.762274:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1787827079.762275:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827079.762282:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805056 00000100:00100000:3.0:1787827079.762283:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143805184:0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.762292:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805056 00000100:00100000:0.0:1787827079.762312:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805568 00000100:00100000:0.0:1787827079.762320:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805568 00010000:00080000:3.0:1787827079.762335:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6bc00 x1874672143805696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827079.762345:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143804544:0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.762347:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805440 00000100:00100000:3.0:1787827079.762354:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143805696:0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.762355:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805440 00000100:00100000:0.0:1787827079.762385:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1787827079.762404:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143805568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827079.762406:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787827079.762425:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787827079.762429:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143805056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.762441:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143805440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.762494:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143805568:12345-0@lo:400:kworker.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00080000:3.0:1787827079.762495:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787827079.762505:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827079.762507:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00080000:3.0:1787827079.762513:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827079.762517:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143805056:12345-0@lo:400:kworker.0 Request processed in 84us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827079.762524:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143805440:12345-0@lo:400:kworker.0 Request processed in 84us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827079.762532:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787827079.762541:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787827079.762547:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827079.762580:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534486d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143805568:0@lo:400:kworker.0 00000100:00100000:3.0:1787827079.762587:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349264780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143805312:0@lo:400:kworker.0 00000100:00100000:2.0:1787827079.762605:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143804800 00000100:00100000:2.0:1787827079.762610:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143804800 00000100:00100000:1.0:1787827079.762613:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143805440:0@lo:400:kworker.0 00000100:00100000:0.0:1787827079.762615:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349266940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143805056:0@lo:400:kworker.0 00000100:00100000:3.0:1787827079.762632:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827079.762656:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805312 00000100:00100000:2.0:1787827079.762660:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805312 00000100:00100000:1.0:1787827079.762677:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1787827079.762691:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143804800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787827079.762732:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827079.762744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1787827079.762759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143805312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827079.762772:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534355e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143804800:12345-0@lo:400:kworker.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827079.762783:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1787827079.762800:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143804800:0@lo:400:kworker.0 00000100:00100000:3.0:1787827079.762808:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5341f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143805312:12345-0@lo:400:kworker.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827079.762814:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00010000:00080000:0.0:1787827079.762824:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5349264780 x1874672143805312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827079.762835:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349264780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143805312:0@lo:400:kworker.0 00000100:00100000:1.0:1787827080.273408:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787827080.273432:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143805824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827080.273498:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827080.273546:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805824 00000100:00100000:0.0:1787827080.273565:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805824 00000100:00100000:0.0:1787827080.273613:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787827080.273620:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143805824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827080.273654:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827080.273707:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143805824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827080.273725:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787827080.273761:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143805824:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787827080.401304:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827080.611093:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827080.611131:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827080.611153:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296576 00000100:00100000:2.0:1787827080.611158:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827080.611163:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296576 00000100:00100000:3.0:1787827080.611182:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296960 00000100:00100000:2.0:1787827080.611184:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827080.611190:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296960 00000100:00100000:0.0:1787827080.611249:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 555 00000100:00100000:1.0:1787827080.611263:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296832 00000100:00100000:0.0:1787827080.611265:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134296576:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827080.611266:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827080.611279:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296832 00000100:00100000:3.0:1787827080.611279:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134297088 00000100:00100000:3.0:1787827080.611285:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134297088 00000100:00100000:2.0:1787827080.611298:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134296704 00000100:00100000:2.0:1787827080.611304:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134296704 00000100:00100000:3.0:1787827080.611332:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 270 00000100:00100000:1.0:1787827080.611334:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 526 00000100:00100000:0.0:1787827080.611343:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134296576:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827080.611343:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 527 00000100:00100000:3.0:1787827080.611350:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134296960:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827080.611351:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134296832:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827080.611361:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134296704:12345-192.168.203.6@tcp:38:kworker.0 00000100:00100000:0.0:1787827080.611371:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 555 00000100:00100000:3.0:1787827080.611389:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134296960:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 46us (255us total) trans 0 rc 0/0 00010000:02000400:2.0:1787827080.611393:0:22268:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 2313f4ee-480a-47b2-8d93-5bb216a57733 (at 192.168.203.6@tcp) reconnecting 00000100:00100000:3.0:1787827080.611403:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 270 00000100:00100000:1.0:1787827080.611415:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134296832:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827080.611419:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827080.611425:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 271 00000100:00080000:0.0:1787827080.611434:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827080.611438:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134297088:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787827080.611439:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827080.611439:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 526 00000100:00080000:0.0:1787827080.611444:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827080.611479:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134297088:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827080.611487:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 271 00010000:00080000:2.0:1787827080.615245:0:22268:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t4294967400 exp ffff8d547f846800 cur 455 last 1787827080 00000004:00100000:2.0:1787827080.615276:0:22268:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.203.6@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1787827080.615298:0:22268:0:(import.c:65:import_set_state_nolock()) ffff8d547f840800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1787827080.615306:0:22268:0:(import.c:65:import_set_state_nolock()) ffff8d547f840800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827080.615369:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2389:x1874672134296704:12345-192.168.203.6@tcp:38:kworker.0 Request processed in 4013us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827080.615378:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 527 00000100:00100000:2.0:1787827080.621411:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827080.621486:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134294400 00000100:00100000:1.0:1787827080.621497:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134294400 00000100:00100000:1.0:1787827080.621549:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 156 00000100:00100000:1.0:1787827080.621557:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:20726:x1874672134294400:12345-192.168.203.6@tcp:36:rm.0 00000004:00080000:1.0:1787827080.621618:0:10060:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff8d5349264780 x1874672134294400/t0(0) o36->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:681/0 lens 504/2888 e 0 to 0 dl 1787827091 ref 1 fl Interpret:/202/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000004:00000400:1.0:1787827080.621627:0:10060:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff8d5349264780 x1874672134294400/t4294967401(0) o36->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:681/0 lens 504/2888 e 0 to 0 dl 1787827091 ref 1 fl Interpret:/202/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827080.633176:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:20726:x1874672134294400:12345-192.168.203.6@tcp:36:rm.0 Request processed in 11613us (11769us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787827080.633186:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 156 00010000:00010000:3.0:1787827081.425294:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787827081.483427:0:23511:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787827081.483477:0:23511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.483491:0:23511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.483497:0:23511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.483502:0:23511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.483518:0:23511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787827081.483522:0:23511:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787827081.483535:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827081.483542:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787827081.483546:0:23511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1787827081.483548:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3200 already unused, calling callback (ffffffffc13fec20) 00000100:00100000:0.0:1787827081.483552:0:23511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:1.0:1787827081.483553:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787827081.483560:0:23511:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1787827081.483562:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827081.483576:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827081.483580:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787827081.483582:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787827081.483583:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1787827081.483584:0:23511:0:(import.c:65:import_set_state_nolock()) ffff8d53434cf800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787827081.483612:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827081.483617:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787827081.483633:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143805952:0@lo:39:umount.0 00010000:00010000:1.0:1787827081.483639:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827081.483651:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787827081.483651:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3200/0xc0fefc09a795425e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954265 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827081.483664:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827081.483666:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827081.483668:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143806080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787827081.483669:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827081.483730:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827081.483731:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827081.483766:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806080 00000100:00100000:1.0:1787827081.483772:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806080 00000100:00100000:3.0:1787827081.483775:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143805952 00000100:00100000:3.0:1787827081.483781:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143805952 00000100:00080000:0.0:1787827081.483810:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827081.483818:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787827081.483830:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143806080:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787827081.483842:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00010000:00010000:1.0:1787827081.483843:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787827081.483857:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143805952:12345-0@lo:39:umount.0 00010000:00010000:1.0:1787827081.483857:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d546e078600/0xc0fefc09a7954265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795425e expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827081.483872:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:0.0:1787827081.483881:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954281 00000100:00080000:0.0:1787827081.483890:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8d53444b2800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787827081.483906:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3618:x1874672143806080:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827081.483918:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1787827081.483931:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827081.483941:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143806080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787827081.483950:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143805952:12345-0@lo:39:umount.0 Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827081.483957:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000020:00000080:0.0:1787827081.483964:0:6487:0:(genops.c:885:class_export_put()) final put ffff8d5343596000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:2.0:1787827081.483966:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53434cf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787827081.483982:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143805952:0@lo:39:umount.0 00000020:00000080:1.0:1787827081.483992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343596000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1787827081.483995:0:23511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787827081.483999:0:23511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787827081.484004:0:23511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787827081.484028:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53444b2800 for lustre-MDT0000 00000100:00080000:3.0:1787827081.484869:0:23511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787827081.484872:0:23511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787827081.484875:0:23511:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787827081.484886:0:23511:0:(import.c:65:import_set_state_nolock()) ffff8d53434cb800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787827081.484925:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143806208:0@lo:39:umount.0 00000100:00100000:2.0:1787827081.484946:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827081.484981:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806208 00000100:00100000:3.0:1787827081.484986:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806208 00000100:00100000:3.0:1787827081.485024:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1787827081.485025:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827081.485034:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143806208:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787827081.485049:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795428f 00000100:00080000:3.0:1787827081.485056:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d53494c0000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787827081.485083:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827081.485109:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143806208:12345-0@lo:39:umount.0 Request processed in 77us (160us total) trans 0 rc 0/0 00010000:00080000:2.0:1787827081.485119:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a32940 x1874672143806208/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827081.485120:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787827081.485131:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d53434cb800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1787827081.485131:0:6485:0:(genops.c:885:class_export_put()) final put ffff8d53494c6800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00100000:2.0:1787827081.485144:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143806208:0@lo:39:umount.0 00000100:00080000:0.0:1787827081.485166:0:23511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787827081.485170:0:23511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000020:00000080:1.0:1787827081.485172:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53494c6800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:0.0:1787827081.485174:0:23511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787827081.485209:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53494c0000 for lustre-MDT0001 00010000:00010000:0.0:1787827081.486574:0:23511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486589:0:23511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486597:0:23511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486605:0:23511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486621:0:23511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787827081.486628:0:23511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486635:0:23511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827081.486639:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827081.486647:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486665:0:23511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486676:0:23511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827081.486684:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112000 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:3.0:1787827081.486688:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827081.486695:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827081.486696:0:23511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787827081.486712:0:23511:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1787827081.486729:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827081.486734:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787827081.486736:0:23511:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787827081.486742:0:23511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:1.0:1787827081.486742:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0200 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787827081.486747:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787827081.486748:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1787827081.486754:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:0.0:1787827081.486755:0:23511:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 10000000:00010000:1.0:1787827081.486763:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827081.486769:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787827081.486771:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787827081.486773:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787827081.486794:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827081.486798:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827081.486817:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827081.486822:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7a0200/0xc0fefc09a7954250 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954257 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827081.486836:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827081.486838:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827081.486839:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827081.486864:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143806336:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1787827081.486878:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827081.486884:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787827081.486886:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787827081.486888:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787827081.486904:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827081.486911:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787827081.486918:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827081.486924:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827081.486933:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5345112000/0xc0fefc09a795421f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a7954226 expref: -99 pid: 21537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827081.486942:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827081.486943:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827081.486946:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827081.486950:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143806464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787827081.486979:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827081.486991:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806336 00000100:00100000:2.0:1787827081.486998:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806336 00000100:00100000:1.0:1787827081.487020:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806464 00000100:00100000:1.0:1787827081.487024:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806464 00000100:00100000:2.0:1787827081.487062:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787827081.487069:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787827081.487075:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54516ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143806336:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787827081.487087:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143806464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787827081.487089:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827081.487103:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827081.487120:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d2a00/0xc0fefc09a7954226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a795421f expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827081.487122:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d546e079a00/0xc0fefc09a7954257 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7954250 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827081.487144:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787827081.487149:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827081.487199:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54516ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143806336:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827081.487203:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3617:x1874672143806464:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827081.487210:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787827081.487243:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787827081.487257:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143806336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787827081.487304:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143806464:0@lo:103:ldlm_bl.0 00002000:00000080:0.0:1787827081.488100:0:23511:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1787827081.488125:0:23511:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:1.0:1787827081.488518:0:23511:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1787827081.488526:0:23511:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d53444b4800 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 30064771559 stale:0 00000020:00080000:1.0:1787827081.488533:0:23511:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5478923800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 30064771560 stale:0 00000020:00080000:1.0:1787827081.488538:0:23511:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5478923000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:1.0:1787827081.488543:0:23511:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5342780000) has exports, disconnecting them 00000020:00080000:1.0:1787827081.488548:0:23511:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d53444b4800), last request at 1787827080 00000020:00000080:1.0:1787827081.488565:0:23511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954249 00000100:00080000:1.0:1787827081.488576:0:23511:0:(import.c:65:import_set_state_nolock()) ffff8d53494c2800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787827081.488609:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787827081.488633:0:23511:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d53444b4800): rc 0 00000020:00000080:1.0:1787827081.488637:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d53444b4800/2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00080000:1.0:1787827081.488676:0:23511:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5478923800), last request at 1787827079 00000020:00000080:1.0:1787827081.488679:0:23511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954242 00000100:00080000:1.0:1787827081.488683:0:23511:0:(import.c:65:import_set_state_nolock()) ffff8d5344bd8800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787827081.488694:0:23511:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5478923800): rc 0 00000020:00000080:1.0:1787827081.488696:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d5478923800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787827081.488718:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787827081.488728:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444b4800/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:0.0:1787827081.488765:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53494c2800 for lustre-OST0000 00000020:00080000:1.0:1787827081.488795:0:23511:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5478923000), last request at 1787827079 00000020:00000080:1.0:1787827081.488798:0:23511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795423b 00000100:00080000:1.0:1787827081.488803:0:23511:0:(import.c:65:import_set_state_nolock()) ffff8d53494c4800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787827081.488815:0:23511:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5478923000): rc 0 00000020:00000080:1.0:1787827081.488817:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d5478923000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1787827081.488834:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787827081.488839:0:23511:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5342780000) has no exports 00000020:00000080:0.0:1787827081.490504:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478923800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787827081.490537:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478923000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787827081.490558:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5344bd8800 for lustre-OST0000 00000020:00000080:0.0:1787827081.490562:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53494c4800 for lustre-OST0000 00000020:01000000:1.0:1787827081.490728:0:23511:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5343af8060 - data ffff8d5469b2cd80/ffff8d53492b8000 00000020:01000000:1.0:1787827081.490853:0:23511:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5343af8480 - data ffff8d5469b6dbd0/ffff8d546f6dc400 00100000:10000000:1.0:1787827081.505621:0:23511:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787827081.511029:0:23511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954234 00000020:00000080:1.0:1787827081.511041:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d5478926000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787827081.511057:0:23511:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5343808800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787827081.511061:0:23511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343808800 2 00000020:01000004:1.0:1787827081.511064:0:23511:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d5343808800 from lustre-OST0000 00000020:00000080:1.0:1787827081.511084:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787827081.511096:0:23511:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787827081.511098:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d5344bdb800/lustre-OST0000_UUID 00000020:00000080:1.0:1787827081.511101:0:23511:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5344bdb800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787827081.511107:0:23511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787827081.511154:0:23511:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1787827081.511165:0:23511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787827081.511169:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787827081.511176:0:23511:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787827081.511182:0:23511:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d53434cd000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787827081.511188:0:23511:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d5450e8b370) has exports, disconnecting them 00000020:00080000:1.0:1787827081.511193:0:23511:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d53434cd000), last request at 1787826926 00000020:00000080:1.0:1787827081.511197:0:23511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954273 00000020:00080000:1.0:1787827081.511207:0:23511:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d53434cd000): rc 0 00000020:00000080:1.0:1787827081.511211:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d53434cd000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787827081.511299:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478926000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787827081.511310:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53434cd000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787827081.512250:0:23511:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787827081.512255:0:23511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787827081.512259:0:23511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787827081.512269:0:23511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787827081.512312:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53434cf800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787827081.512475:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787827081.512483:0:23511:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787827081.512495:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d5343504800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787827081.512514:0:23511:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343504800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787827081.512521:0:23511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787827081.512583:0:23511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787827081.512587:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787827081.512594:0:23511:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787827081.512598:0:23511:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d547d17f800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787827081.512604:0:23511:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d5450e8cd28) has exports, disconnecting them 00000020:00080000:0.0:1787827081.512609:0:23511:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d547d17f800), last request at 1787826926 00000020:00000080:0.0:1787827081.512617:0:23511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954288 00000020:00080000:0.0:1787827081.512636:0:23511:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d547d17f800): rc 0 00000020:00000080:0.0:1787827081.512641:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d547d17f800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787827081.512659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d547d17f800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787827081.513718:0:23511:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787827081.513723:0:23511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787827081.513726:0:23511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787827081.513730:0:23511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787827081.513761:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53434cb800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787827081.513914:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787827081.513922:0:23511:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787827081.513926:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d53434cc000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787827081.513929:0:23511:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53434cc000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787827081.513934:0:23511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787827081.513997:0:23511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343808800 1 00000020:00000080:1.0:1787827081.514002:0:23511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954218 00000020:00000080:1.0:1787827081.514007:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d5344bda800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787827081.514013:0:23511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787827081.514021:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787827081.514026:0:23511:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787827081.514031:0:23511:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d53437f3370) has no exports 00000020:00000080:2.0:1787827081.514035:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5344bda800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787827081.529833:0:23511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787827081.529845:0:23511:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787827081.529849:0:23511:0:(genops.c:885:class_export_put()) final put ffff8d5343593000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787827081.529852:0:23511:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343593000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787827081.529857:0:23511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787827081.529946:0:23511:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d534260e800 00000020:02000400:1.0:1787827081.529983:0:23511:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:3.0:1787827081.809403:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143806592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827081.809486:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827081.809538:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806592 00000100:00100000:3.0:1787827081.809545:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806592 00000100:00100000:3.0:1787827081.809583:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787827081.809591:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143806592:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1787827081.809599:0:16591:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787827081.809639:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143806592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (153us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787827081.809646:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:02020000:3.0:1787827081.809710:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1787827081.811814:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143806720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827081.811858:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827081.811896:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806720 00000100:00100000:1.0:1787827081.811901:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806720 00000100:00100000:1.0:1787827081.811930:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787827081.811936:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3619:x1874672143806720:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1787827081.811944:0:8404:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787827081.811976:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3619:x1874672143806720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (116us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787827081.811982:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:02020000:1.0:1787827081.812015:0:3619:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787827081.812020:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787827081.812024:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787827081.812028:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787827081.823763:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787827081.823769:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787827081.823773:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1787827081.823783:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1787827081.823785:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787827081.823789:0:3618:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 302 00000100:00080000:3.0:1787827081.823795:0:3618:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787827081.823834:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547fa60b40 x1874672143806848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787827081.823876:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143806848:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1787827081.823945:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827081.823996:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806848 00000100:00100000:3.0:1787827081.824003:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806848 00000100:00100000:3.0:1787827081.824039:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787827081.824047:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143806848:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:3.0:1787827081.824076:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:1.0:1787827081.825842:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1787827081.825848:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787827081.825854:0:3619:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 302 00000100:00080000:1.0:1787827081.825861:0:3619:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787827081.825894:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d534479d680 x1874672143806976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787827081.825940:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143806976:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1787827081.825981:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827081.826018:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806976 00000100:00100000:0.0:1787827081.826024:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806976 00000100:00100000:0.0:1787827081.826053:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787827081.826060:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534486d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143806976:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:0.0:1787827081.826074:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787827081.826122:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534486d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143806976:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 60us (140us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787827081.826128:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:2.0:1787827081.826160:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827081.826167:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827081.826171:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143806976:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:3.0:1787827081.836506:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143806848:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 12454us (12557us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787827081.836517:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1787827081.836540:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827081.836548:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827081.836552:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143806848:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:3.0:1787827082.449496:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827083.473386:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827084.369398:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143807104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827084.369453:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827084.369507:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143807232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827084.369507:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143807104 00000100:00100000:3.0:1787827084.369518:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143807104 00000100:00100000:2.0:1787827084.369529:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827084.369556:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827084.369563:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143807232 00000100:00100000:0.0:1787827084.369569:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143807232 00000100:00080000:2.0:1787827084.369577:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827084.369595:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827084.369600:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787827084.369611:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143807104:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827084.369615:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787827084.369630:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5349264b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143807232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787827084.369642:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827084.369643:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143807360 00002000:00000024:2.0:1787827084.369646:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827084.369653:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143807360 00000100:00100000:0.0:1787827084.369696:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787827084.369705:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143807360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827084.369712:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349264b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143807232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827084.369716:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5349267840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143807104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827084.369726:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000004:00000024:0.0:1787827084.369730:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827084.369731:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:2.0:1787827084.369747:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787827084.369774:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fa61a40 x1874672143807104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827084.369782:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143807360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827084.369793:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787827084.369808:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143807104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827084.369817:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143807360:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787827084.369826:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5345ae2d00 x1874672143807232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827084.369836:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143807232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787827084.497371:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827084.881372:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143807616:0@lo:400:kworker.0 00000100:00100000:1.0:1787827084.881376:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143807488:0@lo:400:kworker.0 00000100:00100000:3.0:1787827084.881408:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143807744:0@lo:400:kworker.0 00000100:00080000:2.0:1787827084.881411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787827084.881422:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787827084.881426:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787827084.881433:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 456 00000100:00080000:2.0:1787827084.881439:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787827084.881447:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787827084.881451:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827084.881452:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827084.881473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143807616 00000100:00100000:2.0:1787827084.881476:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d534355f840 x1874672143808000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787827084.881480:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143807616 00000100:00080000:2.0:1787827084.881527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787827084.881530:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787827084.881532:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787827084.881534:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547facb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143808256:0@lo:400:kworker.0 00000100:00100000:3.0:1787827084.881535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00080000:2.0:1787827084.881539:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 456 00000100:00100000:1.0:1787827084.881541:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143808128:0@lo:400:kworker.0 00000100:00080000:2.0:1787827084.881545:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1787827084.881549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5347a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143807616:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787827084.881553:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787827084.881570:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f9df480 x1874672143808384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787827084.881580:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827084.881586:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143807872:0@lo:400:kworker.0 00000100:00100000:2.0:1787827084.881598:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534355f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143808000:0@lo:8:kworker.0 00000100:00100000:3.0:1787827084.881605:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5347a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143807616:12345-0@lo:400:kworker.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827084.881612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1787827084.881625:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808256 00000100:00100000:0.0:1787827084.881627:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143807616:0@lo:400:kworker.0 00000100:00100000:3.0:1787827084.881630:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808256 00000100:00100000:1.0:1787827084.881634:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827084.881643:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827084.881689:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143808384:0@lo:8:kworker.0 00000100:00100000:3.0:1787827084.881693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1787827084.881695:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143807872 00000100:00100000:1.0:1787827084.881700:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143807872 00000100:00100000:3.0:1787827084.881706:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143808256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827084.881721:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827084.881726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827084.881741:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787827084.881752:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143807872:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787827084.881770:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827084.881780:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808128 00000100:00100000:3.0:1787827084.881781:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874672143808256:12345-0@lo:400:kworker.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827084.881785:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808128 00000100:00100000:3.0:1787827084.881790:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1787827084.881802:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143807872:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827084.881808:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143807488 00000100:00100000:2.0:1787827084.881812:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143807488 00000100:00100000:1.0:1787827084.881813:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787827084.881819:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808000 00000100:00100000:3.0:1787827084.881823:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808000 00000100:00100000:0.0:1787827084.881830:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1787827084.881839:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143808128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827084.881850:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808384 00000100:00100000:2.0:1787827084.881851:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1787827084.881856:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808384 00000100:00100000:3.0:1787827084.881856:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787827084.881863:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143807488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827084.881864:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143808000:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787827084.881882:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143808128:12345-0@lo:400:kworker.0 Request processed in 44us (156us total) trans 0 rc 0/0 00010000:00020000:3.0:1787827084.881883:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787827084.881894:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787827084.881895:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1787827084.881902:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3618:x1874672143807488:12345-0@lo:400:kworker.0 Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827084.881906:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143808384:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787827084.881912:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1787827084.881925:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1874672143808000:12345-0@lo:8:kworker.0 Request processed in 61us (283us total) trans 0 rc -19/-19 00000100:00080000:0.0:1787827084.881926:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00020000:1.0:1787827084.881932:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787827084.881937:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787827084.881948:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827084.881951:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143808128:0@lo:400:kworker.0 00000100:00100000:3.0:1787827084.881964:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143807744 00000100:00100000:3.0:1787827084.881969:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143807744 00000100:00100000:0.0:1787827084.881971:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5349265680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143807488:0@lo:400:kworker.0 00000100:00100000:1.0:1787827084.881982:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143808384:12345-0@lo:8:kworker.0 Request processed in 78us (264us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787827084.881988:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787827084.882012:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00010000:00080000:0.0:1787827084.882019:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547facb480 x1874672143808256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787827084.882022:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787827084.882026:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143807744:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787827084.882030:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827084.882039:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534355f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143808000:0@lo:8:kworker.0 00000100:00100000:1.0:1787827084.882040:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143807872:0@lo:400:kworker.0 00000100:00100000:0.0:1787827084.882051:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547facb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874672143808256:0@lo:400:kworker.0 00000100:00080000:2.0:1787827084.882057:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827084.882062:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827084.882066:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143808384:0@lo:8:kworker.0 00000100:00100000:3.0:1787827084.882074:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143807744:12345-0@lo:400:kworker.0 Request processed in 53us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827084.882081:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1787827084.882106:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143807744:0@lo:400:kworker.0 00000100:00100000:1.0:1787827085.393828:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143808512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827085.393899:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827085.393968:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808512 00000100:00100000:3.0:1787827085.393977:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808512 00000100:00100000:3.0:1787827085.394025:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787827085.394033:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143808512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827085.394061:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827085.394104:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143808512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827085.394112:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787827085.394149:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143808512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827085.521408:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827085.713059:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827085.713113:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827085.713123:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134297472 00000100:00100000:3.0:1787827085.713140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134297472 00000100:00100000:1.0:1787827085.713156:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827085.713202:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827085.713262:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134297600 00000100:00080000:0.0:1787827085.713265:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827085.713267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134297600 00000100:00100000:2.0:1787827085.713291:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134297856 00000100:00100000:1.0:1787827085.713292:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827085.713302:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 532 00000100:00100000:2.0:1787827085.713305:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134297856 00000100:00100000:0.0:1787827085.713331:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134297472:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827085.713339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 533 00000100:00100000:1.0:1787827085.713342:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134297344 00000100:00100000:1.0:1787827085.713350:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134297344 00000100:00100000:3.0:1787827085.713355:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134297600:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827085.713382:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134297728 00000100:00100000:2.0:1787827085.713389:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134297728 00000100:00100000:1.0:1787827085.713403:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 557 00000100:00100000:1.0:1787827085.713415:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134297344:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827085.713431:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134297472:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 114us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827085.713443:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 211 00000100:00100000:3.0:1787827085.713444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134297600:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827085.713455:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 532 00000100:00100000:1.0:1787827085.713455:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134297344:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827085.713469:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134297856:12345-192.168.203.6@tcp:9:kworker.0 00000100:00100000:3.0:1787827085.713470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 533 00000100:00100000:1.0:1787827085.713480:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 557 00000100:00100000:0.0:1787827085.713496:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 212 00000100:00100000:0.0:1787827085.713504:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1874672134297728:12345-192.168.203.6@tcp:400:kworker.0 00000020:00080000:0.0:1787827085.713512:0:9498:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.6@tcp 00000020:00000080:2.0:1787827085.713518:0:19008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79543b5 00000100:00080000:1.0:1787827085.713537:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787827085.713538:0:19008:0:(import.c:65:import_set_state_nolock()) ffff8d534351f000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787827085.713546:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827085.713547:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1874672134297728:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 41us (257us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787827085.713557:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 212 00010000:00010000:1.0:1787827085.713593:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787827085.713599:0:19008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787827085.713819:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+2:2389:x1874672134297856:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 360us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827085.713829:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 211 00000100:00100000:1.0:1787827085.715241:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827085.715292:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134297984 00000100:00100000:3.0:1787827085.715301:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134297984 00000100:00100000:3.0:1787827085.715334:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 213 00000100:00100000:3.0:1787827085.715341:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134297984:12345-192.168.203.6@tcp:8:ptlrpcd_00_00.0 00010000:00020000:3.0:1787827085.715365:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787827085.715412:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134297984:12345-192.168.203.6@tcp:8:ptlrpcd_00_00.0 Request processed in 71us (197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787827085.715419:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 213 00010000:00010000:3.0:1787827086.545364:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827087.569359:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827088.593393:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827089.489458:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827089.489477:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143808768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827089.489483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143808896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827089.489484:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143808640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827089.489587:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827089.489591:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827089.489652:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808640 00000100:00100000:3.0:1787827089.489660:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808640 00000100:00100000:2.0:1787827089.489675:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808768 00000100:00100000:2.0:1787827089.489684:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808768 00000100:00080000:1.0:1787827089.489718:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827089.489768:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787827089.489769:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787827089.489786:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143808640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827089.489794:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143808768:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1787827089.489816:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1787827089.489833:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827089.489893:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143808640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (304us total) trans 0 rc 0/0 00010000:00080000:0.0:1787827089.489915:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5345ae1e00 x1874672143808640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827089.489915:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143808768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827089.489929:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787827089.489945:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143808640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827089.489952:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787827089.489981:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143808768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827089.490009:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827089.490057:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143808896 00000100:00100000:2.0:1787827089.490063:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143808896 00000100:00100000:2.0:1787827089.490110:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787827089.490119:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143808896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787827089.490136:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787827089.490144:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827089.490186:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143808896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827089.490193:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:3.0:1787827089.490253:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fa61a40 x1874672143808896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827089.490267:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143808896:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787827089.617436:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827090.001420:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143809152:0@lo:400:kworker.0 00000100:00100000:0.0:1787827090.001421:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143809024:0@lo:400:kworker.0 00000100:00080000:3.0:1787827090.001427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787827090.001439:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787827090.001442:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787827090.001451:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143809280:0@lo:400:kworker.0 00000100:00080000:3.0:1787827090.001451:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1787827090.001460:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787827090.001468:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787827090.001495:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53424421c0 x1874672143809536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787827090.001530:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827090.001531:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827090.001561:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143809408:0@lo:400:kworker.0 00000100:00080000:3.0:1787827090.001590:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787827090.001595:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787827090.001599:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787827090.001605:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787827090.001617:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00100000:0.0:1787827090.001618:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143809664:0@lo:400:kworker.0 00000100:00080000:3.0:1787827090.001630:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1787827090.001634:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809280 00000100:00080000:3.0:1787827090.001639:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827090.001655:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809280 00000100:00100000:0.0:1787827090.001677:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827090.001717:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809664 00000100:00100000:1.0:1787827090.001727:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809664 00000100:00100000:0.0:1787827090.001736:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827090.001746:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143809792:0@lo:400:kworker.0 00000100:00100000:1.0:1787827090.001768:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1787827090.001776:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827090.001789:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143809280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827090.001813:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809024 00000100:00100000:0.0:1787827090.001817:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809024 00000100:00100000:3.0:1787827090.001854:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d53424430c0 x1874672143809920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787827090.001865:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1787827090.001874:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143809280:12345-0@lo:400:kworker.0 Request processed in 94us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827090.001882:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143809024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827090.001885:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53424421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143809536:0@lo:8:kworker.0 00000100:00100000:1.0:1787827090.001890:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1787827090.001903:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809792 00000100:00100000:3.0:1787827090.001911:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809792 00000100:00100000:1.0:1787827090.001922:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1787827090.001935:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143809664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827090.001949:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3616:x1874672143809024:12345-0@lo:400:kworker.0 Request processed in 68us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827090.001949:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827090.001960:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1787827090.001981:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1787827090.001994:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53424430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143809920:0@lo:8:kworker.0 00000100:00100000:1.0:1787827090.001998:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143809664:12345-0@lo:400:kworker.0 Request processed in 62us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827090.002016:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809408 00000100:00100000:1.0:1787827090.002022:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1787827090.002023:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809408 00000100:00100000:3.0:1787827090.002023:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143809792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827090.002039:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827090.002067:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809536 00000100:00100000:1.0:1787827090.002072:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809536 00000100:00100000:0.0:1787827090.002080:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787827090.002091:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827090.002093:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143809408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827090.002097:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809920 00000100:00100000:1.0:1787827090.002103:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809920 00000100:00100000:1.0:1787827090.002130:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787827090.002134:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143809792:12345-0@lo:400:kworker.0 Request processed in 123us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827090.002142:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143809152 00000100:00100000:1.0:1787827090.002143:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143809536:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787827090.002150:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1787827090.002152:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143809152 00000100:00100000:0.0:1787827090.002162:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143809408:12345-0@lo:400:kworker.0 Request processed in 72us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827090.002174:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00020000:1.0:1787827090.002178:0:19009:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787827090.002203:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787827090.002210:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1787827090.002260:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143809920:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787827090.002262:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143809152:12345-0@lo:400:kworker.0 00010000:00020000:3.0:1787827090.002281:0:10061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787827090.002290:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143809536:12345-0@lo:8:kworker.0 Request processed in 147us (345us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787827090.002299:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:1.0:1787827090.002332:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827090.002340:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827090.002352:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143809920:12345-0@lo:8:kworker.0 Request processed in 130us (312us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787827090.002354:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143809152:12345-0@lo:400:kworker.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827090.002366:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787827090.002374:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1787827090.002403:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143809280:0@lo:400:kworker.0 00010000:00080000:0.0:1787827090.002404:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5342440b40 x1874672143809792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827090.002417:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143809792:0@lo:400:kworker.0 00000100:00100000:0.0:1787827090.002449:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143809664:0@lo:400:kworker.0 00000100:00100000:2.0:1787827090.002461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143809152:0@lo:400:kworker.0 00000100:00080000:1.0:1787827090.002465:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787827090.002469:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143809024:0@lo:400:kworker.0 00000100:00080000:1.0:1787827090.002475:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787827090.002482:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53424421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143809536:0@lo:8:kworker.0 00000100:00080000:1.0:1787827090.002509:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787827090.002512:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143809408:0@lo:400:kworker.0 00000100:00080000:1.0:1787827090.002517:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787827090.002531:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53424430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143809920:0@lo:8:kworker.0 00000100:00100000:1.0:1787827090.513474:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143810048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827090.513567:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827090.513611:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810048 00000100:00100000:0.0:1787827090.513620:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810048 00000100:00100000:0.0:1787827090.513696:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787827090.513706:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143810048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827090.513759:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827090.513808:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143810048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827090.513817:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787827090.513863:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143810048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787827090.641372:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827090.833998:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827090.834029:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827090.834053:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827090.834070:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134298112 00000100:00100000:1.0:1787827090.834081:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134298112 00000100:00100000:2.0:1787827090.834087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827090.834111:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134298240 00000100:00100000:0.0:1787827090.834115:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134298368 00000100:00100000:3.0:1787827090.834118:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134298240 00000100:00100000:0.0:1787827090.834121:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134298368 00000100:00100000:2.0:1787827090.834121:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134298496 00000100:00100000:2.0:1787827090.834129:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134298496 00000100:00100000:1.0:1787827090.834137:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 559 00000100:00100000:1.0:1787827090.834150:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134298112:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827090.834165:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 216 00000100:00100000:3.0:1787827090.834172:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 538 00000100:00100000:2.0:1787827090.834176:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e39bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2389:x1874672134298496:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:3.0:1787827090.834186:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134298240:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827090.834187:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 539 00000100:00100000:0.0:1787827090.834200:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54745df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134298368:12345-192.168.203.6@tcp:400:kworker.0 00010000:00020000:2.0:1787827090.834201:0:19008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787827090.834268:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134298240:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827090.834275:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134298112:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 126us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827090.834278:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e39bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2389:x1874672134298496:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 103us (191us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787827090.834284:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 538 00000100:00100000:0.0:1787827090.834288:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54745df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134298368:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827090.834294:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 559 00000100:00100000:2.0:1787827090.834297:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 216 00000100:00100000:0.0:1787827090.834306:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 539 00000100:00080000:3.0:1787827090.834351:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827090.834357:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787827091.026822:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:3.0:1787827091.026832:0:9469:0:(genops.c:885:class_export_put()) final put ffff8d5343518800/2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:2.0:1787827091.026892:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343518800/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0001 00000020:00000080:2.0:1787827091.026944:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d534351f000 for lustre-OST0001 00010000:00010000:3.0:1787827091.665342:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827092.689417:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827093.714332:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787827094.440298:0:23932:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787827094.440303:0:23932:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787827094.440309:0:23932:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787827094.440409:0:23932:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d5343bea800 00000020:01000004:3.0:1787827094.440424:0:23932:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787827094.440437:0:23932:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787827094.440449:0:23932:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d53437f3370) 00000020:00000080:3.0:1787827094.440466:0:23932:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787827094.466865:0:23932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787827094.469518:0:23932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787827094.469794:0:23932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787827094.470030:0:23932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787827094.470900:0:23932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787827094.471095:0:23932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787827094.471267:0:23932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787827094.472254:0:23932:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787827094.472448:0:23932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787827094.472459:0:23932:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787827094.472471:0:23932:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a795445d 00000020:01000004:3.0:1787827094.472477:0:23932:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787827094.472498:0:23932:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787827094.472502:0:23932:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787827094.472507:0:23932:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787827094.472533:0:23932:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787827094.472536:0:23932:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787827094.477912:0:23932:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787827094.477945:0:23932:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787827094.477949:0:23932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787827094.477951:0:23932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787827094.477952:0:23932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827094.477954:0:23932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787827094.477955:0:23932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827094.477956:0:23932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787827094.477961:0:23932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787827094.477962:0:23932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827094.477964:0:23932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787827094.477966:0:23932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787827094.477968:0:23932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787827094.477969:0:23932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787827094.477970:0:23932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827094.477972:0:23932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787827094.477973:0:23932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827094.477974:0:23932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787827094.477974:0:23932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787827094.477975:0:23932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827094.477976:0:23932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787827094.477998:0:23932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787827094.478015:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787827094.478076:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.478126:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787827094.478245:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810176 00000100:00100000:0.0:1787827094.478253:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810176 00000100:00100000:0.0:1787827094.478318:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1787827094.478337:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:23932:x1874672143810176:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787827094.478368:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787827094.478371:0:6478:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787827094.478387:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787827094.478771:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:23932:x1874672143810176:12345-0@lo:253:mount.lustre.0 Request processed in 443us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.478780:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1787827094.478810:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787827094.478827:0:23932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787827094.478829:0:23932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787827094.478830:0:23932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787827094.478831:0:23932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827094.478832:0:23932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787827094.478833:0:23932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827094.478834:0:23932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787827094.478835:0:23932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787827094.478836:0:23932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827094.478837:0:23932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787827094.478869:0:23932:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d5343bea800 from lustre-OST0000 10000000:01000000:3.0:1787827094.478892:0:23932:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787827094.478895:0:23932:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787827094.478904:0:23932:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:3.0:1787827094.478913:0:23932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827094.478970:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787827094.479004:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.479029:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787827094.479052:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810304 00000100:00100000:1.0:1787827094.479057:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810304 00000100:00100000:1.0:1787827094.479084:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1787827094.479092:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:23932:x1874672143810304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827094.479152:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:23932:x1874672143810304:12345-0@lo:501:mount.lustre.0 Request processed in 60us (146us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787827094.479160:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827094.479161:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 10000000:01000000:3.0:1787827094.479179:0:23932:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787827094.479198:0:23932:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787827094.479204:0:23932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.479235:0:23932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827094.479255:0:23932:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d5343bea800 10000000:01000000:3.0:1787827094.479259:0:23932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787827094.479263:0:23932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787827094.479264:0:23932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787827094.479267:0:23932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787827094.479269:0:23932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787827094.479284:0:23932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.479290:0:23932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.479296:0:23932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827094.479303:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787827094.479320:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.479355:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827094.479394:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810432 00000100:00100000:2.0:1787827094.479398:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810432 00000100:00100000:2.0:1787827094.479427:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1787827094.479432:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:23932:x1874672143810432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787827094.479440:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827094.479452:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a795446b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7954464 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.479474:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a795446b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7954464 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.479485:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a795446b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7954464 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.479494:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2200, rc 0) 00000100:00100000:2.0:1787827094.479523:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810432:12345-0@lo:101:mount.lustre.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.479531:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1787827094.479546:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787827094.479557:0:23932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.479564:0:23932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787827094.480066:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000040:00080000:3.0:1787827094.480448:0:23932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787827094.481627:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:3.0:1787827094.481658:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 128 off8544 00000040:00080000:3.0:1787827094.481673:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 112 off8656 00000040:00080000:3.0:1787827094.481687:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8880 00000040:00080000:3.0:1787827094.481700:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9104 00000040:00080000:3.0:1787827094.481713:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 80 off9184 00000040:00080000:3.0:1787827094.481727:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 224 off9408 00000040:00080000:3.0:1787827094.481743:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9632 00000040:00080000:3.0:1787827094.481756:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 80 off9712 00000040:00080000:3.0:1787827094.481768:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 224 off9936 00000040:00080000:3.0:1787827094.481781:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].11, 224 off10160 00000040:00080000:3.0:1787827094.481794:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].12, 120 off10280 00000040:00080000:3.0:1787827094.481813:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].13, 224 off10504 00000040:00080000:3.0:1787827094.481818:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 13 count 14 00000100:00100000:3.0:1787827094.481885:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787827094.481928:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.481966:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827094.481995:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810560 00000100:00100000:1.0:1787827094.482002:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810560 00000100:00100000:1.0:1787827094.482042:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1787827094.482050:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827094.482151:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810560:12345-0@lo:501:mount.lustre.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827094.482167:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827094.482170:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1787827094.482207:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787827094.482291:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.482318:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787827094.482343:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810688 00000100:00100000:2.0:1787827094.482348:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810688 00000100:00100000:2.0:1787827094.482379:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1787827094.482386:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787827094.482471:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810688:12345-0@lo:503:mount.lustre.0 Request processed in 85us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.482480:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1787827094.482486:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787827094.482802:0:23932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827094.482850:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827094.482882:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.482905:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827094.482942:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810816 00000100:00100000:0.0:1787827094.482949:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810816 00000100:00100000:0.0:1787827094.483049:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1787827094.483058:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827094.483141:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810816:12345-0@lo:502:mount.lustre.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.483154:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1787827094.483172:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787827094.483339:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:3.0:1787827094.483361:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 128 off8544 00000040:00080000:3.0:1787827094.483373:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 112 off8656 00000040:00080000:3.0:1787827094.483383:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8880 00000040:00080000:3.0:1787827094.483395:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9104 00000040:00080000:3.0:1787827094.483408:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 80 off9184 00000040:00080000:3.0:1787827094.483420:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 224 off9408 00000040:00080000:3.0:1787827094.483430:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9632 00000040:00080000:3.0:1787827094.483443:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 80 off9712 00000040:00080000:3.0:1787827094.483453:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 224 off9936 00000040:00080000:3.0:1787827094.483464:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].11, 224 off10160 00000040:00080000:3.0:1787827094.483477:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].12, 120 off10280 00000100:00100000:3.0:1787827094.483497:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827094.483533:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.483559:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827094.483580:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143810944 00000100:00100000:0.0:1787827094.483585:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143810944 00000100:00100000:0.0:1787827094.483631:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1787827094.483640:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827094.483716:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143810944:12345-0@lo:502:mount.lustre.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.483722:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1787827094.483751:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143810944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787827094.483793:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].13, 224 off10504 00000040:00080000:3.0:1787827094.483801:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787827094.484276:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787827094.484283:0:23936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787827094.484290:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827094.484292:0:23936:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787827094.484298:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787827094.484310:0:23936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5450e8b370) 00000020:00000080:0.0:1787827094.484330:0:23936:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787827094.484335:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787827094.484401:0:23936:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5343bea800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787827094.484409:0:23936:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787827094.484415:0:23936:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a7954479 00010000:00010000:0.0:1787827094.487494:0:23936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:0.0:1787827094.487863:0:23936:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 30064771072 lx: 1874672143596416 gen 0 00000001:00080000:0.0:1787827094.487901:0:23936:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 30064771560 srv lr: 30064771072 lx: 1874672143801216 gen 0 00000001:00080000:0.0:1787827094.487914:0:23936:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 30064771559 srv lr: 30064771072 lx: 1874672134292992 gen 0 00000001:00000004:0.0:1787827094.487932:0:23936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 30064771560 00080000:10000000:0.0:1787827094.489084:0:23936:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000020:00000080:2.0:1787827094.490141:0:23936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787827094.490152:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827094.490163:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827094.490165:0:23936:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787827094.490169:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787827094.490171:0:23936:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787827094.490173:0:23936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787827094.490175:0:23936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787827094.490176:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787827094.490178:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827094.490179:0:23936:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787827094.490182:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827094.490185:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827094.490186:0:23936:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787827094.490189:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787827094.490191:0:23936:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787827094.490193:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827094.490195:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827094.490196:0:23936:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787827094.490199:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827094.490200:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827094.490202:0:23936:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787827094.490205:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787827094.490252:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827094.490255:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827094.490256:0:23936:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787827094.490260:0:23936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 14 count 14 00000020:01000000:3.0:1787827094.490366:0:23932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787827094.490405:0:23932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787827094.490435:0:23932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.490447:0:23932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827094.490467:0:23932:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5343bea800 from 1 10000000:01000000:3.0:1787827094.490470:0:23932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787827094.490505:0:23932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.490514:0:23932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.490524:0:23932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827094.490548:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787827094.490625:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.490667:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787827094.490702:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811072 00000100:00100000:1.0:1787827094.490709:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811072 00000100:00100000:1.0:1787827094.490754:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1787827094.490764:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:23932:x1874672143811072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787827094.490778:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827094.490791:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5345113c00/0xc0fefc09a795449c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7954495 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.490819:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345113c00/0xc0fefc09a795449c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7954495 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.490831:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5345113c00/0xc0fefc09a795449c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7954495 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.490840:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345113c00, rc 0) 00000100:00100000:1.0:1787827094.490892:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811072:12345-0@lo:101:mount.lustre.0 Request processed in 131us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827094.490899:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1787827094.490931:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787827094.490959:0:23932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.490970:0:23932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787827094.492133:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 7 count 7 00000040:00080000:3.0:1787827094.492400:0:23932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787827094.492576:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].1, 224 off8416 00000040:00080000:3.0:1787827094.492605:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].2, 112 off8528 00000040:00080000:3.0:1787827094.492648:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].3, 224 off8752 00000040:00080000:3.0:1787827094.492666:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].4, 224 off8976 00000040:00080000:3.0:1787827094.492684:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].5, 112 off9088 00000040:00080000:3.0:1787827094.492702:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].6, 224 off9312 00000040:00080000:3.0:1787827094.492708:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 6 count 7 00000100:00100000:3.0:1787827094.492832:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787827094.492891:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.492933:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787827094.494199:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811200 00000100:00100000:2.0:1787827094.494208:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811200 00000100:00100000:2.0:1787827094.494279:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1787827094.494288:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787827094.494410:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811200:12345-0@lo:501:mount.lustre.0 Request processed in 122us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.494418:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1787827094.494448:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787827094.494490:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787827094.494534:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.494568:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787827094.494576:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811328 00000100:00100000:2.0:1787827094.494587:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811328 00000100:00100000:2.0:1787827094.494628:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1787827094.494634:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787827094.494710:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811328:12345-0@lo:503:mount.lustre.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.494716:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1787827094.494804:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811328:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787827094.495115:0:23932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827094.495173:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827094.495205:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.495323:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827094.495382:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811456 00000100:00100000:2.0:1787827094.495386:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811456 00000100:00100000:2.0:1787827094.495414:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1787827094.495420:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787827094.495495:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811456:12345-0@lo:502:mount.lustre.0 Request processed in 70us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.495502:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1787827094.495527:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787827094.495727:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].1, 224 off8416 00000040:00080000:3.0:1787827094.495781:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].2, 112 off8528 00000040:00080000:3.0:1787827094.495803:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].3, 224 off8752 00000040:00080000:3.0:1787827094.495821:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].4, 224 off8976 00000040:00080000:3.0:1787827094.495836:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].5, 112 off9088 00000100:00100000:3.0:1787827094.495858:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827094.495894:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.495921:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827094.495938:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811584 00000100:00100000:2.0:1787827094.495943:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811584 00000100:00100000:2.0:1787827094.495975:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1787827094.495981:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787827094.496049:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811584:12345-0@lo:502:mount.lustre.0 Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.496055:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1787827094.496092:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787827094.496129:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].6, 224 off9312 00000040:00080000:3.0:1787827094.496136:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1787827094.496809:0:23940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827094.496816:0:23940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827094.496822:0:23940:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787827094.496827:0:23940:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5343bea800 00000020:00000080:0.0:1787827094.496829:0:23940:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787827094.496836:0:23940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827094.496839:0:23940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827094.496840:0:23940:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787827094.496842:0:23940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827094.496845:0:23940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827094.496846:0:23940:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787827094.496848:0:23940:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5343bea800 00000020:00000080:0.0:1787827094.496850:0:23940:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787827094.496906:0:23940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827094.496910:0:23940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827094.496912:0:23940:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787827094.496914:0:23940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 7 count 7 00000020:01000000:3.0:1787827094.497268:0:23932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1787827094.497299:0:23932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787827094.497321:0:23932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.497332:0:23932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827094.497382:0:23932:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787827094.497385:0:23932:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d5343bea800 10000000:01000000:3.0:1787827094.497388:0:23932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d5343bea800 10000000:01000000:3.0:1787827094.497393:0:23932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787827094.497398:0:23932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5343bea800 from 1 10000000:01000000:3.0:1787827094.497401:0:23932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787827094.497428:0:23932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.497437:0:23932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827094.497446:0:23932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827094.497462:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787827094.497498:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.497532:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546f6b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827094.498674:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811712 00000100:00100000:0.0:1787827094.498683:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811712 00000100:00100000:0.0:1787827094.498734:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1787827094.498743:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:23932:x1874672143811712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787827094.498756:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827094.498769:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a1800/0xc0fefc09a79544aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79544a3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827094.498791:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a1800/0xc0fefc09a79544aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79544a3 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827094.498802:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a1800/0xc0fefc09a79544aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79544a3 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827094.498810:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a1800, rc 0) 00000100:00100000:0.0:1787827094.498868:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143811712:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.498884:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1787827094.498904:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787827094.498922:0:23932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.498937:0:23932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787827094.500128:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 52 count 51 00000040:00080000:1.0:1787827094.500570:0:23932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827094.500812:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].1, 224 off8416 00000040:00080000:1.0:1787827094.500840:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].2, 120 off8536 00000040:00080000:1.0:1787827094.500850:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].3, 168 off8704 00000040:00080000:1.0:1787827094.500857:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].4, 224 off8928 00000040:00080000:1.0:1787827094.500872:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].5, 224 off9152 00000040:00080000:1.0:1787827094.500889:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].6, 120 off9272 00000040:00080000:1.0:1787827094.500905:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].7, 168 off9440 00000040:00080000:1.0:1787827094.500922:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].8, 224 off9664 00000040:00080000:1.0:1787827094.500937:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].9, 224 off9888 00000040:00080000:1.0:1787827094.500950:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].10, 120 off10008 00000040:00080000:1.0:1787827094.500965:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].11, 224 off10232 00000040:00080000:1.0:1787827094.500978:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].12, 224 off10456 00000040:00080000:1.0:1787827094.500991:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].13, 88 off10544 00000040:00080000:1.0:1787827094.501005:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].14, 128 off10672 00000040:00080000:1.0:1787827094.501019:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].15, 144 off10816 00000040:00080000:1.0:1787827094.501035:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].16, 160 off10976 00000040:00080000:1.0:1787827094.501047:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].17, 224 off11200 00000040:00080000:1.0:1787827094.501061:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].18, 224 off11424 00000040:00080000:1.0:1787827094.501076:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].19, 80 off11504 00000040:00080000:1.0:1787827094.501091:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].20, 224 off11728 00000040:00080000:1.0:1787827094.501108:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].21, 224 off11952 00000040:00080000:1.0:1787827094.501123:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].22, 88 off12040 00000040:00080000:1.0:1787827094.501138:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].23, 128 off12168 00000040:00080000:1.0:1787827094.501152:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].24, 144 off12312 00000040:00080000:1.0:1787827094.501166:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].25, 160 off12472 00000040:00080000:1.0:1787827094.501179:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].26, 224 off12696 00000040:00080000:1.0:1787827094.501191:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].27, 224 off12920 00000040:00080000:1.0:1787827094.501204:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].28, 80 off13000 00000040:00080000:1.0:1787827094.501237:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].29, 224 off13224 00000040:00080000:1.0:1787827094.501256:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].30, 224 off13448 00000040:00080000:1.0:1787827094.501270:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].31, 88 off13536 00000040:00080000:1.0:1787827094.501286:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].32, 128 off13664 00000040:00080000:1.0:1787827094.501302:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].33, 144 off13808 00000040:00080000:1.0:1787827094.501329:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].34, 128 off13936 00000040:00080000:1.0:1787827094.501346:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].35, 224 off14160 00000040:00080000:1.0:1787827094.501361:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].36, 224 off14384 00000040:00080000:1.0:1787827094.501373:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].37, 80 off14464 00000040:00080000:1.0:1787827094.501380:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].38, 224 off14688 00000040:00080000:1.0:1787827094.501391:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].39, 224 off14912 00000040:00080000:1.0:1787827094.501404:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].40, 88 off15000 00000040:00080000:1.0:1787827094.501419:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].41, 128 off15128 00000040:00080000:1.0:1787827094.501436:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].42, 144 off15272 00000040:00080000:1.0:1787827094.501453:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].43, 128 off15400 00000040:00080000:1.0:1787827094.501470:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].44, 224 off15624 00000040:00080000:1.0:1787827094.501488:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].45, 224 off15848 00000040:00080000:1.0:1787827094.501505:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].46, 80 off15928 00000040:00080000:1.0:1787827094.501518:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].47, 224 off16152 00000040:00080000:1.0:1787827094.501526:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].48, 232 off16384 00000040:00080000:1.0:1787827094.501639:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].49, 224 off16608 00000040:00080000:1.0:1787827094.501662:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].50, 120 off16728 00000040:00080000:1.0:1787827094.501678:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].51, 224 off16952 00000040:00080000:1.0:1787827094.501683:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 51 count 51 00000100:00100000:1.0:1787827094.501749:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827094.501800:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.501840:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811840 00000100:00100000:1.0:1787827094.501843:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5450e4d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787827094.501845:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811840 00000100:00100000:3.0:1787827094.501884:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1787827094.501891:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143811840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787827094.501980:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143811840:12345-0@lo:501:mount.lustre.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827094.501987:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1787827094.502000:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827094.502031:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787827094.502075:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827094.502106:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5450e4d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787827094.502154:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143811968 00000100:00100000:0.0:1787827094.502157:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143811968 00000100:00100000:0.0:1787827094.502185:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1787827094.502190:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143811968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787827094.502468:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143811968:12345-0@lo:503:mount.lustre.0 Request processed in 276us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.502477:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1787827094.502534:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143811968:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787827094.502865:0:23932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787827094.502921:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143812096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787827094.502971:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827094.503037:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787827094.503072:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812096 00000100:00100000:0.0:1787827094.503076:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812096 00000100:00100000:0.0:1787827094.503110:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:0.0:1787827094.503119:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143812096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827094.503205:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143812096:12345-0@lo:502:mount.lustre.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.503238:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1787827094.503256:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143812096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787827094.503419:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].1, 224 off8416 00000040:00080000:1.0:1787827094.503444:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].2, 120 off8536 00000040:00080000:1.0:1787827094.503464:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].3, 168 off8704 00000040:00080000:1.0:1787827094.503482:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].4, 224 off8928 00000040:00080000:1.0:1787827094.503498:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].5, 224 off9152 00000040:00080000:1.0:1787827094.503513:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].6, 120 off9272 00000040:00080000:1.0:1787827094.503531:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].7, 168 off9440 00000040:00080000:1.0:1787827094.503551:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].8, 224 off9664 00000040:00080000:1.0:1787827094.503587:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].9, 224 off9888 00000040:00080000:1.0:1787827094.503607:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].10, 120 off10008 00000040:00080000:1.0:1787827094.503632:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].11, 224 off10232 00000040:00080000:1.0:1787827094.503641:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].12, 224 off10456 00000040:00080000:1.0:1787827094.503653:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].13, 88 off10544 00000040:00080000:1.0:1787827094.503671:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].14, 128 off10672 00000040:00080000:1.0:1787827094.503693:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].15, 144 off10816 00000040:00080000:1.0:1787827094.503710:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].16, 160 off10976 00000040:00080000:1.0:1787827094.503720:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].17, 224 off11200 00000040:00080000:1.0:1787827094.503727:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].18, 224 off11424 00000040:00080000:1.0:1787827094.503737:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].19, 80 off11504 00000040:00080000:1.0:1787827094.503759:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].20, 224 off11728 00000040:00080000:1.0:1787827094.503776:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].21, 224 off11952 00000040:00080000:1.0:1787827094.503790:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].22, 88 off12040 00000040:00080000:1.0:1787827094.503809:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].23, 128 off12168 00000040:00080000:1.0:1787827094.503840:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].24, 144 off12312 00000040:00080000:1.0:1787827094.503861:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].25, 160 off12472 00000040:00080000:1.0:1787827094.503876:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].26, 224 off12696 00000040:00080000:1.0:1787827094.503894:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].27, 224 off12920 00000040:00080000:1.0:1787827094.503914:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].28, 80 off13000 00000040:00080000:1.0:1787827094.503944:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].29, 224 off13224 00000040:00080000:1.0:1787827094.503963:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].30, 224 off13448 00000040:00080000:1.0:1787827094.503984:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].31, 88 off13536 00000040:00080000:1.0:1787827094.504001:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].32, 128 off13664 00000040:00080000:1.0:1787827094.504019:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].33, 144 off13808 00000040:00080000:1.0:1787827094.504031:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].34, 128 off13936 00000040:00080000:1.0:1787827094.504042:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].35, 224 off14160 00000040:00080000:1.0:1787827094.504054:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].36, 224 off14384 00000040:00080000:1.0:1787827094.504064:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].37, 80 off14464 00000040:00080000:1.0:1787827094.504075:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].38, 224 off14688 00000040:00080000:1.0:1787827094.504091:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].39, 224 off14912 00000040:00080000:1.0:1787827094.504106:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].40, 88 off15000 00000040:00080000:1.0:1787827094.504120:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].41, 128 off15128 00000040:00080000:1.0:1787827094.504133:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].42, 144 off15272 00000040:00080000:1.0:1787827094.504142:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].43, 128 off15400 00000040:00080000:1.0:1787827094.504149:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].44, 224 off15624 00000040:00080000:1.0:1787827094.504161:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].45, 224 off15848 00000040:00080000:1.0:1787827094.504176:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].46, 80 off15928 00000040:00080000:1.0:1787827094.504192:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].47, 224 off16152 00000040:00080000:1.0:1787827094.504207:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].48, 232 off16384 00000100:00100000:1.0:1787827094.504259:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143812224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787827094.504292:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827094.504320:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787827094.504339:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812224 00000100:00100000:3.0:1787827094.504346:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812224 00000100:00100000:3.0:1787827094.504385:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1787827094.504393:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143812224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827094.504608:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143812224:12345-0@lo:502:mount.lustre.0 Request processed in 215us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827094.504626:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1787827094.504636:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143812224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787827094.504739:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].49, 224 off16608 00000040:00080000:1.0:1787827094.504757:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].50, 120 off16728 00000100:00100000:1.0:1787827094.504778:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143812352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787827094.504817:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827094.504837:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787827094.504849:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812352 00000100:00100000:0.0:1787827094.504853:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812352 00000100:00100000:0.0:1787827094.504879:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1787827094.504887:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143812352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827094.504954:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143812352:12345-0@lo:502:mount.lustre.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.504959:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1787827094.504982:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143812352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787827094.505022:0:23932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].51, 224 off16952 00000040:00080000:1.0:1787827094.505029:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787827094.505538:0:23943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787827094.505554:0:23943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d5342780000) 00000020:00000080:1.0:1787827094.505577:0:23943:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787827094.505696:0:23943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5343bea800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827094.505701:0:23943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5343bea800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827094.505704:0:23943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343bea800 3 00010000:00080000:1.0:1787827094.505739:0:23943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d534390d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:1.0:1787827094.507463:0:23943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:1.0:1787827094.507669:0:23943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787827094.507706:0:23943:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787827094.507717:0:23943:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a79544b8 00000100:00080000:1.0:1787827094.507728:0:23943:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827094.507734:0:23943:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d534390d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827094.507765:0:23943:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5345ae1680 x1874672143812480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827094.507793:0:23943:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787827094.507834:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143812480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787827094.507862:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143812608:0@lo:400:kworker.0 00000100:00080000:1.0:1787827094.507893:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787827094.507898:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787827094.507901:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787827094.507906:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1787827094.507910:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787827094.507914:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787827094.507920:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827094.507935:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5345ae21c0 x1874672143813120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827094.507977:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1787827094.507984:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143813120:0@lo:8:kworker.0 00000100:00080000:1.0:1787827094.507989:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787827094.507993:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787827094.507998:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1787827094.508001:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787827094.508005:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827094.508023:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5345ae3840 x1874672143813632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787827094.508024:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.508058:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143813632:0@lo:8:kworker.0 00000100:00100000:1.0:1787827094.508068:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143812992:0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.508088:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827094.508114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.508145:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143812864:0@lo:400:kworker.0 00000100:00100000:1.0:1787827094.508147:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143813760:0@lo:400:kworker.0 00000100:00100000:1.0:1787827094.508193:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.508200:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827094.508256:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827094.508265:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143813504:0@lo:400:kworker.0 00000100:00100000:1.0:1787827094.508267:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143813248:0@lo:400:kworker.0 00000100:00100000:1.0:1787827094.508306:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.508318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.508331:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143813120 00000100:00100000:3.0:1787827094.508338:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143813120 00000100:00100000:1.0:1787827094.508349:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143813632 00000100:00100000:1.0:1787827094.508354:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143813632 00000100:00100000:2.0:1787827094.508358:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787827094.508367:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143812736:0@lo:400:kworker.0 00000100:00100000:3.0:1787827094.508373:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143813760 00000100:00100000:3.0:1787827094.508378:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143813760 00000100:00100000:1.0:1787827094.508383:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143813248 00000100:00100000:1.0:1787827094.508387:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143813248 00000100:00100000:2.0:1787827094.508403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.508429:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143813376:0@lo:400:kworker.0 00000100:00100000:3.0:1787827094.508433:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787827094.508442:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787827094.508448:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143813760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827094.508456:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143813248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.508477:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.508522:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812480 00000100:00100000:3.0:1787827094.508523:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143813760:12345-0@lo:400:kworker.0 Request processed in 79us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827094.508525:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143813248:12345-0@lo:400:kworker.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.508527:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812480 00000100:00100000:3.0:1787827094.508539:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787827094.508547:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787827094.508562:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812864 00000100:00100000:3.0:1787827094.508563:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787827094.508569:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812864 00000100:00100000:1.0:1787827094.508575:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787827094.508575:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143813120:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787827094.508586:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e073840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143813632:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787827094.508600:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143813504 00000100:00100000:2.0:1787827094.508605:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143813504 00000100:00100000:3.0:1787827094.508646:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143813120:12345-0@lo:8:kworker.0 Request processed in 73us (623us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787827094.508652:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e073840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143813632:12345-0@lo:8:kworker.0 Request processed in 66us (564us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787827094.508659:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143813376 00000100:00100000:3.0:1787827094.508665:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787827094.508666:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143813376 00000100:00100000:1.0:1787827094.508674:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1787827094.508695:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787827094.508701:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827094.508704:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827094.508708:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1787827094.508719:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143812864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.508763:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143812864:12345-0@lo:400:kworker.0 Request processed in 47us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.508771:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1787827094.508788:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1787827094.508796:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143813504:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787827094.508837:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5345ae1e00 x1874672143813248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827094.508841:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143813504:12345-0@lo:400:kworker.0 Request processed in 45us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.508857:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1787827094.508864:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143813248:0@lo:400:kworker.0 00010000:00080000:3.0:1787827094.508884:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5345ae3480 x1874672143813760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827094.508889:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1787827094.508901:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143813760:0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.508903:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143813376:12345-0@lo:400:kworker.0 00000020:01000004:1.0:1787827094.508905:0:23943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787827094.508923:0:23943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d5460440000) 00000020:00000080:1.0:1787827094.508942:0:23943:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:2.0:1787827094.508947:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143813376:12345-0@lo:400:kworker.0 Request processed in 48us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.508956:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1787827094.508973:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787827094.508978:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1874672143812480:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787827094.508994:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:01000004:1.0:1787827094.509048:0:23943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5343bea800 from lustre-OST0000, refs=3 00000020:00000080:2.0:1787827094.509049:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a79544c6 00000020:01000004:1.0:1787827094.509055:0:23943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5343bea800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827094.509059:0:23943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343bea800 3 00000004:00100000:2.0:1787827094.509066:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1787827094.509098:0:23943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d546e141000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00000100:00080000:2.0:1787827094.509099:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d53434c8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827094.509140:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143812480:12345-0@lo:38:llog_process_th.0 Request processed in 160us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.509147:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787827094.509188:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812992 00000100:00100000:2.0:1787827094.509192:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812992 00000100:00100000:2.0:1787827094.509458:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812736 00000100:00100000:2.0:1787827094.509463:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812736 00000100:00100000:0.0:1787827094.509468:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787827094.509482:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143812992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.509501:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787827094.509512:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143812736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827094.509543:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143812992:12345-0@lo:400:kworker.0 Request processed in 64us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827094.509554:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143812992:0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.509556:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143812736:12345-0@lo:400:kworker.0 Request processed in 46us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.509568:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787827094.509575:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787827094.509638:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787827094.509690:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827094.509694:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787827094.509697:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143813632:0@lo:8:kworker.0 00000100:00080000:2.0:1787827094.509713:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827094.509715:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787827094.509718:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143813120:0@lo:8:kworker.0 00000100:00100000:2.0:1787827094.509726:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787827094.509730:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787827094.509735:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787827094.509738:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787827094.509739:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534390d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787827094.509742:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143812480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787827094.509765:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143812736:0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.509773:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143813376:0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.509780:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143812864:0@lo:400:kworker.0 00010000:00080000:2.0:1787827094.509788:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5345ae0780 x1874672143813504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827094.509795:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143813504:0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.509819:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143812608 00000100:00100000:2.0:1787827094.509821:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143812608 00000100:00100000:2.0:1787827094.509848:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1787827094.509855:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e073c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143812608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827094.509894:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e073c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143812608:12345-0@lo:400:kworker.0 Request processed in 38us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.509900:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1787827094.509911:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143812608:0@lo:400:kworker.0 00010000:00010000:1.0:1787827094.511119:0:23943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:1.0:1787827094.511315:0:23943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787827094.511359:0:23943:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787827094.511371:0:23943:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a79544cd 00000100:00080000:1.0:1787827094.511378:0:23943:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827094.511383:0:23943:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d546e141000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827094.511408:0:23943:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d534479ed00 x1874672143813888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827094.511439:0:23943:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787827094.511511:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143813888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787827094.511566:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787827094.511694:0:23943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 52 count 51 00000100:00100000:0.0:1787827094.511729:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143813888 00000100:00100000:0.0:1787827094.511736:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143813888 00000100:00100000:0.0:1787827094.511774:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787827094.511781:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1874672143813888:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787827094.511802:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:0.0:1787827094.511844:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a79544d4 00000004:00100000:0.0:1787827094.511857:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787827094.511885:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d5445589000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787827094.511933:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143813888:12345-0@lo:38:llog_process_th.0 Request processed in 151us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.511941:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00080000:2.0:1787827094.511946:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d534479ed00 x1874672143813888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827094.511956:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787827094.511962:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787827094.511968:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787827094.511972:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000020:01000000:0.0:1787827094.511976:0:23932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00080000:2.0:1787827094.511976:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d546e141000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787827094.511985:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143813888:0@lo:38:llog_process_th.0 10000000:01000000:0.0:1787827094.512012:0:23932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787827094.512033:0:23932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827094.512044:0:23932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787827094.512091:0:23932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787827094.512094:0:23932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787827094.512095:0:23932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827094.512096:0:23932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827094.512098:0:23932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827094.512099:0:23932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827094.512101:0:23932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827094.512102:0:23932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827094.512104:0:23932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787827094.512108:0:23932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787827094.512117:0:23932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787827094.512118:0:23932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787827094.512119:0:23932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827094.512120:0:23932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827094.512121:0:23932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827094.512122:0:23932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827094.512123:0:23932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827094.512123:0:23932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827094.512124:0:23932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787827094.512137:0:23932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787827094.512147:0:23932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143814016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787827094.512176:0:23932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827094.512192:0:23932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54483c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787827094.512253:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143814016 00000100:00100000:1.0:1787827094.512258:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143814016 00000100:00100000:1.0:1787827094.512292:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1787827094.512301:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143814016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787827094.512320:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787827094.512331:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787827094.513408:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787827094.513419:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787827094.513453:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787827094.513459:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787827094.513481:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.513510:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.513518:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.513526:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.513534:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.513563:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.513579:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 24 pid: 6479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827094.513592:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143814144:0@lo:104: 00000100:00100000:2.0:1787827094.513636:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:23932:x1874672143814016:12345-0@lo:253:mount.lustre.0 Request processed in 1335us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.513643:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1787827094.513651:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.513656:0:23932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:23932:1874672143814016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787827094.513690:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143814144 00000100:00100000:2.0:1787827094.513696:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143814144 10000000:01000000:3.0:1787827094.513702:0:23932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787827094.513707:0:23932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:1.0:1787827094.513708:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.513721:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 23 pid: 9479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787827094.513721:0:23932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787827094.513725:0:23932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827094.513728:0:23932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787827094.513731:0:23932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827094.513735:0:23932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:2.0:1787827094.513736:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000020:01000004:3.0:1787827094.513739:0:23932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:1.0:1787827094.513740:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143814272:0@lo:104: 00000020:01000004:3.0:1787827094.513743:0:23932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827094.513746:0:23932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787827094.513752:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143814144:12345-0@lo:104: 00000020:02000000:3.0:1787827094.513759:0:23932:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787827094.513764:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827094.513776:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827094.513806:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143814272 00000100:00100000:0.0:1787827094.513811:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143814272 00010000:00010000:1.0:1787827094.513824:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.513837:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787827094.513848:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787827094.513849:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 9 pid: 6479 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827094.513850:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143814144:12345-0@lo:104: Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.513858:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143814272:12345-0@lo:104: 00000100:00100000:2.0:1787827094.513869:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1787827094.513872:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827094.513876:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143814400:192.168.203.6@tcp:104: 00010000:00010000:2.0:1787827094.513894:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787827094.513900:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.513914:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112800 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787827094.513918:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.513927:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827094.513935:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827094.513937:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391840 going to sleep for 11 seconds 00010000:00010000:0.0:1787827094.513941:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1787827094.513948:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787827094.513951:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143814272:12345-0@lo:104: Request processed in 95us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827094.513955:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143814144:0@lo:104: 00000100:00100000:0.0:1787827094.513962:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787827094.513972:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143814272:0@lo:104: 00010000:00010000:2.0:1787827094.513976:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.513982:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827094.513996:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514000:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d5345112800/0xc0fefc09a79542b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79542b9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514010:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787827094.514013:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514019:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079c00 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787827094.514023:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514047:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827094.514055:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827094.514061:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827094.514080:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514086:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827094.514106:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514114:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d546e079c00/0xc0fefc09a79542a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79542ab expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827094.514116:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e070f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143814656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787827094.514136:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827094.514138:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827094.514142:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827094.514155:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.514156:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827094.514167:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e072940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143814528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787827094.514193:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143814656 00000100:00100000:1.0:1787827094.514198:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143814656 00010000:00010000:1.0:1787827094.514243:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 24 pid: 9479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827094.514269:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787827094.514280:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143814656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787827094.514290:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827094.514295:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 24 pid: 9479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.514304:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 24 pid: 9479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.514317:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345113200/0xc0fefc09a79542ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79542a4 expref: 24 pid: 9479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.514329:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827094.514333:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.514375:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143814528 00000100:00100000:1.0:1787827094.514378:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3616:x1874672143814656:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.514380:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143814528 00000100:00100000:1.0:1787827094.514390:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1787827094.514399:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 24 pid: 6479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827094.514419:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e070f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143814656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787827094.514419:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787827094.514430:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3618:x1874672143814528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787827094.514442:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827094.514445:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 23 pid: 6479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514453:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 23 pid: 6479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514460:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d546e078400/0xc0fefc09a79542b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79542b2 expref: 23 pid: 6479 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.514469:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827094.514500:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3618:x1874672143814528:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.514507:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787827094.514539:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e072940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143814528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787827094.514561:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827094.519326:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827094.519342:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143814400:192.168.203.6@tcp:104: 00000100:00100000:2.0:1787827094.519369:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134298624 00000100:00100000:2.0:1787827094.519376:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134298624 00010000:00010000:1.0:1787827094.519380:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519408:0:13703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 10 pid: 6479 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827094.519442:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 74 00000100:00100000:2.0:1787827094.519452:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134298624:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787827094.519466:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827094.519473:0:13703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 10 pid: 6479 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519483:0:13703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 10 pid: 6479 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519511:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1e00/0xc0fefc09a795429d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34675b5 expref: 10 pid: 6479 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519525:0:13703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519533:0:13703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787827094.519545:0:13703:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006998888s 00010000:00010000:2.0:1787827094.519550:0:13703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519557:0:13703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519563:0:13703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519569:0:13703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519575:0:13703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113600 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787827094.519579:0:13703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519587:0:13703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519605:0:13703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827094.519632:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827094.519634:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.519642:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827094.519647:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345113600/0xc0fefc09a79544db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827094.519679:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134298624:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 227us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827094.519687:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 74 00010000:00080000:0.0:1787827094.520743:0:23932:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 30064771560 00010000:00080000:0.0:1787827094.521201:0:23949:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 23949 00000020:01000004:3.0:1787827094.521400:0:23932:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787827094.521452:0:23932:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787827094.521477:0:23932:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00010000:00080000:0.0:1787827094.521487:0:23949:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787827094.521493:0:23949:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000080:00000004:3.0:1787827094.521496:0:23932:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787827094.522447:0:23932:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787827094.522716:0:23932:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787827094.609358:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827094.609383:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143814784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827094.609383:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143814912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827094.609458:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827094.609470:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827094.609511:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143814784 00000100:00100000:3.0:1787827094.609513:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143814912 00000100:00100000:0.0:1787827094.609517:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143814784 00000100:00100000:3.0:1787827094.609519:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143814912 00000100:00100000:0.0:1787827094.609561:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787827094.609571:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143814784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827094.609576:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787827094.609588:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143814912:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1787827094.609606:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787827094.609626:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827094.609675:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143814784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827094.609684:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143814912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827094.609685:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787827094.609697:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00010000:00080000:2.0:1787827094.609702:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d546e109680 x1874672143814784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827094.609723:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143814784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827094.609763:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143814912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827094.610367:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143815040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827094.610404:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827094.610447:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815040 00000100:00100000:3.0:1787827094.610453:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815040 00000100:00100000:3.0:1787827094.610495:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787827094.610504:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143815040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787827094.610517:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827094.610556:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143815040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827094.610564:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00080000:0.0:1787827094.610585:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5342442d00 x1874672143815040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827094.610601:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143815040:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787827094.737593:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787827094.868635:0:23998:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827094.868847:0:23998:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787827095.633372:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787827095.633382:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 13 10000000:01000000:2.0:1787827095.633389:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1787827095.633400:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143815168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827095.633456:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827095.633470:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827095.633486:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827095.633499:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827095.633529:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787827095.633551:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815168 00000100:00100000:3.0:1787827095.633562:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815168 00000100:00100000:2.0:1787827095.633623:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827095.633637:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787827095.633650:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143815168:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827095.633681:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bcf00 going to sleep for 11 seconds 00000004:00000024:3.0:1787827095.633685:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827095.633706:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815296 00000100:00100000:1.0:1787827095.633712:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815296 00000100:00100000:3.0:1787827095.633757:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143815168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827095.633758:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1787827095.633770:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143815296:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787827095.633770:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00010000:1.0:1787827095.633782:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827095.633800:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79544e2 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827095.633824:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827095.633844:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 23 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827095.633865:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345113400, rc 0) 00000100:00100000:2.0:1787827095.633878:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143815168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827095.633902:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143815296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827095.633912:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1787827095.633963:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827095.633982:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827095.633994:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827095.634050:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53424412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787827095.634082:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827095.634103:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787827095.634126:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815424 00000100:00100000:0.0:1787827095.634132:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815424 00000100:00100000:0.0:1787827095.634165:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1787827095.634172:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143815424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787827095.634187:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787827095.634202:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787827095.634205:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787827095.634320:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143815424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827095.634328:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1787827095.634334:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53424412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815424:0@lo:256:ll_cfg_requeue.0 00000100:00080000:3.0:1787827095.634381:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 34, was 0): DISCONN 00010000:00080000:3.0:1787827095.634392:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:3.0:1787827095.634397:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787827095.634410:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787827095.634432:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5342440000 x1874672143815552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1787827095.634466:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787827095.634474:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827095.634482:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827095.634492:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787827095.634495:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 13 10000000:01000000:3.0:1787827095.634499:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787827095.634522:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827095.634529:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827095.634537:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827095.634548:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53424412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787827095.634572:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827095.634613:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d1cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1787827095.634669:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815680 00000100:00100000:1.0:1787827095.634673:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815680 00000100:00100000:2.0:1787827095.634695:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143815552:0@lo:8:ll_cfg_requeue.0 00000100:00100000:1.0:1787827095.634698:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1787827095.634705:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143815680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787827095.634712:0:9479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827095.634720:0:9479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79544f0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827095.634725:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827095.634736:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827095.634745:0:9479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827095.634752:0:9479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345112e00, rc 0) 00000100:00100000:1.0:1787827095.634782:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143815680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827095.634789:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1787827095.634792:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53424412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827095.634801:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827095.634809:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827095.634848:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787827095.634853:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815552 00000100:00100000:3.0:1787827095.634857:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815552 00000100:00100000:2.0:1787827095.634875:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827095.634896:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827095.634921:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787827095.634927:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e071e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143815552:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787827095.634946:0:10061:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d5343518800, cookie 0xc0fefc09a7954480 00010000:00080000:3.0:1787827095.634951:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5343518800 cur 470 last 1787827094 00010000:02000400:3.0:1787827095.634958:0:10061:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:0.0:1787827095.634992:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815808 00000100:00100000:0.0:1787827095.634998:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815808 00000100:00100000:0.0:1787827095.635029:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787827095.635036:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143815808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787827095.635047:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787827095.635058:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787827095.635060:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787827095.635131:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143815808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827095.635140:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1787827095.635148:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143815808:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1787827095.635179:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 34, was 0): DISCONN 00010000:00080000:2.0:1787827095.635186:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:2.0:1787827095.635190:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787827095.635195:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787827095.635211:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d546e071a40 x1874672143815936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787827095.635266:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143815936:0@lo:8:ll_cfg_requeue.0 10000000:01000000:2.0:1787827095.635281:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787827095.635288:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827095.635299:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827095.635300:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827095.635354:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143815936 00000100:00100000:2.0:1787827095.635359:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143815936 00000100:00100000:2.0:1787827095.635388:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787827095.635394:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143815936:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787827095.635408:0:8401:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d534351f000, cookie 0xc0fefc09a7954487 00010000:00080000:2.0:1787827095.635413:0:8401:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d534351f000 cur 470 last 1787827094 00010000:00080000:2.0:1787827095.635421:0:8401:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:2.0:1787827095.635433:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d534351f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787827095.635437:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787827095.635439:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1787827095.635568:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8d5478923000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827095.635627:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143815936:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 232us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827095.635634:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00010000:00080000:0.0:1787827095.635695:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e071a40 x1874672143815936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787827095.635707:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1787827095.635714:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787827095.635718:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1787827095.635720:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771560 gen 2 00000100:00080000:0.0:1787827095.635724:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 30064771560 last 0 00000100:00080000:0.0:1787827095.635727:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1787827095.635963:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143815936:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787827095.635990:0:24106:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1787827095.635995:0:24106:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1787827095.636000:0:24106:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1787827095.636036:0:24106:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1787827095.636083:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143816064:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1787827095.636113:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827095.636142:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816064 00000100:00100000:0.0:1787827095.636147:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816064 00000100:00100000:0.0:1787827095.636196:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787827095.636205:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e071a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143816064:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787827095.636268:0:9498:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d546e071a40 x1874672143816064/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:696/0 lens 224/0 e 0 to 0 dl 1787827106 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827095.636285:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e071a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143816064:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 82us (172us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787827095.636291:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:1.0:1787827095.636396:0:23949:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00002000:00100000:3.0:1787827095.639514:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d5343518800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787827095.639525:0:10061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787827095.639527:0:10061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1787827095.639566:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d5476634800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787827095.639657:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e071e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143815552:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 4727us (4929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827095.639664:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:2.0:1787827095.639736:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5342440000 x1874672143815552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787827095.639760:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 8 00000100:00080000:2.0:1787827095.639770:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787827095.639774:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787827095.639777:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:2.0:1787827095.639791:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00080000:2.0:1787827095.639795:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787827095.640684:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143815552:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787827095.640766:0:24107:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787827095.640770:0:24107:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1787827095.640774:0:24107:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1787827095.640814:0:24107:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787827095.640874:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143816192:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787827095.640917:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827095.640963:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816192 00000100:00100000:2.0:1787827095.640970:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816192 00000100:00100000:2.0:1787827095.641015:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787827095.641025:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143816192:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787827095.641040:0:19008:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d546e10a580 x1874672143816192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:696/0 lens 224/0 e 0 to 0 dl 1787827106 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827095.641059:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143816192:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 37us (143us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787827095.641065:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00080000:1.0:1787827095.641084:0:23949:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:1.0:1787827095.761357:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827095.953412:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827095.953459:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827095.953488:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827095.953497:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299008 00000100:00100000:0.0:1787827095.953503:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134298880 00000100:00100000:0.0:1787827095.953508:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134298880 00000100:00100000:2.0:1787827095.953514:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299008 00000100:00100000:1.0:1787827095.953521:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827095.953552:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827095.953559:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134298752 00000100:00100000:0.0:1787827095.953564:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134298752 00000100:00100000:1.0:1787827095.953583:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299264 00000100:00100000:2.0:1787827095.953584:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299136 00000100:00100000:1.0:1787827095.953589:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299264 00000100:00100000:2.0:1787827095.953591:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299136 00000100:00100000:0.0:1787827095.953598:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 583 00000100:00100000:0.0:1787827095.953622:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134298880:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787827095.953634:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 221 00010000:00010000:0.0:1787827095.953640:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787827095.953643:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134299264:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:2.0:1787827095.953648:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 544 00010000:00010000:0.0:1787827095.953658:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467609 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827095.953661:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134299008:12345-192.168.203.6@tcp:400:kworker.0 00010000:00080000:1.0:1787827095.953673:0:8402:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d534351b000, cookie 0xc0fefc09a795448e 00010000:00080000:1.0:1787827095.953680:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t25769803803 exp ffff8d534351b000 cur 470 last 1787827094 00010000:00010000:0.0:1787827095.953687:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787827095.953694:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d534351b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00010000:00010000:0.0:1787827095.953697:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787827095.953704:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00010000:0.0:1787827095.953706:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0200, rc 0) 00000100:00100000:2.0:1787827095.953735:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134299008:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827095.953749:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 544 00000100:00100000:0.0:1787827095.953750:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+11:10866:x1874672134298880:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 127us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827095.953759:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 583 00000100:00100000:2.0:1787827095.953774:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 545 00000100:00100000:2.0:1787827095.953782:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134299136:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827095.953794:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 584 00000100:00100000:0.0:1787827095.953804:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134298752:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827095.953821:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134299136:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 38us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827095.953827:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 545 00000100:00100000:0.0:1787827095.953839:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134298752:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 35us (316us total) trans 0 rc 0/0 00000100:00080000:2.0:1787827095.953846:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827095.953847:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 584 00000100:00080000:2.0:1787827095.953853:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827095.953882:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d546e146000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1787827095.953935:0:23949:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787827095.953941:0:23949:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 30064771561 00000100:00100000:1.0:1787827095.953944:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134299264:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 299us (454us total) trans 0 rc 0/0 00010000:00080000:0.0:1787827095.953946:0:23949:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 30064771561 00010000:00080000:0.0:1787827095.953955:0:23949:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 30064771561 00000100:00100000:1.0:1787827095.953958:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 221 00000100:00100000:0.0:1787827095.954893:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827095.954964:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299392 00000100:00100000:2.0:1787827095.954969:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299392 00000100:00100000:2.0:1787827095.955035:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 585 00000100:00100000:2.0:1787827095.955045:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134299392:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787827095.955063:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787827095.955077:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787827095.955081:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787827095.955420:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827095.955453:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299520 00000100:00100000:3.0:1787827095.955465:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299520 00000100:00100000:3.0:1787827095.955502:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 276 00000100:00100000:3.0:1787827095.955510:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e071680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134299520:12345-192.168.203.6@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787827095.955522:0:19009:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d546e071680 x1874672134299520/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:696/0 lens 224/0 e 0 to 0 dl 1787827106 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827095.955544:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e071680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134299520:12345-192.168.203.6@tcp:400:ldlm_lock_repla.0 Request processed in 36us (126us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787827095.955551:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 276 00010000:00080000:2.0:1787827095.955571:0:23949:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 30064771561 00010000:00080000:2.0:1787827095.955576:0:23949:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:2.0:1787827095.955583:0:23949:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787827095.955585:0:23949:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1787827095.955700:0:23949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738368 00000100:00100000:3.0:1787827095.956506:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134299392:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 1461us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827095.956516:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 585 00000001:00100000:1.0:1787827095.959671:0:23933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:1.0:1787827095.959682:0:23933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787827095.959688:0:23933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787827095.959982:0:23949:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:3.0:1787827095.960000:0:23949:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d546e071a40 x1874672143816064/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:696/0 lens 224/0 e 0 to 0 dl 1787827106 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787827095.960161:0:23949:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d546e10a580 x1874672143816192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:696/0 lens 224/0 e 0 to 0 dl 1787827106 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787827095.960212:0:23949:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d546e071680 x1874672134299520/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:696/0 lens 224/0 e 0 to 0 dl 1787827106 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1787827095.960294:0:23949:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00010000:00080000:1.0:1787827095.960656:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e10b480 x1874672143816064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827111 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827095.960672:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787827095.960679:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d546e10b480 x1874672143816064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827111 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827095.960696:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d546e10b480 x1874672143816064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827111 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827095.960703:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1787827095.960715:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1787827095.960717:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787827095.961370:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b583c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143816448:0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787827095.961427:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827095.961453:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54506bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1787827095.961468:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e070f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143816320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827095.961493:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827095.961528:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816448 00000100:00100000:2.0:1787827095.961535:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816448 00000100:00100000:2.0:1787827095.961575:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787827095.961584:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143816448:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787827095.961822:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816320 00000100:00100000:2.0:1787827095.961826:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816320 00000100:00100000:2.0:1787827095.961869:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787827095.961878:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143816320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787827095.961892:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8388608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827095.961936:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143816320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827095.961942:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00080000:2.0:1787827095.961977:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e070f00 x1874672143816320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827095.961991:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e070f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143816320:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787827095.965663:0:10061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787827095.965671:0:10061:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x41:0x0] 00000100:00100000:2.0:1787827095.965772:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143816448:12345-0@lo:7:osp-pre-0-0.0 Request processed in 4185us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827095.965783:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:2.0:1787827095.965841:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b583c0 x1874672143816448/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787827111 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827095.965856:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b583c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143816448:0@lo:7:osp-pre-0-0.0 00000004:00080000:2.0:1787827095.965878:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x41:0x0] 00002000:00080000:3.0:1787827095.966337:0:23949:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787827095.966343:0:23949:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00080000:1.0:1787827095.972194:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008c1efc06): req@ffff8d547fa6b480 x1874672143806720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787827097 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827095.972298:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143816064:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787827095.972386:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787827095.972493:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e0730c0 x1874672143816192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827111 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827095.972509:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00100000:3.0:1787827095.972512:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806720 00000100:00080000:1.0:1787827095.972517:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d546e0730c0 x1874672143816192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827111 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827095.972521:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806720 00000100:00080000:1.0:1787827095.972531:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d546e0730c0 x1874672143816192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827111 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827095.972539:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1787827095.972559:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1787827095.972563:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1787827095.972569:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009f8725f1): req@ffff8d5347a30f00 x1874672143806592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787827097 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827095.972577:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787827095.972589:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143806720:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827095.972591:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e0730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143816192:0@lo:400:ldlm_lock_repla.0 00002000:00000024:3.0:1787827095.972640:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827095.972667:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827095.972712:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143806720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827095.972715:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143806592 00000100:00100000:1.0:1787827095.972720:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143806592 00000100:00100000:3.0:1787827095.972722:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00080000:3.0:1787827095.972761:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fa6b480 x1874672143806720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827111 ref 1 fl Rpc:RQU/202/0 rc -107/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827095.972764:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787827095.972777:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143806592:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827095.972782:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143806720:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787827095.972792:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827095.972835:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143806592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827095.972841:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00080000:3.0:1787827095.972912:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5347a30f00 x1874672143806592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827111 ref 1 fl Rpc:RQU/202/0 rc -107/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827095.972937:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5347a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143806592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827095.972958:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143816576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827095.972966:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e108f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143816704:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787827095.973003:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827095.973009:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827095.973033:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54533fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1787827095.973045:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816576 00000100:00100000:3.0:1787827095.973050:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816576 00000100:00100000:0.0:1787827095.973052:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816704 00000100:00100000:0.0:1787827095.973056:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816704 00000100:00100000:3.0:1787827095.973077:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787827095.973087:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143816576:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827095.973093:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787827095.973103:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:9485:x1874672143816704:12345-0@lo:7:osp-pre-0-1.0 00002000:00000024:3.0:1787827095.973109:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827095.973145:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143816576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827095.973151:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00080000:3.0:1787827095.973178:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e108000 x1874672143816576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827095.973205:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143816576:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1787827095.974197:0:19008:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787827095.974203:0:19008:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787827095.974290:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143816704:12345-0@lo:7:osp-pre-0-1.0 Request processed in 1186us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827095.974299:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:1.0:1787827095.974320:0:9485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e108f00 x1874672143816704/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787827111 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827095.974332:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e108f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143816704:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787827095.974342:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00010000:00010000:1.0:1787827096.785333:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787827096.791183:0:24289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1787827097.177411:0:24341:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787827097.177610:0:24341:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787827097.560199:0:24391:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827097.560690:0:24391:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787827097.809431:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827098.833367:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827098.885009:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827098.885157:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299648 00000100:00100000:2.0:1787827098.885166:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299648 00000100:00080000:3.0:1787827098.885233:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827098.885406:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 161 00000100:00100000:2.0:1787827098.885429:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21024:x1874672134299648:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787827098.885465:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827098.885526:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21024:x1874672134299648:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 100us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827098.885533:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 161 00000100:00100000:2.0:1787827098.887527:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827098.887593:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299776 00000100:00100000:3.0:1787827098.887601:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299776 00000100:00080000:2.0:1787827098.887654:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827098.887672:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 162 00000100:00100000:3.0:1787827098.887683:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21024:x1874672134299776:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787827098.887710:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827098.887762:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21024:x1874672134299776:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827098.887770:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 162 00000100:00100000:3.0:1787827098.889110:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827098.889159:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134299904 00000100:00100000:1.0:1787827098.889164:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134299904 00000100:00100000:1.0:1787827098.889209:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 311 00000100:00080000:2.0:1787827098.889243:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827098.889275:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21024:x1874672134299904:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787827098.889297:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827098.889359:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21024:x1874672134299904:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 144us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827098.889364:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 311 00000100:00100000:1.0:1787827098.890142:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827098.890180:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300032 00000100:00100000:2.0:1787827098.890184:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300032 00000100:00100000:2.0:1787827098.890209:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 224 00000100:00100000:2.0:1787827098.890232:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134300032:12345-192.168.203.6@tcp:8:lfs.0 00010000:00080000:2.0:1787827098.890258:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1787827098.890283:0:8402:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a7954505 00002000:00100000:2.0:1787827098.890290:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d5478923800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787827098.890301:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787827098.890362:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787827098.890388:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d5478926000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827098.890419:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134300032:12345-192.168.203.6@tcp:8:lfs.0 Request processed in 188us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827098.890430:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 224 00000100:00100000:2.0:1787827098.891074:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827098.891121:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300160 00000100:00100000:3.0:1787827098.891126:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300160 00000100:00080000:2.0:1787827098.891159:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827098.891165:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 312 00000100:00100000:3.0:1787827098.891175:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:21024:x1874672134300160:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787827098.891187:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827098.891247:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:21024:x1874672134300160:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827098.891254:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 312 00000100:00100000:3.0:1787827099.729349:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787827099.729370:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143816832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827099.729445:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827099.729613:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816832 00000100:00100000:1.0:1787827099.729621:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816832 00000100:00100000:1.0:1787827099.729668:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787827099.729678:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143816832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787827099.729712:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827099.729765:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143816832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827099.729771:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787827099.729807:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143816832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827099.730413:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143816960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827099.730447:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827099.730495:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143816960 00000100:00100000:2.0:1787827099.730500:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143816960 00000100:00100000:2.0:1787827099.730540:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787827099.730549:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143816960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787827099.730564:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827099.730609:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143816960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827099.730617:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:2.0:1787827099.730639:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827099.730659:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143817088:0@lo:400:kworker.0 00000100:00100000:2.0:1787827099.730700:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827099.730733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143817344:0@lo:400:kworker.0 00000100:00100000:2.0:1787827099.730744:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143817600:0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.730767:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827099.730775:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827099.730786:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817088 00000100:00100000:1.0:1787827099.730792:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143817856:0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.730793:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817088 00000100:00100000:2.0:1787827099.730798:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143817984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827099.730831:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827099.730833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827099.730847:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1787827099.730856:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143818368:0@lo:400:kworker.0 00000100:00100000:2.0:1787827099.730859:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787827099.730862:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143817088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827099.730868:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143817472:0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.730890:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827099.730914:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787827099.730919:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827099.730923:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143817216:0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.730931:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143817088:12345-0@lo:400:kworker.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827099.730940:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1787827099.730950:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143818112:0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.730955:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827099.730980:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817344 00000100:00100000:2.0:1787827099.730981:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827099.730983:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143817728:0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.730987:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817344 00000100:00100000:2.0:1787827099.731003:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143818496:0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.731021:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827099.731023:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817856 00000100:00100000:0.0:1787827099.731028:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817856 00000100:00100000:2.0:1787827099.731036:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827099.731047:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143818240:0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.731058:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143818368 00000100:00100000:0.0:1787827099.731063:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143818368 00000100:00100000:2.0:1787827099.731070:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534479da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143817088:0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.731076:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827099.731086:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817216 00000100:00100000:0.0:1787827099.731091:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817216 00000100:00100000:2.0:1787827099.731109:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143818112 00000100:00100000:2.0:1787827099.731114:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143818112 00000100:00100000:0.0:1787827099.731119:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143818496 00000100:00100000:0.0:1787827099.731125:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143818496 00000100:00100000:2.0:1787827099.731154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1787827099.731164:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143817344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.731166:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1787827099.731181:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143817856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827099.731246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143817344:12345-0@lo:400:kworker.0 Request processed in 84us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827099.731254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1787827099.731261:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143817856:12345-0@lo:400:kworker.0 Request processed in 83us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827099.731261:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1787827099.731269:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1787827099.731271:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143818368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827099.731275:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1787827099.731290:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1787827099.731291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143817216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.731303:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143818112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827099.731308:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143818368:12345-0@lo:400:kworker.0 Request processed in 40us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827099.731320:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1787827099.731336:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143817216:12345-0@lo:400:kworker.0 Request processed in 50us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827099.731340:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1787827099.731350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1787827099.731352:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143818496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.731356:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143818112:12345-0@lo:400:kworker.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827099.731370:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1787827099.731387:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817600 00000100:00100000:3.0:1787827099.731388:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143818496:12345-0@lo:400:kworker.0 Request processed in 38us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827099.731393:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817600 00000100:00100000:3.0:1787827099.731397:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1787827099.731418:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817472 00000100:00100000:3.0:1787827099.731423:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817472 00000100:00100000:2.0:1787827099.731429:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817728 00000100:00100000:2.0:1787827099.731433:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817728 00000100:00100000:3.0:1787827099.731455:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787827099.731462:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143818240 00000100:00100000:3.0:1787827099.731466:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5451bc4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143817472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827099.731467:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143818240 00000100:00100000:0.0:1787827099.731491:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787827099.731499:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787827099.731505:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143817600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827099.731506:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5451bc4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143817472:12345-0@lo:400:kworker.0 Request processed in 45us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827099.731513:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143817728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827099.731515:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787827099.731543:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143817600:12345-0@lo:400:kworker.0 Request processed in 44us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827099.731548:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787827099.731569:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143817728:12345-0@lo:400:kworker.0 Request processed in 60us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827099.731586:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787827099.731595:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787827099.731600:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143818240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.731607:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143817472:0@lo:400:kworker.0 00000100:00080000:2.0:1787827099.731622:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787827099.731626:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787827099.731628:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfd680 x1874672143818112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787827099.731630:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787827099.731636:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827099.731641:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143818240:12345-0@lo:400:kworker.0 Request processed in 44us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827099.731645:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143818112:0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.731656:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787827099.731669:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143817216:0@lo:400:kworker.0 00010000:00080000:1.0:1787827099.731670:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfe580 x1874672143818496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827099.731686:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143818496:0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.731699:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143817984 00010000:00080000:2.0:1787827099.731699:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfc3c0 x1874672143817728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827099.731705:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143817984 00010000:00080000:1.0:1787827099.731709:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbff0c0 x1874672143817600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827099.731731:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787827099.731744:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143817984:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827099.731748:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143817728:0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.731749:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143817600:0@lo:400:kworker.0 00002000:00000024:0.0:1787827099.731758:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1787827099.731776:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfe1c0 x1874672143818240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827099.731787:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143818240:0@lo:400:kworker.0 00000100:00100000:0.0:1787827099.731793:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143817984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827099.731801:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00080000:1.0:1787827099.731804:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e10bc00 x1874672143817984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827099.731808:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143817344:0@lo:400:kworker.0 00000100:00100000:1.0:1787827099.731830:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143817984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827099.731836:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143817856:0@lo:400:kworker.0 00010000:00080000:0.0:1787827099.731840:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b5b0c0 x1874672143816960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827099.731857:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143816960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827099.731859:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143818368:0@lo:400:kworker.0 00010000:00010000:0.0:1787827099.857353:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827100.754342:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143818624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827100.754416:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827100.754507:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143818624 00000100:00100000:2.0:1787827100.754514:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143818624 00000100:00100000:2.0:1787827100.754555:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787827100.754578:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143818624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787827100.754609:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787827100.754661:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143818624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827100.754669:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787827100.754702:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143818624:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787827100.756880:0:24583:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:1.0:1787827100.881418:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827101.072891:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827101.072937:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300288 00000100:00100000:0.0:1787827101.072944:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300288 00000100:00100000:3.0:1787827101.072973:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827101.072997:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 587 00000100:00100000:0.0:1787827101.073009:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134300288:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827101.073030:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300544 00000100:00100000:1.0:1787827101.073036:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300544 00000100:00100000:3.0:1787827101.073070:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827101.073085:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134300288:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827101.073093:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 552 00000100:00100000:0.0:1787827101.073096:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 587 00000100:00100000:1.0:1787827101.073110:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134300544:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827101.073147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134300544:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827101.073155:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 552 00000100:00100000:0.0:1787827101.073173:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00080000:1.0:1787827101.073185:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827101.073196:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300416 00000100:00100000:1.0:1787827101.073199:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300416 00000100:00100000:0.0:1787827101.073212:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827101.073270:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 553 00000100:00100000:1.0:1787827101.073280:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134300416:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827101.073293:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300800 00000100:00100000:3.0:1787827101.073294:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300672 00000100:00100000:0.0:1787827101.073299:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300800 00000100:00100000:3.0:1787827101.073301:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300672 00000100:00100000:1.0:1787827101.073322:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134300416:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827101.073329:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 553 00000100:00100000:0.0:1787827101.073340:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 280 00000100:00100000:0.0:1787827101.073351:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134300800:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827101.073381:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134300800:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827101.073388:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 281 00000100:00100000:0.0:1787827101.073396:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 280 00000100:00100000:3.0:1787827101.073402:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134300672:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787827101.073425:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787827101.073429:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827101.073431:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827101.073586:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134300672:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 188us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827101.073708:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 281 00000100:00100000:1.0:1787827101.265425:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787827101.265555:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143818752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827101.265653:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827101.265706:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143818752 00000100:00100000:2.0:1787827101.265715:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143818752 00000100:00080000:1.0:1787827101.265750:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827101.265779:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787827101.265792:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143818752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787827101.265833:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787827101.265881:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143818752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827101.265888:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00080000:1.0:1787827101.265925:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b58f00 x1874672143818752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827101.265946:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143818752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827101.266380:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787827101.266395:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143818880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827101.266426:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827101.266466:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143818880 00000100:00100000:1.0:1787827101.266471:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143818880 00000100:00100000:1.0:1787827101.266519:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00080000:2.0:1787827101.266522:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827101.266530:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143818880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787827101.266542:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827101.266593:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143818880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827101.266600:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00080000:3.0:1787827101.266608:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbbf480 x1874672143818880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827101.266622:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143818880:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1787827101.298578:0:24632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1787827101.905379:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827102.609176:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827102.609246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134300928 00000100:00100000:1.0:1787827102.609256:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134300928 00000100:00100000:1.0:1787827102.609312:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 163 00000100:00100000:1.0:1787827102.609323:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21492:x1874672134300928:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787827102.609363:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827102.609430:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21492:x1874672134300928:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827102.609438:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 163 00000100:00100000:0.0:1787827102.610310:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827102.610349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301056 00000100:00100000:1.0:1787827102.610354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301056 00000100:00100000:1.0:1787827102.610378:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 164 00000100:00100000:1.0:1787827102.610398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21492:x1874672134301056:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787827102.610418:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827102.610458:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21492:x1874672134301056:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827102.610462:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 164 00000100:00100000:2.0:1787827102.611714:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827102.611761:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301184 00000100:00100000:1.0:1787827102.611767:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301184 00000100:00100000:1.0:1787827102.611803:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 317 00000100:00100000:1.0:1787827102.611811:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21492:x1874672134301184:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787827102.611826:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827102.611870:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21492:x1874672134301184:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827102.611877:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 317 00000100:00100000:2.0:1787827102.613038:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827102.613125:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301312 00000100:00100000:3.0:1787827102.613130:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301312 00000100:00100000:3.0:1787827102.613158:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 318 00000100:00100000:3.0:1787827102.613163:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:21492:x1874672134301312:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787827102.613182:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827102.613243:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:21492:x1874672134301312:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827102.613249:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 318 00010000:00010000:2.0:1787827102.929359:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787827103.783888:0:24825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 00000100:00100000:0.0:1787827103.824951:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827103.824995:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301440 00000100:00100000:1.0:1787827103.825011:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301440 00000100:00080000:2.0:1787827103.825066:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827103.825069:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 165 00000100:00100000:1.0:1787827103.825082:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21562:x1874672134301440:12345-192.168.203.6@tcp:101:checkstat.0 00010000:00010000:1.0:1787827103.825101:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827103.825118:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795450c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467610 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825165:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825183:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825203:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825248:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825257:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825265:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825304:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825309:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825314:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825318:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112a00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827103.825321:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825327:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825338:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827103.825341:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827103.825354:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825367:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954513 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825382:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825387:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825391:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825394:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827103.825397:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825407:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825416:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xad0f7562 (ffff8d5453332100) 00010000:00010000:1.0:1787827103.825419:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827103.825422:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825428:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a795451a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xad0f7562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825465:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795450c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467610 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825488:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827103.825496:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827103.825500:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795450c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467610 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827103.825510:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345112c00, rc 0) 00000100:00100000:1.0:1787827103.825574:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21562:x1874672134301440:12345-192.168.203.6@tcp:101:checkstat.0 Request processed in 495us (632us total) trans 0 rc 301/301 00000100:00100000:1.0:1787827103.825582:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 165 00010000:00010000:0.0:1787827103.953336:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827104.849427:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143819392:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.849475:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143819264:0@lo:400:kworker.0 00000100:00100000:2.0:1787827104.849502:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143819520:0@lo:400:kworker.0 00000100:00100000:3.0:1787827104.849515:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827104.849520:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827104.849599:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143819776:0@lo:400:kworker.0 00000100:00100000:3.0:1787827104.849611:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143819904:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.849627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827104.849652:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827104.849664:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143820288:0@lo:400:kworker.0 00000100:00100000:3.0:1787827104.849684:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143820416:0@lo:400:kworker.0 00000100:00100000:0.0:1787827104.849686:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143819136:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.849695:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827104.849724:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e1083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143820800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827104.849733:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827104.849737:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827104.849754:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827104.849803:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819392 00000100:00100000:2.0:1787827104.849810:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819392 00000100:00100000:2.0:1787827104.849854:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787827104.849864:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143819392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827104.850030:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342440780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143819008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827104.850033:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819264 00000100:00100000:3.0:1787827104.850040:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819264 00000100:00100000:2.0:1787827104.850042:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143819392:12345-0@lo:400:kworker.0 Request processed in 178us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827104.850048:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820800 00000100:00100000:2.0:1787827104.850052:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787827104.850054:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820800 00000100:00100000:0.0:1787827104.850059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827104.850088:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819008 00000100:00100000:3.0:1787827104.850089:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1787827104.850093:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819008 00000100:00100000:0.0:1787827104.850094:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143819648:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850105:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787827104.850107:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143819264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850117:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143820800:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827104.850123:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787827104.850132:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827104.850133:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143819008:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1787827104.850141:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827104.850150:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143820160:0@lo:400:kworker.0 00000004:00000024:2.0:1787827104.850154:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827104.850172:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143819264:12345-0@lo:400:kworker.0 Request processed in 71us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827104.850186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827104.850193:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143820800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827104.850195:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143819008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827104.850196:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1787827104.850205:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143820672:0@lo:400:kworker.0 00000100:00100000:2.0:1787827104.850207:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787827104.850241:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787827104.850242:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820160 00000100:00100000:2.0:1787827104.850248:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819648 00000100:00100000:3.0:1787827104.850249:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820160 00000100:00100000:0.0:1787827104.850254:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827104.850254:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819648 00000100:00100000:2.0:1787827104.850282:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787827104.850290:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143819648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820672 00000100:00100000:1.0:1787827104.850299:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820672 00000100:00100000:3.0:1787827104.850301:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1787827104.850306:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342440780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143819008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827104.850315:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143820160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827104.850325:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143819648:12345-0@lo:400:kworker.0 Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827104.850331:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143819648:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850338:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1787827104.850339:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787827104.850352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143820672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787827104.850361:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787827104.850367:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827104.850375:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143820160:12345-0@lo:400:kworker.0 Request processed in 63us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827104.850379:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819776 00000100:00100000:0.0:1787827104.850385:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819776 00000100:00100000:2.0:1787827104.850385:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827104.850389:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1787827104.850402:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e109680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143820672:12345-0@lo:400:kworker.0 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827104.850409:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143820032:0@lo:400:kworker.0 00000100:00100000:3.0:1787827104.850410:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819520 00000100:00100000:1.0:1787827104.850411:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1787827104.850417:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819520 00000100:00100000:0.0:1787827104.850428:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819904 00000100:00100000:0.0:1787827104.850433:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819904 00000100:00100000:2.0:1787827104.850444:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827104.850459:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820288 00000100:00100000:3.0:1787827104.850462:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820032 00000100:00100000:0.0:1787827104.850463:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820288 00000100:00100000:2.0:1787827104.850463:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143820544:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850467:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143819136 00000100:00100000:3.0:1787827104.850469:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820032 00000100:00100000:1.0:1787827104.850473:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143819136 00000100:00100000:0.0:1787827104.850486:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820416 00000100:00100000:2.0:1787827104.850486:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827104.850490:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820416 00000100:00100000:3.0:1787827104.850506:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820544 00000100:00100000:2.0:1787827104.850508:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787827104.850512:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820544 00000100:00100000:2.0:1787827104.850517:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143820928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827104.850518:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787827104.850518:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1787827104.850536:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143819776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850536:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143819136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827104.850558:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1787827104.850560:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827104.850572:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143819520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827104.850597:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143820928 00000100:00100000:0.0:1787827104.850602:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143819776:12345-0@lo:400:kworker.0 Request processed in 74us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827104.850602:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143819136:12345-0@lo:400:kworker.0 Request processed in 71us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827104.850603:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143820928 00000100:00100000:0.0:1787827104.850620:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787827104.850620:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1787827104.850630:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143819520:12345-0@lo:400:kworker.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827104.850635:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787827104.850640:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787827104.850646:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1787827104.850650:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143819904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827104.850650:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143820928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827104.850662:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00002000:00000024:2.0:1787827104.850663:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827104.850670:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1787827104.850674:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143820288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827104.850686:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143820032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827104.850692:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143819904:12345-0@lo:400:kworker.0 Request processed in 43us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827104.850692:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143820928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827104.850702:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787827104.850702:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787827104.850715:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143820288:12345-0@lo:400:kworker.0 Request processed in 45us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827104.850722:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00080000:2.0:1787827104.850726:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787827104.850730:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787827104.850733:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827104.850740:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787827104.850741:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143820416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827104.850741:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143820032:12345-0@lo:400:kworker.0 Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827104.850757:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1787827104.850783:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1787827104.850788:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143820416:12345-0@lo:400:kworker.0 Request processed in 53us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827104.850795:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143820544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827104.850798:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787827104.850833:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143819136:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850845:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143820544:12345-0@lo:400:kworker.0 Request processed in 50us (353us total) trans 0 rc 0/0 00010000:00080000:2.0:1787827104.850845:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e10ad00 x1874672143820928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787827104.850857:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dc000 x1874672143820160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827104.850861:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1787827104.850880:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143820160:0@lo:400:kworker.0 00000100:00100000:2.0:1787827104.850882:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143820928:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787827104.850912:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dda40 x1874672143820672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827104.850923:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143820672:0@lo:400:kworker.0 00010000:00080000:1.0:1787827104.850936:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e1083c0 x1874672143820800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827104.850940:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143819520:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.850954:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e1083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143820800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827104.850971:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143819264:0@lo:400:kworker.0 00000100:00100000:2.0:1787827104.850981:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143820032:0@lo:400:kworker.0 00010000:00080000:1.0:1787827104.850987:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbbe940 x1874672143819776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827104.850992:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143820544:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.851004:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143819776:0@lo:400:kworker.0 00010000:00080000:1.0:1787827104.851019:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477df480 x1874672143820288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827104.851028:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143820288:0@lo:400:kworker.0 00010000:00080000:1.0:1787827104.851059:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbbf840 x1874672143819904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827104.851067:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143819904:0@lo:400:kworker.0 00010000:00080000:1.0:1787827104.851075:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dde00 x1874672143820416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827104.851082:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143820416:0@lo:400:kworker.0 00000100:00100000:1.0:1787827104.851090:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143819392:0@lo:400:kworker.0 00000001:00100000:2.0:1787827104.851379:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:1.0:1787827104.977442:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827105.873369:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143821056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827105.873431:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827105.873488:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821056 00000100:00100000:1.0:1787827105.873497:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821056 00000100:00100000:1.0:1787827105.873562:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787827105.873573:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143821056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787827105.873622:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827105.873680:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143821056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827105.873689:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787827105.873714:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143821056:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787827106.001388:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827106.193170:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827106.193252:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301696 00000100:00100000:2.0:1787827106.193259:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827106.193264:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301696 00000100:00100000:2.0:1787827106.193291:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827106.193294:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301568 00000100:00100000:0.0:1787827106.193301:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301568 00000100:00100000:2.0:1787827106.193312:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827106.193343:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827106.193344:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301824 00000100:00080000:1.0:1787827106.193348:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827106.193350:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301824 00000100:00100000:0.0:1787827106.193362:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 589 00000100:00100000:0.0:1787827106.193374:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134301568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827106.193390:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134301952 00000100:00100000:1.0:1787827106.193395:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134301952 00000100:00100000:3.0:1787827106.193399:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 560 00000100:00100000:2.0:1787827106.193410:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 561 00000100:00100000:3.0:1787827106.193412:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134301696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827106.193425:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134301824:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827106.193434:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302080 00000100:00100000:1.0:1787827106.193439:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302080 00000100:00100000:0.0:1787827106.193445:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134301568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827106.193454:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 589 00000100:00100000:3.0:1787827106.193460:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134301696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 51us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827106.193462:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134301824:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827106.193474:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 560 00000100:00100000:1.0:1787827106.193480:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 286 00000100:00100000:2.0:1787827106.193484:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 561 00000100:00100000:1.0:1787827106.193493:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134301952:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827106.193543:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 287 00000100:00100000:2.0:1787827106.193554:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534479da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134302080:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827106.193559:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134301952:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827106.193566:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 286 00000100:00080000:1.0:1787827106.193587:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827106.193590:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534479da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134302080:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827106.193592:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787827106.193598:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827106.193602:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 287 00000100:00100000:3.0:1787827106.385429:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e072580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143821312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827106.385501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827106.385558:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821312 00000100:00100000:1.0:1787827106.385565:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821312 00000100:00100000:3.0:1787827106.385577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143821184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827106.385597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787827106.385618:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827106.385633:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821184 00000100:00100000:1.0:1787827106.385637:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821184 00000100:00100000:2.0:1787827106.385651:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787827106.385677:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143821312:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827106.385691:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787827106.385699:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143821184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787827106.385710:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00002000:00000024:1.0:1787827106.385711:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787827106.385712:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827106.385776:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143821184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827106.385779:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143821312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827106.385790:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787827106.385795:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00080000:0.0:1787827106.385816:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e072580 x1874672143821312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827106.385835:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e072580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143821312:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787827106.385848:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477df480 x1874672143821184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827106.385859:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143821184:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787827107.025343:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787827107.830008:0:25097:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787827107.830017:0:25097:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:1.0:1787827107.855599:0:25109:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787827107.855608:0:25109:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1787827107.873976:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827107.874023:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302208 00000100:00100000:1.0:1787827107.874038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302208 00000100:00100000:1.0:1787827107.874098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:1.0:1787827107.874110:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e070f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21771:x1874672134302208:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787827107.874147:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827107.874238:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e070f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:21771:x1874672134302208:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 130us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827107.874247:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:1.0:1787827107.875372:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827107.875439:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302336 00000100:00100000:2.0:1787827107.875446:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302336 00000100:00100000:2.0:1787827107.875489:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 167 00000100:00100000:2.0:1787827107.875500:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21771:x1874672134302336:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787827107.875535:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787827107.875585:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21771:x1874672134302336:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827107.875592:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 167 00000100:00100000:2.0:1787827107.876631:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827107.876672:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302464 00000100:00100000:1.0:1787827107.876679:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302464 00000100:00100000:1.0:1787827107.876732:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 323 00000100:00100000:1.0:1787827107.876742:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21771:x1874672134302464:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787827107.876761:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827107.876801:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21771:x1874672134302464:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 61us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827107.876809:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 323 00000100:00100000:1.0:1787827107.877513:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827107.877569:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302592 00000100:00100000:2.0:1787827107.877575:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302592 00000100:00100000:2.0:1787827107.877612:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 324 00000100:00100000:2.0:1787827107.877622:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21771:x1874672134302592:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:2.0:1787827107.877644:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827107.877681:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:21771:x1874672134302592:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827107.877687:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 324 00010000:00010000:0.0:1787827108.049437:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787827108.423849:0:25167:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: free_before: 7663128 free_after: 7663128 00010000:00010000:1.0:1787827109.073348:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827109.969415:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143821440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827109.969491:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827109.969497:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143821824:0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.969535:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143821696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827109.969566:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.969573:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e10ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143821568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827109.969599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.969619:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143821952:0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.969625:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821824 00000100:00100000:1.0:1787827109.969632:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821824 00000100:00100000:2.0:1787827109.969639:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143822336:0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.969674:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1787827109.969684:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143821824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.969757:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.969775:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143822464:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.969791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.969814:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143822976:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.969828:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.969842:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787827109.969846:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143822080:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.969860:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827109.969929:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143822208:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.969930:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143822592:0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.969938:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143821824:12345-0@lo:400:kworker.0 Request processed in 255us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827109.969944:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827109.969956:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1787827109.969969:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827109.969980:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143822848:0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.969983:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.969993:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143823104:0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.970007:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822464 00000100:00100000:1.0:1787827109.970011:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822464 00000100:00100000:3.0:1787827109.970019:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143822720:0@lo:400:kworker.0 00000100:00100000:2.0:1787827109.970020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.970030:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827109.970046:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822976 00000100:00100000:1.0:1787827109.970049:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822976 00000100:00100000:3.0:1787827109.970061:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827109.970072:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822848 00000100:00100000:1.0:1787827109.970072:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822336 00000100:00100000:2.0:1787827109.970072:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143821824:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.970078:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822848 00000100:00100000:1.0:1787827109.970078:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822336 00000100:00100000:3.0:1787827109.970095:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143823232:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.970119:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787827109.970124:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827109.970128:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787827109.970129:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143822464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.970135:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143822976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827109.970137:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787827109.970151:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143822848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.970167:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821440 00000100:00100000:3.0:1787827109.970172:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821440 00000100:00100000:0.0:1787827109.970175:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143822464:12345-0@lo:400:kworker.0 Request processed in 46us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827109.970175:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143822976:12345-0@lo:400:kworker.0 Request processed in 39us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827109.970184:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787827109.970188:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787827109.970201:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787827109.970207:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e0730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143822848:12345-0@lo:400:kworker.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827109.970210:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822208 00000100:00100000:1.0:1787827109.970230:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143822336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.970240:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822208 00010000:00080000:0.0:1787827109.970254:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c2580 x1874672143822464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827109.970259:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e072940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143822336:12345-0@lo:400:kworker.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827109.970266:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787827109.970271:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143822464:0@lo:400:kworker.0 00010000:00080000:0.0:1787827109.970284:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c0780 x1874672143822976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827109.970284:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827109.970284:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00080000:1.0:1787827109.970289:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827109.970300:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143822976:0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.970302:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821952 00000100:00100000:2.0:1787827109.970303:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787827109.970307:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e1083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143821440:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827109.970308:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821952 00000100:00100000:1.0:1787827109.970330:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822080 00000100:00100000:1.0:1787827109.970335:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822080 00000100:00100000:2.0:1787827109.970338:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822592 00000004:00000024:3.0:1787827109.970339:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827109.970345:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822592 00000100:00100000:1.0:1787827109.970350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143823104 00000100:00100000:1.0:1787827109.970354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143823104 00000100:00100000:0.0:1787827109.970358:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143822720 00000100:00100000:0.0:1787827109.970369:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143822720 00000100:00100000:1.0:1787827109.970384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143823232 00000100:00100000:3.0:1787827109.970387:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e1083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143821440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827109.970388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143823232 00000100:00100000:2.0:1787827109.970392:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1787827109.970401:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1787827109.970402:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787827109.970407:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143821952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.970415:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143822080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.970415:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1787827109.970425:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143822592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.970429:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787827109.970440:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143822208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827109.970467:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143821952:12345-0@lo:400:kworker.0 Request processed in 65us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827109.970469:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143822080:12345-0@lo:400:kworker.0 Request processed in 56us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827109.970469:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143822592:12345-0@lo:400:kworker.0 Request processed in 47us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827109.970481:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1787827109.970487:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1787827109.970493:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143822208:12345-0@lo:400:kworker.0 Request processed in 54us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827109.970494:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1787827109.970516:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1787827109.970517:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787827109.970525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1787827109.970530:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143823104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.970531:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1787827109.970536:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143822720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.970540:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143823232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.970547:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821696 00000100:00100000:3.0:1787827109.970553:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821696 00000100:00100000:2.0:1787827109.970593:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143823104:12345-0@lo:400:kworker.0 Request processed in 66us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827109.970596:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143823232:12345-0@lo:400:kworker.0 Request processed in 55us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827109.970596:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143822720:12345-0@lo:400:kworker.0 Request processed in 62us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827109.970599:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787827109.970608:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1787827109.970613:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143821696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827109.970615:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1787827109.970624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00002000:00000024:3.0:1787827109.970638:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787827109.970648:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827109.970653:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787827109.970668:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c2d00 x1874672143822336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827109.970678:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827109.970684:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143821696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827109.970688:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143822336:0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.970693:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787827109.970699:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143822080:0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.970713:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143821568 00000100:00100000:1.0:1787827109.970718:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143821440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827109.970719:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143821568 00000100:00100000:0.0:1787827109.970723:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143822592:0@lo:400:kworker.0 00010000:00080000:2.0:1787827109.970724:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c0f00 x1874672143822848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827109.970740:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143822848:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.970744:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143823104:0@lo:400:kworker.0 00000100:00100000:1.0:1787827109.970753:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143822208:0@lo:400:kworker.0 00000100:00100000:0.0:1787827109.970760:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143821952:0@lo:400:kworker.0 00000100:00100000:3.0:1787827109.970762:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00010000:00080000:1.0:1787827109.970768:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c1a40 x1874672143822720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827109.970775:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143821568:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827109.970782:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143822720:0@lo:400:kworker.0 00002000:00000024:3.0:1787827109.970789:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1787827109.970796:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c1e00 x1874672143823232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827109.970807:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143823232:0@lo:400:kworker.0 00010000:00080000:1.0:1787827109.970818:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5342442580 x1874672143821696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827109.970830:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143821696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827109.970833:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143821568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827109.970842:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00080000:0.0:1787827109.971117:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e10ad00 x1874672143821568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827109.971130:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e10ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143821568:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787827110.097984:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787827110.953132:0:25362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 7: Fail OST before obd_destroy ========================================================== 06:38:30 (1787827110) 00000100:00100000:0.0:1787827110.993450:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143823360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827110.993551:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827110.993611:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143823360 00000100:00100000:3.0:1787827110.993622:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143823360 00000100:00100000:3.0:1787827110.993685:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787827110.993693:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143823360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827110.993739:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827110.993810:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143823360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827110.993819:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787827110.993868:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143823360:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827111.121466:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827111.313121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827111.313162:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827111.313179:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302720 00000100:00100000:1.0:1787827111.313189:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302720 00000100:00100000:0.0:1787827111.313198:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827111.313255:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302848 00000100:00100000:3.0:1787827111.313257:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134303104 00000100:00100000:2.0:1787827111.313262:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302848 00000100:00100000:3.0:1787827111.313264:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134303104 00000100:00100000:0.0:1787827111.313281:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827111.313297:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 591 00000100:00100000:1.0:1787827111.313310:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134302720:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827111.313321:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827111.313326:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134302976 00000100:00100000:3.0:1787827111.313326:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 292 00000100:00100000:2.0:1787827111.313332:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134302976 00000100:00100000:3.0:1787827111.313339:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303104:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827111.313366:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 568 00000100:00080000:0.0:1787827111.313368:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827111.313373:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787827111.313376:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827111.313379:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134302848:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827111.313398:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 569 00000100:00100000:1.0:1787827111.313398:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134302720:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827111.313399:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303104:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827111.313414:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 292 00000100:00100000:0.0:1787827111.313417:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134302976:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827111.313420:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e10ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134302848:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827111.313429:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 591 00000100:00100000:3.0:1787827111.313436:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134303232 00000100:00100000:2.0:1787827111.313437:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 568 00000100:00100000:3.0:1787827111.313442:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134303232 00000100:00100000:0.0:1787827111.313463:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134302976:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827111.313473:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 569 00000100:00100000:3.0:1787827111.313508:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 293 00000100:00100000:3.0:1787827111.313519:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d355e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134303232:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787827111.313530:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827111.313554:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d355e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134303232:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827111.313578:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 293 00000100:00100000:0.0:1787827111.505609:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143823488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827111.505614:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143823616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827111.505751:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827111.505794:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827111.505853:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143823616 00000100:00100000:2.0:1787827111.505862:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143823616 00000100:00080000:0.0:1787827111.505908:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827111.505919:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143823488 00000100:00100000:2.0:1787827111.505924:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143823488 00000100:00080000:0.0:1787827111.505950:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827111.505958:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787827111.505968:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143823616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787827111.505996:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827111.505997:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787827111.506010:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143823488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787827111.506025:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787827111.506052:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143823616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827111.506061:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787827111.506078:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143823488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (282us total) trans 0 rc 0/0 00010000:00080000:3.0:1787827111.506080:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53477dc000 x1874672143823616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787827111.506090:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c1e00 x1874672143823488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827111.506091:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787827111.506119:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143823616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827111.506125:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143823488:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787827112.145539:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827113.169589:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827114.193404:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827115.089529:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143823744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827115.089549:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143824128:0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.089599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827115.089606:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827115.089643:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5342443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143824000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827115.089666:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143824256:0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.089670:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143824640:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.089682:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827115.089746:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143823744 00000100:00100000:1.0:1787827115.089754:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143823744 00000100:00100000:0.0:1787827115.089761:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143824512:0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.089774:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827115.089774:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787827115.089800:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827115.089801:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824000 00000100:00100000:1.0:1787827115.089806:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824000 00000100:00100000:2.0:1787827115.089818:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143824768:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.089827:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827115.089839:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787827115.089848:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827115.089851:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143823744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827115.089853:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143825024:0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.089871:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143825280:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.089889:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787827115.089892:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827115.089899:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827115.089914:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143825536:0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.089925:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787827115.089935:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143825152:0@lo:400:kworker.0 00000100:00100000:1.0:1787827115.089942:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143823744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827115.089943:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827115.089947:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143823872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827115.089953:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787827115.089971:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787827115.089978:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824256 00000100:00100000:0.0:1787827115.089982:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824256 00000100:00100000:3.0:1787827115.089989:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827115.089995:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143824000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827115.089996:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827115.090013:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143825664:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.090018:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824512 00000100:00100000:2.0:1787827115.090024:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143824384:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.090032:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824512 00000100:00100000:3.0:1787827115.090044:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787827115.090051:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827115.090057:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825024 00000100:00100000:0.0:1787827115.090062:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825024 00000100:00100000:2.0:1787827115.090062:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827115.090082:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143824896:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.090099:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825536 00000100:00100000:0.0:1787827115.090104:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825536 00000100:00100000:2.0:1787827115.090112:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827115.090121:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143824000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827115.090124:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825152 00000100:00100000:0.0:1787827115.090127:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825152 00000100:00100000:1.0:1787827115.090129:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787827115.090132:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824128 00000100:00100000:2.0:1787827115.090137:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143825408:0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090139:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824128 00000100:00100000:0.0:1787827115.090143:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825664 00000100:00100000:0.0:1787827115.090148:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825664 00000100:00100000:1.0:1787827115.090153:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1787827115.090162:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143824256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.090169:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827115.090173:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1787827115.090182:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143824512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090188:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1787827115.090199:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143824128:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787827115.090209:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d354b40 x1874672143823744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827115.090238:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143824256:12345-0@lo:400:kworker.0 Request processed in 77us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827115.090247:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143824512:12345-0@lo:400:kworker.0 Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827115.090252:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1787827115.090258:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1787827115.090267:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143823744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827115.090269:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143824128:12345-0@lo:400:kworker.0 Request processed in 73us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827115.090277:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1787827115.090281:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1787827115.090286:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1787827115.090288:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143825024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827115.090295:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143825536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.090303:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143824256:0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090321:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824640 00000100:00100000:3.0:1787827115.090326:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824640 00000100:00100000:0.0:1787827115.090331:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143825024:12345-0@lo:400:kworker.0 Request processed in 45us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827115.090336:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143825536:12345-0@lo:400:kworker.0 Request processed in 44us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827115.090337:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824768 00000100:00100000:0.0:1787827115.090339:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1787827115.090343:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824768 00000100:00100000:1.0:1787827115.090346:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1787827115.090358:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1787827115.090358:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143823872 00000100:00100000:1.0:1787827115.090365:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:0.0:1787827115.090369:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143825152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090371:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143823872 00000100:00100000:1.0:1787827115.090376:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143825664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.090378:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825280 00000100:00100000:2.0:1787827115.090389:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825280 00000100:00100000:3.0:1787827115.090399:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824384 00000100:00100000:0.0:1787827115.090411:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143825152:12345-0@lo:400:kworker.0 Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827115.090415:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143824896 00000100:00100000:2.0:1787827115.090419:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824896 00000100:00100000:0.0:1787827115.090420:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1787827115.090424:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143825664:12345-0@lo:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827115.090429:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1787827115.090440:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825408 00000100:00100000:2.0:1787827115.090443:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825408 00000100:00100000:0.0:1787827115.090450:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787827115.090453:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143824384 00000100:00100000:0.0:1787827115.090461:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143824768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090486:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787827115.090494:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143824640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.090519:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143824768:12345-0@lo:400:kworker.0 Request processed in 60us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827115.090535:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143824640:12345-0@lo:400:kworker.0 Request processed in 42us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827115.090541:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787827115.090548:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787827115.090553:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787827115.090563:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143825280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090568:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143823872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787827115.090603:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827115.090604:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143825280:12345-0@lo:400:kworker.0 Request processed in 45us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827115.090646:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143823872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827115.090655:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00080000:1.0:1787827115.090670:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5342443c00 x1874672143824000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827115.090671:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787827115.090685:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143824384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827115.090693:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5342443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143824000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827115.090712:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143824512:0@lo:400:kworker.0 00000100:00100000:1.0:1787827115.090725:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143825024:0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090740:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143824384:12345-0@lo:400:kworker.0 Request processed in 55us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827115.090741:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143825536:0@lo:400:kworker.0 00000100:00100000:3.0:1787827115.090753:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787827115.091425:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787827115.091432:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787827115.091449:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787827115.091455:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787827115.091460:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143824896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.091474:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143825408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.091515:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143825408:12345-0@lo:400:kworker.0 Request processed in 53us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827115.091522:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787827115.091527:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143824896:12345-0@lo:400:kworker.0 Request processed in 69us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827115.091535:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1787827115.091568:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787827115.091573:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827115.091575:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827115.091597:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143824640:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.091608:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143823872:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787827115.091615:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16ed00 x1874672143825152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827115.091623:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143824384:0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.091629:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143825152:0@lo:400:kworker.0 00010000:00080000:0.0:1787827115.091638:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d357840 x1874672143824896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787827115.091645:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16c3c0 x1874672143825664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827115.091652:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143824896:0@lo:400:kworker.0 00000100:00100000:2.0:1787827115.091661:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143825664:0@lo:400:kworker.0 00010000:00080000:0.0:1787827115.091671:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16cb40 x1874672143825408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827115.091675:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143824128:0@lo:400:kworker.0 00000100:00100000:0.0:1787827115.091689:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143825408:0@lo:400:kworker.0 00010000:00080000:0.0:1787827115.091714:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356d00 x1874672143824768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827115.091724:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143824768:0@lo:400:kworker.0 00010000:00080000:0.0:1787827115.091738:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16c000 x1874672143825280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827115.091747:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143825280:0@lo:400:kworker.0 00010000:00010000:2.0:1787827115.217402:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827116.114695:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143825792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827116.114766:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827116.114875:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825792 00000100:00100000:3.0:1787827116.114883:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825792 00000100:00100000:3.0:1787827116.114958:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787827116.115045:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143825792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827116.115076:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827116.115160:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143825792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 194us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827116.115168:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787827116.115263:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143825792:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787827116.242487:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827116.433475:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827116.433515:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827116.433519:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134303360 00000100:00100000:0.0:1787827116.433529:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134303360 00000100:00100000:1.0:1787827116.433550:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827116.433560:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134303616 00000100:00100000:2.0:1787827116.433566:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134303616 00000100:00100000:0.0:1787827116.433589:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 593 00000100:00100000:1.0:1787827116.433589:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827116.433593:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134303872 00000100:00100000:3.0:1787827116.433599:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134303872 00000100:00100000:0.0:1787827116.433605:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134303360:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827116.433650:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 298 00000100:00100000:3.0:1787827116.433660:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303872:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827116.433673:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134303360:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827116.433682:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 593 00000100:00100000:3.0:1787827116.433696:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303872:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827116.433705:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 298 00000100:00080000:0.0:1787827116.433720:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827116.433726:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827116.434029:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134303488 00000100:00100000:2.0:1787827116.434034:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134303488 00000100:00100000:1.0:1787827116.434039:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827116.434064:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134303744 00000100:00100000:1.0:1787827116.434071:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134303744 00000100:00100000:2.0:1787827116.434077:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 576 00000100:00100000:2.0:1787827116.434097:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303616:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827116.434114:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 299 00000100:00100000:1.0:1787827116.434123:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303744:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827116.434142:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303616:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 49us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827116.434150:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 576 00000100:00100000:1.0:1787827116.434161:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134303744:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827116.434168:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 577 00000100:00100000:1.0:1787827116.434179:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 299 00000100:00100000:2.0:1787827116.434180:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134303488:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787827116.434241:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787827116.434246:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827116.434247:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134303488:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 69us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827116.434255:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 577 00000100:00100000:0.0:1787827116.625365:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827116.625385:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143825920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827116.625443:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827116.625523:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143825920 00000100:00100000:0.0:1787827116.625530:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143825920 00000100:00100000:0.0:1787827116.625575:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787827116.625584:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143825920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787827116.625620:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827116.625680:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143825920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827116.625687:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00080000:3.0:1787827116.625793:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16c000 x1874672143825920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827116.625812:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143825920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827116.625948:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143826048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827116.625977:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827116.626021:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826048 00000100:00100000:3.0:1787827116.626027:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826048 00000100:00100000:3.0:1787827116.626065:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787827116.626073:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143826048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827116.626084:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787827116.626137:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143826048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827116.626144:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00080000:0.0:1787827116.626206:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd61c0 x1874672143826048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827116.626239:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143826048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787827117.265623:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827118.289395:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827119.314628:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827119.473159:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827119.473230:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134304000 00000100:00100000:2.0:1787827119.473239:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134304000 00000100:00100000:2.0:1787827119.473316:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 168 00000100:00100000:2.0:1787827119.473327:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:22632:x1874672134304000:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787827119.473363:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827119.473452:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:22632:x1874672134304000:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 127us (309us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827119.473457:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827119.473463:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 168 00000100:00100000:1.0:1787827119.474415:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827119.474451:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134304128 00000100:00100000:1.0:1787827119.474456:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134304128 00000100:00100000:1.0:1787827119.474494:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 169 00000100:00100000:1.0:1787827119.474502:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22632:x1874672134304128:12345-192.168.203.6@tcp:41:lfs.0 00000100:00080000:2.0:1787827119.474526:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:1.0:1787827119.474527:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827119.474568:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22632:x1874672134304128:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827119.474573:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 169 00000100:00100000:3.0:1787827119.476018:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827119.476071:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134304256 00000100:00100000:1.0:1787827119.476079:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134304256 00000100:00100000:1.0:1787827119.476137:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 333 00000100:00100000:1.0:1787827119.476160:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22632:x1874672134304256:12345-192.168.203.6@tcp:13:lfs.0 00000100:00080000:0.0:1787827119.476163:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787827119.476185:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827119.476256:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22632:x1874672134304256:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827119.476267:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 333 00000100:00100000:0.0:1787827119.477287:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827119.477614:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134304384 00000100:00100000:3.0:1787827119.477629:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134304384 00000100:00080000:0.0:1787827119.477669:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827119.477687:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 334 00000100:00100000:3.0:1787827119.477699:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22632:x1874672134304384:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787827119.477723:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827119.477772:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22632:x1874672134304384:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 75us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827119.477789:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 334 00000100:00100000:0.0:1787827119.495892:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827119.495950:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134304640 00000100:00100000:2.0:1787827119.495959:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134304640 00000100:00100000:2.0:1787827119.496011:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 170 00000100:00100000:2.0:1787827119.496023:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:22636:x1874672134304640:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:2.0:1787827119.496042:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827119.496061:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7954521 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467617 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496142:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496153:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496161:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496188:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496193:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496198:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787827119.496610:0:6486:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x13:0x0], index 0: 0 00010000:00010000:2.0:1787827119.496772:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7954536 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496780:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7954536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496791:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7954536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496816:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496821:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496825:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496829:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827119.496832:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496837:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496845:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827119.496847:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827119.496852:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496858:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3600/0xc0fefc09a7954528 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787827119.496871:0:6486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a52c18e7 reply state 00000000a9cb1456 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496881:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496896:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x49967031 (ffff8d53428dd700) 00010000:00010000:2.0:1787827119.496898:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787827119.496901:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787827119.496927:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3200/0xc0fefc09a7954521 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467617 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496942:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7954536 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467617 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.496950:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8d53428ddd00) 00010000:00010000:2.0:1787827119.496953:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787827119.496956:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2c00, rc 0) 00000100:00100000:2.0:1787827119.497012:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+11:22636:x1874672134304640:12345-192.168.203.6@tcp:101:dd.0 Request processed in 992us (1129us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787827119.497019:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 170 00000100:00100000:1.0:1787827119.498968:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827119.499022:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134304768 00000100:00100000:2.0:1787827119.499031:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134304768 00000100:00100000:2.0:1787827119.499086:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 225 00000100:00100000:2.0:1787827119.499097:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22636:x1874672134304768:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:2.0:1787827119.499112:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827119.499130:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7954544 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346761e expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787827119.499520:0:19009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787827119.499540:0:19009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1787827119.499543:0:19009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787827119.499556:0:19009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7954544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.499571:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7954544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827119.499580:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2400, rc 0) 00000100:00100000:2.0:1787827119.499624:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:22636:x1874672134304768:12345-192.168.203.6@tcp:101:dd.0 Request processed in 529us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827119.499635:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 225 00000100:00100000:0.0:1787827119.775399:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827119.775482:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134304896 00000100:00100000:2.0:1787827119.775492:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134304896 00002000:00100000:2.0:1787827119.775538:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x13:0x0] (0->4194303) req@ffff8d546e16d680 x1874672134304896/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:720/0 lens 488/0 e 0 to 0 dl 1787827130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827119.775551:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16d680 with x1874672134304896 ext(0->4194303) 00002000:00010000:2.0:1787827119.775557:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16d680 00000100:00100000:2.0:1787827119.775588:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 553 00000100:00100000:2.0:1787827119.775598:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134304896:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:2.0:1787827119.797549:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134304896:12345-192.168.203.6@tcp:4:dd.0 Request processed in 21941us (22148us total) trans 34359738369 rc 0/0 00000100:00100000:2.0:1787827119.797565:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 553 00002000:00100000:2.0:1787827119.797579:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x13:0x0] (0->4194303) req@ffff8d546e16d680 x1874672134304896/t34359738369(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:720/0 lens 488/448 e 0 to 0 dl 1787827130 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827119.797590:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16d680 with x1874672134304896 ext(0->4194303) 00002000:00010000:2.0:1787827119.797596:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16d680 00000100:00100000:1.0:1787827119.848865:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827119.848991:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134305152 00000100:00100000:2.0:1787827119.849001:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134305152 00000100:00100000:2.0:1787827119.849057:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:2.0:1787827119.849067:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+11:22636:x1874672134305152:12345-192.168.203.6@tcp:35:dd.0 00000100:00100000:2.0:1787827119.849389:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:22636:x1874672134305152:12345-192.168.203.6@tcp:35:dd.0 Request processed in 323us (531us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1787827119.849398:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:0.0:1787827119.858383:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827119.858464:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134305280 00000100:00100000:2.0:1787827119.858474:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134305280 00002000:00100000:2.0:1787827119.858523:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x13:0x0] (4194304->5242879) req@ffff8d546e16c000 x1874672134305280/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:720/0 lens 488/0 e 0 to 0 dl 1787827130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827119.858533:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16c000 with x1874672134305280 ext(4194304->5242879) 00002000:00010000:2.0:1787827119.858538:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16c000 00000100:00100000:2.0:1787827119.858579:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 554 00000100:00100000:2.0:1787827119.858590:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134305280:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:2.0:1787827119.865371:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134305280:12345-192.168.203.6@tcp:4:dd.0 Request processed in 6669us (6882us total) trans 34359738370 rc 0/0 00000100:00100000:2.0:1787827119.865391:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 554 00002000:00100000:2.0:1787827119.865417:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x13:0x0] (4194304->5242879) req@ffff8d546e16c000 x1874672134305280/t34359738370(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:720/0 lens 488/448 e 0 to 0 dl 1787827130 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827119.865429:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d546e16c000 with x1874672134305280 ext(4194304->5242879) 00002000:00010000:2.0:1787827119.865449:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d546e16c000 00000100:00100000:3.0:1787827120.209427:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143826304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827120.209428:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143826432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827120.209467:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143826688:0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.209529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827120.209530:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827120.209554:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143826176:0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.209634:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827120.209668:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143826816:0@lo:400:kworker.0 00000100:00100000:3.0:1787827120.209669:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143826944:0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.209678:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143826560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827120.209714:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827120.209721:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827120.209743:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827120.209756:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143827456:0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.209761:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143827328:0@lo:400:kworker.0 00000100:00100000:0.0:1787827120.209774:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827120.209783:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143827200:0@lo:400:kworker.0 00000100:00100000:3.0:1787827120.209808:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826176 00000100:00100000:3.0:1787827120.209817:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826176 00000100:00100000:1.0:1787827120.209830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827120.209853:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143827072:0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.209856:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826304 00000100:00100000:2.0:1787827120.209863:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826304 00000100:00100000:1.0:1787827120.209876:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143827840:0@lo:400:kworker.0 00000100:00100000:3.0:1787827120.209878:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1787827120.209896:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143826176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827120.209917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827120.209927:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826560 00000100:00100000:1.0:1787827120.209933:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827120.209934:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826560 00000100:00100000:0.0:1787827120.209961:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143827584:0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.209984:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787827120.209998:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3617:x1874672143826176:12345-0@lo:400:kworker.0 Request processed in 107us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.209999:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143826304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827120.210014:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826432 00000100:00100000:3.0:1787827120.210017:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1787827120.210020:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826432 00002000:00000024:2.0:1787827120.210022:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827120.210027:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827120.210073:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143828096:0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.210073:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826816 00000100:00100000:3.0:1787827120.210082:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826944 00000100:00100000:1.0:1787827120.210084:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826816 00000100:00100000:3.0:1787827120.210089:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826944 00000100:00100000:2.0:1787827120.210090:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143826304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210099:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787827120.210125:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827072 00000100:00100000:2.0:1787827120.210125:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787827120.210133:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827072 00000100:00100000:0.0:1787827120.210140:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827120.210140:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143826688 00000100:00100000:3.0:1787827120.210148:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143826688 00000100:00100000:2.0:1787827120.210149:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143826560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787827120.210169:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827120.210173:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787827120.210193:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143826432:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827120.210193:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827584 00000100:00100000:3.0:1787827120.210200:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827584 00000100:00100000:2.0:1787827120.210242:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143826560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210252:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000004:00000024:1.0:1787827120.210257:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827120.210259:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787827120.210271:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828096 00000100:00100000:3.0:1787827120.210276:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828096 00000100:00100000:0.0:1787827120.210285:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143826816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210286:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827120.210310:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1787827120.210320:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143826432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210324:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143827712:0@lo:400:kworker.0 00000100:00100000:3.0:1787827120.210326:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.210348:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787827120.210377:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787827120.210395:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143826816:12345-0@lo:400:kworker.0 Request processed in 114us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827120.210396:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143827072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210396:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827120.210411:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143826944:12345-0@lo:400:kworker.0 Request processed in 79us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827120.210424:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1787827120.210440:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787827120.210461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143826176:0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.210483:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143827072:12345-0@lo:400:kworker.0 Request processed in 95us (565us total) trans 0 rc 0/0 00010000:00080000:2.0:1787827120.210490:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546e16c3c0 x1874672143826560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827120.210497:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787827120.210497:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1787827120.210514:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143826560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827120.210526:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143826688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210561:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827328 00000100:00100000:2.0:1787827120.210565:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827328 00000100:00100000:3.0:1787827120.210569:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143826688:12345-0@lo:400:kworker.0 Request processed in 48us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210585:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827840 00000100:00100000:2.0:1787827120.210587:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827840 00000100:00100000:2.0:1787827120.210595:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827200 00000100:00100000:2.0:1787827120.210597:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827200 00000100:00100000:2.0:1787827120.210605:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827712 00000100:00100000:2.0:1787827120.210607:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827712 00000100:00100000:2.0:1787827120.210615:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787827120.210618:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143827328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210644:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143827328:12345-0@lo:400:kworker.0 Request processed in 24us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210649:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787827120.210660:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787827120.210666:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143827840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210691:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143827840:12345-0@lo:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210697:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787827120.210707:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787827120.210713:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143827200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827120.210724:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1787827120.210737:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143827584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210747:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143827200:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210755:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787827120.210779:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787827120.210784:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143827584:12345-0@lo:400:kworker.0 Request processed in 50us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210795:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143827712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210827:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143827712:12345-0@lo:400:kworker.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.210843:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787827120.210880:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143827200:0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.210890:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143827712:0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.211073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1787827120.211082:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1787827120.211087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143828096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827120.211096:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00080000:0.0:1787827120.211143:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787827120.211154:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827120.211157:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143828096:12345-0@lo:400:kworker.0 Request processed in 64us (1016us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827120.211159:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827120.211171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1787827120.211191:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827120.211196:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143827072:0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.211250:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143826816:0@lo:400:kworker.0 00010000:00080000:2.0:1787827120.211253:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd5e00 x1874672143827584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827120.211265:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143827968:0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.211267:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143827584:0@lo:400:kworker.0 00010000:00080000:1.0:1787827120.211273:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd5a40 x1874672143827328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827120.211287:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143827328:0@lo:400:kworker.0 00010000:00080000:2.0:1787827120.211291:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d356d00 x1874672143828096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827120.211303:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143828096:0@lo:400:kworker.0 00010000:00080000:1.0:1787827120.211307:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd61c0 x1874672143827840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827120.211318:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827120.211323:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143826688:0@lo:400:kworker.0 00000100:00100000:1.0:1787827120.211325:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143827840:0@lo:400:kworker.0 00010000:00080000:3.0:1787827120.211368:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbfc3c0 x1874672143826304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827120.211377:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827456 00000100:00100000:2.0:1787827120.211382:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827456 00000100:00100000:3.0:1787827120.211384:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143826304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827120.211412:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143826944:0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.211414:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143827968 00000100:00100000:2.0:1787827120.211419:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143827968 00000100:00100000:1.0:1787827120.211423:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143826432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827120.211460:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1787827120.211468:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143827456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827120.211472:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1787827120.211484:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143827968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827120.211516:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143827456:12345-0@lo:400:kworker.0 Request processed in 48us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827120.211523:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1787827120.211560:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143827456:0@lo:400:kworker.0 00000100:00080000:0.0:1787827120.211593:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827120.211664:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143827968:12345-0@lo:400:kworker.0 Request processed in 182us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827120.211672:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1787827120.211774:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143827968:0@lo:400:kworker.0 00010000:00010000:0.0:1787827120.337406:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827121.233473:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143828224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827121.233539:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827121.233614:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828224 00000100:00100000:0.0:1787827121.233623:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828224 00000100:00100000:0.0:1787827121.233676:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787827121.233686:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143828224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827121.233716:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827121.233768:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143828224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827121.233775:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787827121.233827:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143828224:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787827121.361485:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827121.553688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827121.553725:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827121.553752:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134305536 00000100:00100000:0.0:1787827121.553759:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827121.553762:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134305536 00000100:00100000:2.0:1787827121.553782:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134305792 00000100:00100000:2.0:1787827121.553789:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134305792 00000100:00100000:2.0:1787827121.553831:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 304 00000100:00100000:3.0:1787827121.553837:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 584 00000100:00100000:2.0:1787827121.553843:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134305792:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827121.553855:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134305536:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827121.553857:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827121.553905:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827121.553911:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:2393:x1874672134305792:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827121.553911:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:2393:x1874672134305536:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827121.553932:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 304 00000100:00100000:3.0:1787827121.553932:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 584 00000100:00100000:2.0:1787827121.553950:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134305920 00000100:00100000:2.0:1787827121.553955:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134305920 00000100:00100000:3.0:1787827121.553965:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134305664 00000100:00100000:2.0:1787827121.553985:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 305 00000100:00100000:2.0:1787827121.553993:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134305920:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:0.0:1787827121.554018:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827121.554028:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827121.554030:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134305920:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827121.554032:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134305664 00000100:00080000:0.0:1787827121.554033:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827121.554042:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 305 00000100:00100000:2.0:1787827121.554084:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 585 00000100:00080000:0.0:1787827121.554088:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827121.554094:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134305664:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827121.554132:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134305664:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 41us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827121.554139:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 585 00000100:00100000:1.0:1787827121.554159:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134305408 00000100:00100000:1.0:1787827121.554164:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134305408 00000100:00100000:1.0:1787827121.554205:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 595 00000100:00100000:1.0:1787827121.554246:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134305408:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827121.554285:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134305408:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827121.554293:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 595 00000100:00100000:1.0:1787827121.745642:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143828352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827121.745707:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827121.745856:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143828480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827121.748190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827121.749891:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828352 00000100:00100000:1.0:1787827121.749896:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828480 00000100:00100000:1.0:1787827121.749907:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828480 00000100:00100000:1.0:1787827121.749980:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787827121.749987:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828352 00000100:00100000:1.0:1787827121.750000:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143828480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787827121.750034:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25544128 pending 5292032 free 3918270464 avail 3686748160 00000100:00100000:0.0:1787827121.750061:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787827121.750072:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143828352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787827121.750087:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25544128 pending 5292032 free 3918270464 avail 3686748160 00000100:00100000:1.0:1787827121.750114:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143828480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827121.750123:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787827121.750158:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143828480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827121.750208:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143828352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (4500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827121.750234:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787827121.750265:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143828352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827121.949135:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827121.949203:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134306048 00000100:00100000:1.0:1787827121.949605:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134306048 00000100:00100000:1.0:1787827121.949674:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 171 00000100:00100000:1.0:1787827121.949688:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:22653:x1874672134306048:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787827121.949725:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827121.949801:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+12:22653:x1874672134306048:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 118us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827121.949810:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 171 00000100:00100000:0.0:1787827121.951698:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827121.951754:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134306176 00000100:00100000:1.0:1787827121.951759:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134306176 00000100:00100000:1.0:1787827121.951798:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 172 00000100:00100000:1.0:1787827121.951804:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22653:x1874672134306176:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:1.0:1787827121.951822:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827121.951868:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22653:x1874672134306176:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 64us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827121.951873:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 172 00000100:00100000:2.0:1787827121.953782:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827121.953852:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134306304 00000100:00100000:1.0:1787827121.953860:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134306304 00000100:00100000:1.0:1787827121.953914:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 339 00000100:00100000:1.0:1787827121.953924:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+10:22653:x1874672134306304:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787827121.953955:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25544128 pending 5292032 free 3918270464 avail 3686748160 00000100:00100000:1.0:1787827121.953998:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+10:22653:x1874672134306304:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827121.954005:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 339 00000100:00100000:2.0:1787827121.956777:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827121.956836:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134306432 00000100:00100000:0.0:1787827121.956844:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134306432 00000100:00100000:0.0:1787827121.956908:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 340 00000100:00100000:0.0:1787827121.956927:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22653:x1874672134306432:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:0.0:1787827121.956957:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827121.957021:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:22653:x1874672134306432:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 104us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827121.957028:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 340 00010000:00010000:1.0:1787827122.385538:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787827122.595064:0:25557:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: before: 7663128 after_dd: 7658008 took 2 seconds 00000001:00080000:3.0:1787827122.956688:0:23933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738370 is committed 00000001:00080000:1.0:1787827122.957005:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00010000:00010000:0.0:1787827122.957035:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.957048:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.957056:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.957073:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d3e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827122.957078:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.957085:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.957103:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x49967031 (ffff8d53428dd700) 00010000:00010000:0.0:1787827122.957106:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827122.957111:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.957118:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3e00/0xc0fefc09a795452f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827122.999332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827122.999380:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134306688 00000100:00100000:0.0:1787827122.999389:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134306688 00000100:00100000:0.0:1787827122.999452:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:0.0:1787827122.999464:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+9:22810:x1874672134306688:12345-192.168.203.6@tcp:36:mcreate.0 00010000:00010000:0.0:1787827122.999516:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827122.999543:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d534350e000/0xc0fefc09a7953759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c34673cb expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.999561:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54531bc700) 00010000:00010000:0.0:1787827122.999572:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827122.999626:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.999640:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.999658:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.999715:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.999723:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827122.999731:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000146:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000154:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000162:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000168:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a0c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:0.0:1787827123.000173:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000181:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000190:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d5450fb5e00) 00010000:00010000:0.0:1787827123.000193:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787827123.000197:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000210:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a0c00/0xc0fefc09a795454b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787827123.000285:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e302083 reply state 00000000423cf50e transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000297:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.000304:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb66fff45 (ffff8d5450fb5c00) 00010000:00010000:0.0:1787827123.000307:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787827123.000310:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787827123.000402:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+10:22810:x1874672134306688:12345-192.168.203.6@tcp:36:mcreate.0 Request processed in 940us (1074us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1787827123.000422:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:0.0:1787827123.008765:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827123.008826:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134306816 00000100:00100000:1.0:1787827123.008834:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134306816 00000100:00080000:0.0:1787827123.008880:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827123.008895:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 174 00000100:00100000:1.0:1787827123.008902:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+10:22813:x1874672134306816:12345-192.168.203.6@tcp:101:rm.0 00010000:00010000:1.0:1787827123.008923:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827123.008946:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467625 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.009008:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a7954560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.009019:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a7954560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.009030:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a7954560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787827123.009079:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787827123.009083:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787827123.009103:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a7954560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.009136:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a7954559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467625 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.009152:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a7954560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467625 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.009159:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d5458a66900) 00010000:00010000:1.0:1787827123.009161:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787827123.009164:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345113800, rc 0) 00000100:00100000:1.0:1787827123.009228:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+11:22813:x1874672134306816:12345-192.168.203.6@tcp:101:rm.0 Request processed in 311us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827123.009234:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 174 00000100:00100000:3.0:1787827123.010876:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827123.010919:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134306944 00000100:00100000:1.0:1787827123.010926:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134306944 00000100:00100000:1.0:1787827123.010978:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 175 00000100:00100000:1.0:1787827123.010989:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+11:22813:x1874672134306944:12345-192.168.203.6@tcp:101:rm.0 00010000:00010000:1.0:1787827123.011006:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827123.011025:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346762c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011072:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011084:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011102:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011113:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011120:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011126:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011204:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113e00/0xc0fefc09a795457c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011234:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113e00/0xc0fefc09a795457c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011244:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113e00/0xc0fefc09a795457c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787827123.011303:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x13:0x0]: returning size 0 00000004:00200000:1.0:1787827123.011307:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787827123.011322:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113e00/0xc0fefc09a795457c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011334:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113e00/0xc0fefc09a795457c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011342:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011350:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011356:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011363:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827123.011367:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011375:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011385:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d5458a66900) 00010000:00010000:1.0:1787827123.011388:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827123.011392:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011403:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a795456e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011438:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011445:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011451:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011457:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112600 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827123.011461:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011467:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011476:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb66fff45 (ffff8d5450fb5c00) 00010000:00010000:1.0:1787827123.011478:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827123.011482:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011488:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112600/0xc0fefc09a7954575 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011523:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112200/0xc0fefc09a7954567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346762c expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011538:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113e00/0xc0fefc09a795457c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346762c expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.011557:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff8d5458a66500) 00010000:00010000:1.0:1787827123.011560:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787827123.011563:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345113e00, rc 0) 00000100:00100000:1.0:1787827123.011605:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+12:22813:x1874672134306944:12345-192.168.203.6@tcp:101:rm.0 Request processed in 618us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827123.011614:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 175 00000100:00100000:0.0:1787827123.013334:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827123.013394:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134307200 00000100:00100000:3.0:1787827123.013402:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134307200 00000100:00100000:3.0:1787827123.013464:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 176 00000100:00100000:3.0:1787827123.013474:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:22813:x1874672134307200:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:3.0:1787827123.013526:0:22268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787827123.013547:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113e00/0xc0fefc09a795457c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346762c expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013567:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff8d5458a66500) 00010000:00010000:3.0:1787827123.013583:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113800/0xc0fefc09a7954560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467625 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013592:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d5458a66900) 00010000:00010000:3.0:1787827123.013601:0:22268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827123.013622:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013632:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013642:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013664:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013673:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013681:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013809:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013819:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.013826:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014087:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014098:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014106:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014113:0:22268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014120:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014134:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014154:0:22268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787827123.014172:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014179:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014187:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014193:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827123.014199:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014205:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014236:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff8d54745a9500) 00010000:00010000:3.0:1787827123.014239:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787827123.014242:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014250:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a7954591 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014263:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014274:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014279:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014282:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827123.014285:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.014287:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827123.014292:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.014297:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014301:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54745a9100) 00010000:00010000:3.0:1787827123.014303:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787827123.014306:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014321:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a7954583 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.014325:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078400 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787827123.014331:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787827123.014336:0:22268:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfc80e8 reply state 000000009243af7f transno 4294967405 ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.014342:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014345:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.014358:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb66fff45 (ffff8d5450fb5c00) 00010000:00010000:3.0:1787827123.014360:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787827123.014362:0:22268:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787827123.014363:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff8d54745a9500) 00010000:00010000:2.0:1787827123.014367:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787827123.014372:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.014379:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078400/0xc0fefc09a7954598 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.014396:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827123.014399:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827123.014401:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827123.014410:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+12:22813:x1874672134307200:12345-192.168.203.6@tcp:36:rm.0 Request processed in 937us (1082us total) trans 4294967405 rc 0/0 00000100:00100000:3.0:1787827123.014437:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 176 00010000:00010000:0.0:1787827123.410381:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827124.435193:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827125.329394:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143828736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827125.329394:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143828992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827125.329446:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143829248:0@lo:400:kworker.0 00000100:00100000:2.0:1787827125.329515:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143829120:0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.329525:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827125.329532:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827125.329559:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828992 00000100:00100000:0.0:1787827125.329567:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828992 00000100:00100000:2.0:1787827125.329571:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827125.329596:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143828864:0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.329597:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143829504:0@lo:400:kworker.0 00000100:00100000:2.0:1787827125.329608:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143829632:0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.329626:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787827125.329637:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143828992:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827125.329644:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827125.329652:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827125.329654:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787827125.329671:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827125.329673:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143830016:0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.329692:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143828608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827125.329701:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143830144:0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.329716:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827125.329724:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143828992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827125.329732:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787827125.329741:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827125.329742:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827125.329742:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143830528:0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.329770:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828608 00000100:00100000:1.0:1787827125.329773:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546e16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143829376:0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.329775:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828608 00000100:00100000:2.0:1787827125.329778:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787827125.329784:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827125.329788:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143829760:0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.329808:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827125.329821:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1787827125.329830:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143828608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827125.329836:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143829888:0@lo:400:kworker.0 00000100:00100000:2.0:1787827125.329837:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787827125.329848:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787827125.329848:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d368f00 x1874672143828992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827125.329867:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827125.329873:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143828992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827125.329875:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143830272:0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.329897:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143830400:0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.329899:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143828608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827125.329909:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787827125.329918:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828736 00000100:00100000:2.0:1787827125.329923:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827125.329924:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828736 00000100:00100000:1.0:1787827125.329931:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787827125.329932:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787827125.329965:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbff480 x1874672143828608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827125.329965:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143829504 00000100:00100000:0.0:1787827125.329970:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143829120 00000100:00100000:3.0:1787827125.329971:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143829504 00000100:00100000:0.0:1787827125.329976:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143829120 00000100:00100000:2.0:1787827125.329980:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143829632 00000100:00100000:1.0:1787827125.329985:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143828608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827125.329987:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143829632 00000100:00100000:3.0:1787827125.330021:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787827125.330022:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830016 00000100:00100000:1.0:1787827125.330025:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830528 00000100:00100000:0.0:1787827125.330027:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830016 00000100:00100000:3.0:1787827125.330033:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143828736:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827125.330037:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830528 00000100:00100000:2.0:1787827125.330048:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830144 00000100:00100000:0.0:1787827125.330051:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143829376 00000100:00100000:2.0:1787827125.330053:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830144 00000100:00100000:0.0:1787827125.330056:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143829376 00000100:00100000:1.0:1787827125.330068:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143829888 00000004:00000024:3.0:1787827125.330076:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787827125.330081:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143829888 00000100:00100000:0.0:1787827125.330084:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830400 00000100:00100000:2.0:1787827125.330088:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143829760 00000100:00100000:0.0:1787827125.330089:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830400 00000100:00100000:2.0:1787827125.330093:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143829760 00000100:00100000:1.0:1787827125.330107:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1787827125.330117:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143829120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330125:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1787827125.330132:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830272 00000100:00100000:0.0:1787827125.330138:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143830016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.330141:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143828736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827125.330151:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787827125.330154:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830272 00000100:00100000:3.0:1787827125.330171:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787827125.330190:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143829504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.330192:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143829120:12345-0@lo:400:kworker.0 Request processed in 74us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827125.330192:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787827125.330204:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1787827125.330208:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143829632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330211:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143830016:12345-0@lo:400:kworker.0 Request processed in 63us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827125.330251:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00010000:00000080:2.0:1787827125.330251:0:19009:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8d5344bd43c0 x1874672143829632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 224/224 e 0 to 0 dl 1787827136 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827125.330257:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143829504:12345-0@lo:400:kworker.0 Request processed in 70us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827125.330261:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1787827125.330265:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143830528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.330275:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787827125.330287:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1787827125.330298:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143829376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.330301:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143828864 00000100:00100000:3.0:1787827125.330306:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143828864 00000100:00100000:2.0:1787827125.330317:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143829632:12345-0@lo:400:kworker.0 Request processed in 113us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827125.330319:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143830528:12345-0@lo:400:kworker.0 Request processed in 57us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827125.330335:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1787827125.330335:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787827125.330340:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1787827125.330347:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143829376:12345-0@lo:400:kworker.0 Request processed in 51us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827125.330353:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143828864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330363:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1787827125.330363:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787827125.330372:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1787827125.330377:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143830144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.330384:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143829888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330389:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1787827125.330392:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143828864:12345-0@lo:400:kworker.0 Request processed in 43us (745us total) trans 0 rc 0/0 00010000:00000080:2.0:1787827125.330394:0:19009:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8d5344bd6d00 x1874672143830144/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:726/0 lens 224/224 e 0 to 0 dl 1787827136 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827125.330420:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1787827125.330426:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143830400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.330431:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143829888:12345-0@lo:400:kworker.0 Request processed in 50us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827125.330439:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1787827125.330456:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143830144:12345-0@lo:400:kworker.0 Request processed in 82us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827125.330466:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787827125.330475:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787827125.330480:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143830400:12345-0@lo:400:kworker.0 Request processed in 58us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827125.330487:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143829120:0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.330489:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143829760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330494:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1787827125.330494:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787827125.330506:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143829632:0@lo:400:kworker.0 00000100:00100000:2.0:1787827125.330512:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143830272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.330524:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143830144:0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330534:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827125.330539:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143829760:12345-0@lo:400:kworker.0 Request processed in 52us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827125.330548:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00080000:1.0:1787827125.330554:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd61c0 x1874672143829760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827125.330565:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143829760:0@lo:400:kworker.0 00000100:00100000:2.0:1787827125.330569:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143830272:12345-0@lo:400:kworker.0 Request processed in 60us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827125.330587:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787827125.330589:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143829248 00010000:00080000:1.0:1787827125.330591:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd4f00 x1874672143830272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827125.330594:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143829248 00000100:00100000:1.0:1787827125.330605:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143830272:0@lo:400:kworker.0 00000100:00080000:0.0:1787827125.330614:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787827125.330619:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827125.330623:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827125.330632:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787827125.330639:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143829248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827125.330671:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143829504:0@lo:400:kworker.0 00000100:00100000:3.0:1787827125.330683:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143829248:12345-0@lo:400:kworker.0 Request processed in 43us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827125.330684:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546e16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143829376:0@lo:400:kworker.0 00010000:00080000:2.0:1787827125.330690:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd4b40 x1874672143830016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827125.330699:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787827125.330709:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143830016:0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330710:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143829888:0@lo:400:kworker.0 00000100:00100000:1.0:1787827125.330724:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143829248:0@lo:400:kworker.0 00010000:00080000:2.0:1787827125.330735:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd7c00 x1874672143830528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827125.330736:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143830400:0@lo:400:kworker.0 00000100:00100000:2.0:1787827125.330751:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143830528:0@lo:400:kworker.0 00000100:00100000:0.0:1787827125.330754:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143828736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827125.330764:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143828864:0@lo:400:kworker.0 00000001:02000400:2.0:1787827125.401814:0:25951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:2.0:1787827125.422296:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827125.422361:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134307328 00000100:00100000:3.0:1787827125.422369:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134307328 00000100:00100000:3.0:1787827125.422455:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00100000:3.0:1787827125.422466:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+12:22880:x1874672134307328:12345-192.168.203.6@tcp:101:rm.0 00010000:00010000:3.0:1787827125.422496:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827125.422573:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a795459f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467633 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827125.422635:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a79545a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827125.422650:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a79545a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827125.422664:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a79545a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787827125.422709:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787827125.422720:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787827125.422743:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a79545a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827125.422764:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079e00/0xc0fefc09a795459f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467633 expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827125.422776:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e078000/0xc0fefc09a79545a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467633 expref: 13 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827125.422783:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d54745a9800) 00010000:00010000:3.0:1787827125.422785:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787827125.422788:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e078000, rc 0) 00000100:00100000:3.0:1787827125.422852:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+13:22880:x1874672134307328:12345-192.168.203.6@tcp:101:rm.0 Request processed in 388us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827125.422858:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00080000:1.0:1787827125.423030:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827125.424359:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827125.424413:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134307584 00000100:00100000:1.0:1787827125.424419:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134307584 00000100:00100000:1.0:1787827125.424458:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 178 00000100:00100000:1.0:1787827125.424467:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+13:22880:x1874672134307584:12345-192.168.203.6@tcp:36:rm.0 00010000:00010000:1.0:1787827125.424503:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827125.424550:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a7954536 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467617 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424565:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8d53428ddd00) 00010000:00010000:1.0:1787827125.424574:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827125.424590:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424602:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424610:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424636:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424644:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424657:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424724:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424733:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424740:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787827125.424923:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00000004:00080000:1.0:1787827125.424944:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 500287717332ns, next at 501287715687ns, rc = 0 00010000:00010000:1.0:1787827125.424989:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.424999:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425007:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425014:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425020:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425026:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425056:0:6487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787827125.425071:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425078:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425085:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827125.425087:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827125.425095:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827125.425099:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425100:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425122:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827125.425124:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113200 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:2.0:1787827125.425133:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425137:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8d5458a66b00) 00010000:00010000:1.0:1787827125.425149:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787827125.425153:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827125.425155:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425163:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112000/0xc0fefc09a79545bb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827125.425176:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8d5458a66b00) 00010000:00010000:1.0:1787827125.425180:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827125.425180:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787827125.425186:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425194:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827125.425210:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113200/0xc0fefc09a79545c2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425235:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425248:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345113000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827125.425254:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425262:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827125.425264:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827125.425268:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827125.425273:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827125.425276:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827125.425280:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827125.425284:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425290:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345113000/0xc0fefc09a79545ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787827125.425301:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e17b6a7 reply state 00000000a90386e0 transno 4294967406 ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425311:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827125.425317:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x49967031 (ffff8d5458a66600) 00010000:00010000:1.0:1787827125.425320:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787827125.425322:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787827125.425380:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+14:22880:x1874672134307584:12345-192.168.203.6@tcp:36:rm.0 Request processed in 914us (1021us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787827125.425387:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 178 00010000:00010000:3.0:1787827125.457636:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787827126.060311:0:26048:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787827126.060353:0:26048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060365:0:26048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060370:0:26048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060374:0:26048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060388:0:26048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787827126.060404:0:26048:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787827126.060424:0:26048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787827126.060426:0:26048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787827126.060430:0:26048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787827126.060451:0:26048:0:(import.c:65:import_set_state_nolock()) ffff8d534390d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787827126.060475:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143830656:0@lo:39:umount.0 00000100:00100000:1.0:1787827126.060539:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827126.060592:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827126.060597:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060605:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079200 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:1.0:1787827126.060609:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060618:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827126.060632:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830656 10000000:00010000:1.0:1787827126.060632:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827126.060640:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830656 10000000:01000000:1.0:1787827126.060641:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787827126.060646:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787827126.060649:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787827126.060672:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060678:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787827126.060691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00010000:00010000:1.0:1787827126.060696:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827126.060704:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143830656:12345-0@lo:39:umount.0 00010000:00010000:1.0:1787827126.060707:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d546e079200/0xc0fefc09a79544a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a79544aa expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.060723:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827126.060725:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827126.060727:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787827126.060732:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79544c6 00000100:00100000:1.0:1787827126.060740:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143830784:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787827126.060743:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d53434c8000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787827126.060774:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827126.060779:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827126.060800:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830784 00000100:00100000:3.0:1787827126.060804:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830784 00000100:00100000:0.0:1787827126.060820:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3615:x1874672143830656:12345-0@lo:39:umount.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827126.060831:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000020:00000080:0.0:1787827126.060841:0:6514:0:(genops.c:885:class_export_put()) final put ffff8d53434cf800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:1.0:1787827126.060842:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534390d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787827126.060851:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787827126.060854:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143830656:0@lo:39:umount.0 00000100:00100000:3.0:1787827126.060861:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143830784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787827126.060872:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1787827126.060876:0:26048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787827126.060878:0:26048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787827126.060882:0:26048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787827126.060883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53434cf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1787827126.060887:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a1800/0xc0fefc09a79544aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a79544a3 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787827126.060942:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d53434c8000 for lustre-MDT0000 00010000:00010000:3.0:1787827126.060950:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787827126.061000:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3618:x1874672143830784:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827126.061007:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787827126.061011:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143830784:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787827126.061668:0:26048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787827126.061670:0:26048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787827126.061678:0:26048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787827126.061685:0:26048:0:(import.c:65:import_set_state_nolock()) ffff8d546e141000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787827126.061753:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143830912:0@lo:39:umount.0 00000100:00100000:2.0:1787827126.061777:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827126.061806:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143830912 00000100:00100000:1.0:1787827126.061810:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143830912 00000100:00100000:1.0:1787827126.061837:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787827126.061844:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143830912:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787827126.061859:0:6486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79544d4 00000100:00080000:1.0:1787827126.061865:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8d5445589000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787827126.061891:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827126.061909:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3615:x1874672143830912:12345-0@lo:39:umount.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827126.061916:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000020:00000080:1.0:1787827126.061923:0:6486:0:(genops.c:885:class_export_put()) final put ffff8d544558d000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00080000:3.0:1787827126.061934:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5344bd5a40 x1874672143830912/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787827126.061945:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d546e141000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787827126.061955:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143830912:0@lo:39:umount.0 00000020:00000080:0.0:1787827126.061964:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d544558d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:1.0:1787827126.061965:0:26048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787827126.061968:0:26048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787827126.061971:0:26048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787827126.062011:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5445589000 for lustre-MDT0001 00010000:00010000:1.0:1787827126.062798:0:26048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.062806:0:26048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.062810:0:26048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.062814:0:26048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.062826:0:26048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787827126.062832:0:26048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.062846:0:26048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827126.062846:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827126.062852:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.062853:0:26048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827126.062859:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079600 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:1.0:1787827126.062860:0:26048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827126.062863:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827126.062870:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827126.062874:0:26048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787827126.062877:0:26048:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:00010000:3.0:1787827126.062886:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827126.062892:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787827126.062894:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787827126.062896:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:1.0:1787827126.062902:0:26048:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1787827126.062904:0:6474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000000:1.0:1787827126.062907:0:26048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:0.0:1787827126.062911:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787827126.062912:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787827126.062915:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:1.0:1787827126.062919:0:26048:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:0.0:1787827126.062929:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078200 already unused, calling callback (ffffffffc13fec20) 00010000:00010000:3.0:1787827126.062929:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787827126.062936:0:6474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827126.062946:0:6474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827126.062951:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787827126.062955:0:6474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827126.062965:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d546e079600/0xc0fefc09a7954464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a795446b expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827126.062968:0:6474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787827126.062971:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143831040:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1787827126.062975:0:6474:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787827126.062980:0:6474:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787827126.062991:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827126.062995:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827126.063003:0:6474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827126.063007:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827126.063008:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827126.063017:0:6474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787827126.063038:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827126.063039:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831040 00000100:00100000:3.0:1787827126.063046:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831040 00010000:00010000:0.0:1787827126.063049:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d546e078200/0xc0fefc09a7954495 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc0fefc09a795449c expref: -99 pid: 23932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827126.063050:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827126.063060:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143831168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787827126.063065:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827126.063069:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827126.063072:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827126.063089:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827126.063089:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787827126.063102:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143831040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787827126.063112:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787827126.063120:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831168 00000100:00100000:0.0:1787827126.063126:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831168 00010000:00010000:3.0:1787827126.063127:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7d2200/0xc0fefc09a795446b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7954464 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827126.063147:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787827126.063170:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787827126.063181:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443202450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3617:x1874672143831168:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787827126.063183:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143831040:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827126.063190:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787827126.063201:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1787827126.063204:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345113c00/0xc0fefc09a795449c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0fefc09a7954495 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827126.063208:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143831040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787827126.063247:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787827126.063288:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443202450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143831168:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827126.063296:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143831168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787827126.063297:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00002000:00000080:1.0:1787827126.064435:0:26048:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1787827126.064452:0:26048:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:1.0:1787827126.064563:0:26048:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1787827126.064569:0:26048:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d534351b000 2313f4ee-480a-47b2-8d93-5bb216a57733 192.168.203.6@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 34359738370 stale:0 00000020:00080000:1.0:1787827126.064574:0:26048:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d534351f000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 30064771560 stale:0 00000020:00080000:1.0:1787827126.064577:0:26048:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8d5343518800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:1.0:1787827126.064580:0:26048:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8d5450e8b370) has exports, disconnecting them 00000020:00080000:1.0:1787827126.064583:0:26048:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.6@tcp (ffff8d534351b000), last request at 1787827121 00000020:00000080:1.0:1787827126.064590:0:26048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795448e 00000020:00010000:1.0:1787827126.064594:0:26048:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d534351b000: total 0 00000100:00080000:1.0:1787827126.064597:0:26048:0:(import.c:65:import_set_state_nolock()) ffff8d546e146000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787827126.064624:0:10301:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d534351b000: total 0 00000020:00080000:1.0:1787827126.064641:0:26048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.6@tcp (ffff8d534351b000): rc 0 00000020:00080000:1.0:1787827126.064650:0:26048:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d534351f000), last request at 1787827125 00000020:00000080:1.0:1787827126.064654:0:26048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954487 00010000:00010000:3.0:1787827126.064655:0:10301:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d534351b000, canceled 0 locks, left on hash table 1. 00000100:00080000:1.0:1787827126.064657:0:26048:0:(import.c:65:import_set_state_nolock()) ffff8d5478923000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787827126.064670:0:26048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d534351f000): rc 0 00000020:00000080:1.0:1787827126.064672:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d534351f000/lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787827126.064677:0:10301:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb size from disk: 0 -> 5242880 00000020:00080000:1.0:1787827126.064680:0:26048:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8d5343518800), last request at 1787827125 00002000:00010000:3.0:1787827126.064680:0:10301:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb mtime from disk: 0 -> 1787827119 00000020:00000080:1.0:1787827126.064684:0:26048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954480 00000100:00080000:1.0:1787827126.064688:0:26048:0:(import.c:65:import_set_state_nolock()) ffff8d5476634800 : changing import state from FULL to CLOSED 00002000:00010000:3.0:1787827126.064689:0:10301:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb ctime from disk: 0 -> 1787827119 00010000:00010000:2.0:1787827126.064690:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787827126.064693:0:10301:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb blocks from disk: 0 -> 10240 00000020:00080000:1.0:1787827126.064699:0:26048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d5343518800): rc 0 00000020:00000080:1.0:1787827126.064701:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d5343518800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787827126.064706:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534351f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00010000:00010000:3.0:1787827126.064710:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e5e36db/0xc0fefc09a7954544 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 2 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827126.064718:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827126.064737:0:10301:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d534351b000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787827126.064743:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343518800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00080000:1.0:1787827126.064755:0:26048:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d5450e8b370) has no exports 00000020:00000080:0.0:1787827126.064768:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5478923000 for lustre-OST0000 00000020:00000080:0.0:1787827126.064776:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5476634800 for lustre-OST0000 00000020:00000080:3.0:1787827126.066191:0:10301:0:(genops.c:885:class_export_put()) final put ffff8d534351b000/2313f4ee-480a-47b2-8d93-5bb216a57733 00010000:00010000:3.0:1787827126.066205:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827126.066208:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827126.066210:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787827126.066268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d534351b000/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0000 00000020:00000080:0.0:1787827126.066302:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d546e146000 for lustre-OST0000 00000020:01000000:1.0:1787827126.066931:0:26048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d54438be360 - data ffff8d547fcc6ca8/ffff8d547fb07c00 00000020:01000000:1.0:1787827126.067029:0:26048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d5344b1a360 - data ffff8d5469bc81b0/ffff8d547fa51000 00100000:10000000:1.0:1787827126.078611:0:26048:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787827126.082775:0:26048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954479 00000020:00000080:0.0:1787827126.082784:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d5476375000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787827126.082798:0:26048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5343bea800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787827126.082801:0:26048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343bea800 2 00000020:01000004:0.0:1787827126.082803:0:26048:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d5343bea800 from lustre-OST0000 00000020:00000080:0.0:1787827126.082821:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787827126.082826:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5476375000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787827126.082829:0:26048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787827126.082833:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d53434cc000/lustre-OST0000_UUID 00000020:00000080:0.0:1787827126.082835:0:26048:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53434cc000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787827126.082841:0:26048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787827126.082881:0:26048:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1787827126.082890:0:26048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787827126.082894:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787827126.082900:0:26048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787827126.082905:0:26048:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d53444b1800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787827126.082909:0:26048:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d5342780000) has exports, disconnecting them 00000020:00080000:0.0:1787827126.082913:0:26048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d53444b1800), last request at 1787827094 00000020:00000080:0.0:1787827126.082915:0:26048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79544b8 00000020:00080000:0.0:1787827126.082921:0:26048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d53444b1800): rc 0 00000020:00000080:0.0:1787827126.082925:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d53444b1800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787827126.082954:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444b1800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787827126.084269:0:26048:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787827126.084281:0:26048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787827126.084285:0:26048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787827126.084298:0:26048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787827126.084327:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d534390d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787827126.084491:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787827126.084498:0:26048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787827126.084509:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d53444b4800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787827126.084513:0:26048:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444b4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787827126.084518:0:26048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787827126.084602:0:26048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787827126.084606:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787827126.084612:0:26048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787827126.084618:0:26048:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d546e142800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787827126.084630:0:26048:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d5460440000) has exports, disconnecting them 00000020:00080000:2.0:1787827126.084635:0:26048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d546e142800), last request at 1787827094 00000020:00000080:2.0:1787827126.084638:0:26048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a79544cd 00000020:00080000:2.0:1787827126.084650:0:26048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d546e142800): rc 0 00000020:00000080:2.0:1787827126.084653:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d546e142800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787827126.084676:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d546e142800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787827126.086897:0:26048:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787827126.086902:0:26048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787827126.086905:0:26048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787827126.086910:0:26048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787827126.086953:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d546e141000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787827126.087030:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787827126.087036:0:26048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787827126.087039:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d53444b6000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787827126.087042:0:26048:0:(genops.c:844:class_export_destroy()) destroying export ffff8d53444b6000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787827126.087046:0:26048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787827126.087098:0:26048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5343bea800 1 00000020:00000080:3.0:1787827126.087111:0:26048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a795445d 00000020:00000080:3.0:1787827126.087117:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d5343be9000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787827126.087127:0:26048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787827126.087131:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787827126.087137:0:26048:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1787827126.087138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343be9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:3.0:1787827126.087141:0:26048:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d53437f3370) has no exports 00000020:00000080:3.0:1787827126.100209:0:26048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787827126.100356:0:26048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787827126.100360:0:26048:0:(genops.c:885:class_export_put()) final put ffff8d5343bef800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787827126.100363:0:26048:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5343bef800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787827126.100368:0:26048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787827126.101264:0:26048:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d5343bee800 00000020:02000400:3.0:1787827126.101318:0:26048:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:1.0:1787827126.353445:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827126.353468:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143831296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827126.353534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827126.353567:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831296 00000100:00100000:0.0:1787827126.353575:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831296 00000100:00100000:0.0:1787827126.353623:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787827126.353634:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143831296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827126.353666:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827126.353722:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143831296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827126.353729:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787827126.353762:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143831296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787827126.481322:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827126.673087:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827126.673111:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827126.673130:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827126.673146:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134307712 00000100:00100000:2.0:1787827126.673153:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827126.673157:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134307712 00000100:00100000:3.0:1787827126.673158:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134307840 00000100:00100000:3.0:1787827126.673165:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134307840 00000100:00100000:1.0:1787827126.673180:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134307968 00000100:00100000:1.0:1787827126.673186:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134307968 00000100:00100000:0.0:1787827126.673250:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 597 00000100:00100000:2.0:1787827126.673266:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827126.673266:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 592 00000100:00100000:0.0:1787827126.673267:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134307712:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827126.673279:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 593 00000100:00100000:1.0:1787827126.673290:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134307968:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827126.673320:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308096 00000100:00100000:3.0:1787827126.673322:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2391:x1874672134307840:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827126.673324:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308096 00000100:00100000:2.0:1787827126.673351:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308224 00000100:00100000:0.0:1787827126.673353:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134307712:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827126.673354:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134307968:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 62us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827126.673354:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308224 00000100:00100000:3.0:1787827126.673369:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+14:2391:x1874672134307840:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827126.673375:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 597 00000100:00100000:1.0:1787827126.673376:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 593 00000100:00100000:2.0:1787827126.673381:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 310 00000100:00100000:2.0:1787827126.673406:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134308224:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827126.673406:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 592 00000100:00080000:1.0:1787827126.673424:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787827126.673430:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827126.673441:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 226 00000100:00100000:3.0:1787827126.673448:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1874672134308096:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827126.673455:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134308224:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000020:00080000:3.0:1787827126.673458:0:8399:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.6@tcp 00000100:00100000:2.0:1787827126.673465:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 310 00000100:00100000:3.0:1787827126.673499:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1874672134308096:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 49us (345us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787827126.673508:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 226 00000100:00100000:2.0:1787827126.682666:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827126.682719:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308352 00000100:00100000:3.0:1787827126.682728:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308352 00000100:00100000:3.0:1787827126.682772:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 227 00000100:00100000:3.0:1787827126.682790:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134308352:12345-192.168.203.6@tcp:8:ptlrpcd_00_01.0 00010000:00020000:3.0:1787827126.682813:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787827126.682874:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874672134308352:12345-192.168.203.6@tcp:8:ptlrpcd_00_01.0 Request processed in 86us (214us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787827126.682882:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 227 00000004:00080000:2.0:1787827126.865370:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 501728152890ns, next at 502728150276ns, rc = 0 00000100:00100000:3.0:1787827126.865419:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143831424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827126.865485:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827126.865528:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831424 00000100:00100000:3.0:1787827126.865532:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143831552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827126.865536:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831424 00000100:00100000:3.0:1787827126.865561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827126.865595:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831552 00000100:00100000:0.0:1787827126.865599:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831552 00000100:00100000:0.0:1787827126.865622:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787827126.865630:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143831424:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827126.865630:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787827126.865637:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54765b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143831552:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1787827126.865638:0:22265:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000020:00080000:2.0:1787827126.865642:0:16591:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787827126.865681:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143831424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (195us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787827126.865683:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54765b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1874672143831552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (122us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787827126.865690:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787827126.865694:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:02020000:3.0:1787827126.865714:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787827126.869253:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787827126.869262:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787827126.869267:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1787827126.875110:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1787827126.875120:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787827126.875130:0:3618:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 470 00000100:00080000:3.0:1787827126.875140:0:3618:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787827126.875204:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547fbfc000 x1874672143831680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:02020000:3.0:1787827126.875278:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787827126.875283:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787827126.875287:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1787827126.875288:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143831680:0@lo:8:ptlrpcd_00_02.0 00000100:02000400:3.0:1787827126.875296:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1787827126.875329:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1787827126.875332:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787827126.875337:0:3618:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:3.0:1787827126.875342:0:3618:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787827126.875348:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827126.875361:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547fbfc780 x1874672143831808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787827126.875392:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831680 00000100:00100000:1.0:1787827126.875399:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831680 00000100:00100000:2.0:1787827126.875406:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143831808:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:2.0:1787827126.875435:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827126.875447:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831808 00000100:00100000:1.0:1787827126.875453:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831808 00000100:00100000:0.0:1787827126.875461:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787827126.875471:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143831680:12345-0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1787827126.875478:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787827126.875485:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143831808:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:0.0:1787827126.875493:0:8401:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1787827126.875500:0:19008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787827126.875550:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1874672143831680:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 79us (202us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787827126.875558:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143831808:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 70us (122us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787827126.875561:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787827126.875570:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:2.0:1787827126.875581:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827126.875586:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827126.875590:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143831808:0@lo:8:ptlrpcd_00_02.0 00000100:00080000:2.0:1787827126.875601:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827126.875603:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827126.875605:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143831680:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:2.0:1787827127.505432:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827128.529412:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787827128.914369:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 22 committed 00000001:00080000:1.0:1787827128.914407:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000004:00080000:1.0:1787827128.914412:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00010000:00010000:3.0:1787827128.914620:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914634:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914642:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914649:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7a1000 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827128.914653:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914666:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914695:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb66fff45 (ffff8d5450fb5c00) 00010000:00010000:3.0:1787827128.914698:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787827128.914704:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914710:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7a1000/0xc0fefc09a7954552 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914726:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914730:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914734:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914736:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e079400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827128.914738:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914742:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914746:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb66fff45 (ffff8d5450fb5c00) 00010000:00010000:3.0:1787827128.914747:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787827128.914749:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914752:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d546e079400/0xc0fefc09a795458a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb66fff45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914770:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914774:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914778:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914780:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:3.0:1787827128.914782:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914785:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914790:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x49967031 (ffff8d5458a66600) 00010000:00010000:3.0:1787827128.914791:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787827128.914793:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827128.914796:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112400/0xc0fefc09a79545b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.553382:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787827130.449432:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1787827130.449441:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143832320:0@lo:400:kworker.0 00000100:00080000:2.0:1787827130.449450:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787827130.449454:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787827130.449460:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1787827130.449470:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787827130.449476:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787827130.449500:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b59680 x1874672143832704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787827130.449511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787827130.449551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787827130.449555:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787827130.449557:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787827130.449562:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1787827130.449566:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787827130.449570:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787827130.449581:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832320 00000100:00100000:2.0:1787827130.449586:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5343b5b480 x1874672143833472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787827130.449587:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143832960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827130.449589:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832320 00000100:00100000:1.0:1787827130.449626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827130.449631:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143832192:0@lo:400:kworker.0 00000100:00100000:3.0:1787827130.449641:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787827130.449653:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827130.449669:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832960 00000100:00100000:1.0:1787827130.449674:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832960 00000100:00100000:2.0:1787827130.449685:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827130.449718:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143832832:0@lo:400:kworker.0 00000100:00100000:3.0:1787827130.449719:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143832320:12345-0@lo:400:kworker.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827130.449724:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787827130.449736:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143832960:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827130.449739:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787827130.449751:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787827130.449758:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827130.449775:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143833344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827130.449785:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832192 00000100:00100000:3.0:1787827130.449791:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832192 00000100:00100000:2.0:1787827130.449809:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827130.449818:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143832960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827130.449825:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1787827130.449827:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787827130.449835:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787827130.449840:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143832192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827130.449843:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833344 00000100:00100000:2.0:1787827130.449847:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143832064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827130.449848:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833344 00000100:00100000:1.0:1787827130.449873:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787827130.449880:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143833344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827130.449943:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143831936:0@lo:400:kworker.0 00000100:00100000:3.0:1787827130.450481:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143832192:12345-0@lo:400:kworker.0 Request processed in 645us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827130.450489:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827130.450494:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1787827130.450526:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143832704:0@lo:8:kworker.0 00000100:00100000:2.0:1787827130.450528:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143832576:0@lo:400:kworker.0 00000100:00100000:3.0:1787827130.450579:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827130.450580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827130.450588:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827130.450627:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143833472:0@lo:8:kworker.0 00000100:00100000:0.0:1787827130.450642:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143832448:0@lo:400:kworker.0 00000100:00100000:3.0:1787827130.450656:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827130.450684:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827130.450692:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832832 00000100:00100000:3.0:1787827130.450697:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832832 00000100:00100000:0.0:1787827130.450707:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143833088:0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.450728:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827130.450746:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787827130.450751:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143833600:0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.450770:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827130.450794:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831936 00000100:00100000:0.0:1787827130.450797:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831936 00000100:00100000:0.0:1787827130.450823:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1787827130.450836:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143831936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.450871:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3619:x1874672143831936:12345-0@lo:400:kworker.0 Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827130.450878:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1787827130.450904:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832448 00000100:00100000:0.0:1787827130.450908:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832448 00000100:00100000:0.0:1787827130.450927:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833088 00000100:00100000:0.0:1787827130.450929:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833088 00000100:00100000:0.0:1787827130.450947:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1787827130.450953:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143832448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.450981:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143832448:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827130.450988:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1787827130.450998:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1787827130.451004:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143833088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.451028:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143833088:12345-0@lo:400:kworker.0 Request processed in 24us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827130.451034:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1787827130.451069:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143831936:0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.451081:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143832448:0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.451089:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143833088:0@lo:400:kworker.0 00000100:00100000:2.0:1787827130.451101:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143833216:0@lo:400:kworker.0 00000100:00100000:2.0:1787827130.451131:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787827130.451144:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787827130.451149:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787827130.451233:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827130.451261:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832704 00000100:00100000:3.0:1787827130.451266:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832704 00000100:00100000:3.0:1787827130.451283:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833472 00010000:00080000:0.0:1787827130.451287:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fbfd680 x1874672143832960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827130.451288:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833472 00000100:00100000:2.0:1787827130.451289:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143832192:0@lo:400:kworker.0 00000100:00100000:3.0:1787827130.451304:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833600 00000100:00100000:3.0:1787827130.451308:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833600 00000100:00100000:2.0:1787827130.451318:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787827130.451327:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143832832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.451329:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143832960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827130.451334:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787827130.451346:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143833600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.451353:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143832320:0@lo:400:kworker.0 00000100:00100000:2.0:1787827130.451384:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143832832:12345-0@lo:400:kworker.0 Request processed in 58us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827130.451392:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787827130.451413:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143833600:12345-0@lo:400:kworker.0 Request processed in 69us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827130.451414:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787827130.451424:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143832704:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787827130.451428:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787827130.451429:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833216 00000100:00100000:0.0:1787827130.451435:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833216 00010000:00020000:2.0:1787827130.451446:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787827130.451452:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787827130.451458:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143833472:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787827130.451473:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00010000:00020000:3.0:1787827130.451477:0:9498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787827130.451485:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1874672143832704:12345-0@lo:8:kworker.0 Request processed in 59us (911us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787827130.451486:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143833216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827130.451500:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787827130.451516:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1874672143833472:12345-0@lo:8:kworker.0 Request processed in 55us (859us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787827130.451525:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1787827130.451535:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827130.451541:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827130.451545:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143832704:0@lo:8:kworker.0 00000100:00080000:2.0:1787827130.451559:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827130.451563:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787827130.451568:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143833472:0@lo:8:kworker.0 00010000:00080000:2.0:1787827130.451613:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b5bc00 x1874672143832832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827130.451619:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143833344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1736us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827130.451632:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787827130.451645:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143832832:0@lo:400:kworker.0 00000100:00100000:1.0:1787827130.451673:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832064 00000100:00100000:1.0:1787827130.451683:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832064 00000100:00100000:1.0:1787827130.451708:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143832576 00000100:00100000:1.0:1787827130.451710:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143832576 00010000:00080000:2.0:1787827130.451731:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fbfcb40 x1874672143833344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827130.451741:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874672143833216:12345-0@lo:400:kworker.0 Request processed in 258us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827130.451745:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143833344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827130.451755:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00010000:00080000:3.0:1787827130.451771:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b59a40 x1874672143833600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787827130.451776:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5343b59e00 x1874672143833216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787827130.451780:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827130.451797:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143833600:0@lo:400:kworker.0 00000100:00100000:2.0:1787827130.451799:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874672143833216:0@lo:400:kworker.0 00000100:00100000:0.0:1787827130.451806:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787827130.451816:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143832064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787827130.451840:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827130.451880:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143832064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827130.451886:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787827130.451910:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143832064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827130.451965:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787827130.451971:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143832576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827130.452008:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143832576:12345-0@lo:400:kworker.0 Request processed in 37us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827130.452014:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787827130.452044:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143832576:0@lo:400:kworker.0 00010000:00010000:0.0:1787827130.577426:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827131.473747:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143833728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827131.473813:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827131.473867:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833728 00000100:00100000:3.0:1787827131.473876:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833728 00000100:00100000:3.0:1787827131.473927:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787827131.473937:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143833728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827131.473977:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827131.474035:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143833728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827131.474042:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787827131.474113:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143833728:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827131.601415:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827131.793114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827131.793141:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827131.793172:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827131.793182:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308480 00000100:00100000:0.0:1787827131.793190:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308480 00000100:00100000:2.0:1787827131.793205:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827131.793206:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308608 00000100:00100000:3.0:1787827131.793242:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308736 00000100:00100000:1.0:1787827131.793248:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308608 00000100:00100000:3.0:1787827131.793249:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308736 00000100:00100000:2.0:1787827131.793276:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827131.793291:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 599 00000100:00100000:2.0:1787827131.793301:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308864 00000100:00100000:0.0:1787827131.793305:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134308480:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827131.793306:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308864 00000100:00100000:1.0:1787827131.793310:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 598 00000100:00100000:3.0:1787827131.793324:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 599 00000100:00100000:1.0:1787827131.793326:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134308608:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827131.793328:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134308992 00000100:00100000:2.0:1787827131.793331:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134308992 00000100:00100000:3.0:1787827131.793338:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134308736:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827131.793377:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 313 00000100:00100000:2.0:1787827131.793384:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134308992:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827131.793405:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134308480:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 100us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827131.793405:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134308608:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827131.793412:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134308736:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827131.793423:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134308992:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827131.793427:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 599 00000100:00100000:1.0:1787827131.793427:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 598 00000100:00100000:3.0:1787827131.793437:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 599 00000100:00100000:2.0:1787827131.793449:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 313 00000100:00100000:2.0:1787827131.793475:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 232 00000100:00100000:2.0:1787827131.793485:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134308864:12345-192.168.203.6@tcp:8:kworker.0 00000100:00080000:1.0:1787827131.793501:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00020000:2.0:1787827131.793506:0:8399:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787827131.793507:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827131.793513:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827131.793546:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134308864:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 62us (340us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787827131.793554:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 232 00010000:00010000:2.0:1787827132.625462:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827133.649454:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827134.673453:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827135.569419:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143833984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827135.569442:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143834112:0@lo:400:kworker.0 00000100:00100000:3.0:1787827135.569444:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143834368:0@lo:400:kworker.0 00000100:00080000:1.0:1787827135.569449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787827135.569455:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787827135.569460:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787827135.569468:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1787827135.569474:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787827135.569481:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787827135.569488:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827135.569508:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5344bd43c0 x1874672143834880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787827135.569532:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.569539:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827135.569543:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143833856:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787827135.569548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787827135.569559:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787827135.569563:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787827135.569569:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1787827135.569574:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787827135.569582:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1787827135.569602:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827135.569606:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5344bd5e00 x1874672143835264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787827135.569614:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143834368 00000100:00100000:2.0:1787827135.569615:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143834624:0@lo:400:kworker.0 00000100:00100000:3.0:1787827135.569633:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143834368 00000100:00100000:0.0:1787827135.569647:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143834496:0@lo:400:kworker.0 00000100:00100000:1.0:1787827135.569654:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833984 00000100:00100000:1.0:1787827135.569660:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833984 00000100:00100000:2.0:1787827135.569666:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827135.569699:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.569703:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143834624 00000100:00100000:3.0:1787827135.569709:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143834624 00000100:00100000:1.0:1787827135.569714:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143833856 00000100:00100000:1.0:1787827135.569719:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143833856 00000100:00100000:0.0:1787827135.569731:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143835136:0@lo:400:kworker.0 00000100:00100000:2.0:1787827135.569747:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143835392:0@lo:400:kworker.0 00000100:00100000:3.0:1787827135.569748:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1787827135.569759:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787827135.569765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.569765:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143834368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827135.569776:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143833984:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827135.569806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787827135.569807:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827135.569819:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53424421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143834240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827135.569835:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143834368:12345-0@lo:400:kworker.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.569845:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1787827135.569871:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.569873:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835136 00000100:00100000:3.0:1787827135.569878:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835136 00000100:00100000:2.0:1787827135.569884:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143834880:0@lo:8:kworker.0 00000100:00100000:1.0:1787827135.569892:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143833984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827135.569901:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143835008:0@lo:400:kworker.0 00000100:00100000:1.0:1787827135.569911:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787827135.569925:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1787827135.569937:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787827135.569940:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143834624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827135.569943:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827135.569955:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143833856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827135.569966:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827135.569970:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:1.0:1787827135.569974:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827135.569982:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143834752:0@lo:400:kworker.0 00000100:00100000:2.0:1787827135.570005:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143835264:0@lo:8:kworker.0 00000100:00100000:1.0:1787827135.570029:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143833856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827135.570037:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.570038:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143834624:12345-0@lo:400:kworker.0 Request processed in 98us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.570052:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1787827135.570060:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787827135.570075:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.570078:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835008 00000100:00100000:3.0:1787827135.570083:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835008 00000100:00100000:0.0:1787827135.570092:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143834112 00000100:00080000:1.0:1787827135.570096:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827135.570098:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143834112 00000100:00080000:1.0:1787827135.570106:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827135.570112:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827135.570127:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1787827135.570138:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143835136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827135.570155:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00010000:00080000:1.0:1787827135.570155:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d368b40 x1874672143833984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827135.570167:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1787827135.570172:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143834112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827135.570188:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143835136:12345-0@lo:400:kworker.0 Request processed in 51us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827135.570197:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143833984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827135.570200:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143835008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827135.570201:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00010000:00080000:1.0:1787827135.570234:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fbff480 x1874672143833856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827135.570251:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143833856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827135.570262:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:3617:x1874672143834112:12345-0@lo:400:kworker.0 Request processed in 97us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827135.570276:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1787827135.570283:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143834496 00000100:00100000:3.0:1787827135.570288:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143834496 00010000:00080000:1.0:1787827135.570296:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd4b40 x1874672143835136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827135.570307:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143835136:0@lo:400:kworker.0 00000100:00100000:0.0:1787827135.570323:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143834240 00000100:00100000:2.0:1787827135.570336:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143835008:12345-0@lo:400:kworker.0 Request processed in 138us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827135.570340:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143834240 00000100:00100000:3.0:1787827135.570347:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143834752 00000100:00100000:3.0:1787827135.570353:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143834752 00000100:00100000:2.0:1787827135.570354:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1787827135.570371:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787827135.570384:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143834496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827135.570387:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787827135.570401:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874672143834240:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827135.570409:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787827135.570419:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835392 00000004:00000024:0.0:1787827135.570424:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827135.570426:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143834752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827135.570430:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835392 00000100:00100000:1.0:1787827135.570438:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143834496:12345-0@lo:400:kworker.0 Request processed in 55us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827135.570449:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787827135.570473:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143834240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827135.570483:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787827135.570494:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143834880 00000100:00100000:2.0:1787827135.570502:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143834880 00000100:00100000:3.0:1787827135.570502:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143834752:12345-0@lo:400:kworker.0 Request processed in 78us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827135.570507:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143834496:0@lo:400:kworker.0 00000100:00100000:0.0:1787827135.570526:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143834752:0@lo:400:kworker.0 00000100:00100000:3.0:1787827135.570527:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787827135.570549:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835264 00000100:00100000:2.0:1787827135.570555:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835264 00000100:00100000:0.0:1787827135.570559:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53424421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143834240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827135.570586:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143835008:0@lo:400:kworker.0 00000100:00100000:3.0:1787827135.570591:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787827135.570606:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143834368:0@lo:400:kworker.0 00000100:00100000:2.0:1787827135.570608:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787827135.570610:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143835392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827135.570624:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143834880:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787827135.570636:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787827135.570642:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143835264:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787827135.570650:0:19008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1787827135.570661:0:19009:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787827135.570663:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143835392:12345-0@lo:400:kworker.0 Request processed in 60us (858us total) trans 0 rc 0/0 00010000:00080000:1.0:1787827135.570675:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd5a40 x1874672143835392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827135.570675:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787827135.570687:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143835392:0@lo:400:kworker.0 00000100:00100000:1.0:1787827135.570711:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143834624:0@lo:400:kworker.0 00000100:00100000:2.0:1787827135.570726:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3615:x1874672143834880:12345-0@lo:8:kworker.0 Request processed in 102us (766us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787827135.570732:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143835264:12345-0@lo:8:kworker.0 Request processed in 85us (679us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787827135.570736:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3617:1874672143834112:0@lo:400:kworker.0 00000100:00080000:3.0:1787827135.570749:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1787827135.570760:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1787827135.570761:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787827135.570772:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143834880:0@lo:8:kworker.0 00000100:00100000:0.0:1787827135.570775:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:3.0:1787827135.570793:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787827135.570797:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787827135.570801:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143835264:0@lo:8:kworker.0 00010000:00010000:2.0:1787827135.697405:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827136.593422:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143835520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827136.593524:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827136.593596:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835520 00000100:00100000:2.0:1787827136.593610:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835520 00000100:00100000:2.0:1787827136.593686:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787827136.593701:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143835520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787827136.593747:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787827136.593841:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143835520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827136.593850:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787827136.593900:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143835520:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827136.721393:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827136.914121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827136.914164:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827136.914182:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134309120 00000100:00100000:1.0:1787827136.914191:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134309120 00000100:00100000:1.0:1787827136.914278:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 601 00000100:00100000:0.0:1787827136.914286:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827136.914293:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134309120:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827136.914331:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134309504 00000100:00100000:0.0:1787827136.914338:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827136.914339:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134309504 00000100:00100000:2.0:1787827136.914366:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134309632 00000100:00100000:2.0:1787827136.914370:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134309632 00000100:00100000:1.0:1787827136.914375:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134309120:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 86us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827136.914389:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 601 00000100:00100000:0.0:1787827136.914392:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827136.914405:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 315 00000100:00100000:2.0:1787827136.914412:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134309632:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827136.914438:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134309632:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 27us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827136.914452:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 235 00000100:00100000:2.0:1787827136.914461:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 315 00000100:00100000:1.0:1787827136.914462:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134309504:12345-192.168.203.6@tcp:8:kworker.0 00010000:00020000:1.0:1787827136.914485:0:8402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787827136.914490:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827136.914524:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874672134309504:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 64us (252us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787827136.914531:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 235 00000100:00100000:3.0:1787827136.914641:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134309248 00000100:00100000:2.0:1787827136.914642:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134309376 00000100:00100000:3.0:1787827136.914648:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134309248 00000100:00100000:2.0:1787827136.914649:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134309376 00000100:00100000:2.0:1787827136.914699:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 604 00000100:00100000:2.0:1787827136.914708:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134309376:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1787827136.914719:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827136.914725:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827136.914755:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134309376:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.914757:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 605 00000100:00100000:2.0:1787827136.914769:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 604 00000100:00100000:3.0:1787827136.914773:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134309248:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827136.914812:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134309248:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.914819:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 605 00010000:00010000:3.0:1787827137.745293:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827138.770605:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827139.793513:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787827140.326509:0:26665:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787827140.326512:0:26665:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787827140.326513:0:26665:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787827140.326617:0:26665:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d5445588000 00000020:01000004:0.0:1787827140.326632:0:26665:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787827140.326646:0:26665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787827140.326660:0:26665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d5450e8b370) 00000020:00000080:0.0:1787827140.326675:0:26665:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787827140.368724:0:26665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787827140.370624:0:26665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787827140.370909:0:26665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787827140.371061:0:26665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787827140.371239:0:26665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787827140.371639:0:26665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787827140.371814:0:26665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1787827140.372921:0:26665:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787827140.373143:0:26665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787827140.373154:0:26665:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787827140.373164:0:26665:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a79545d0 00000020:01000004:0.0:1787827140.373170:0:26665:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787827140.373192:0:26665:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787827140.373195:0:26665:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787827140.373202:0:26665:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787827140.373269:0:26665:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787827140.373274:0:26665:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787827140.380264:0:26665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787827140.380314:0:26665:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787827140.380320:0:26665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787827140.380322:0:26665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787827140.380323:0:26665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827140.380324:0:26665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827140.380329:0:26665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827140.380331:0:26665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827140.380332:0:26665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827140.380334:0:26665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827140.380335:0:26665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787827140.380338:0:26665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787827140.380345:0:26665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787827140.380346:0:26665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787827140.380346:0:26665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827140.380347:0:26665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827140.380348:0:26665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827140.380349:0:26665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827140.380350:0:26665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827140.380351:0:26665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827140.380352:0:26665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787827140.380378:0:26665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787827140.380396:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143835648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787827140.380474:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.380530:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d3919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.380548:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835648 00000100:00100000:2.0:1787827140.380556:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835648 00000100:00100000:2.0:1787827140.380606:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1787827140.380615:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:26665:x1874672143835648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787827140.380659:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787827140.380662:0:6478:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787827140.380665:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787827140.380934:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:26665:x1874672143835648:12345-0@lo:253:mount.lustre.0 Request processed in 319us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.380942:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1787827140.380968:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143835648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787827140.380980:0:26665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787827140.380982:0:26665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787827140.380983:0:26665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787827140.380984:0:26665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827140.380985:0:26665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827140.380986:0:26665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827140.380987:0:26665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827140.380988:0:26665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827140.380989:0:26665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827140.380990:0:26665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787827140.381011:0:26665:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d5445588000 from lustre-OST0000 10000000:01000000:0.0:1787827140.381034:0:26665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787827140.381036:0:26665:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787827140.381044:0:26665:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d5450ee99b8 local copy 00010000:00010000:0.0:1787827140.381053:0:26665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827140.381131:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143835776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787827140.381157:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.381181:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787827140.381243:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835776 00000100:00100000:1.0:1787827140.381248:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835776 00000100:00100000:1.0:1787827140.381279:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1787827140.381287:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:26665:x1874672143835776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827140.381350:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:26665:x1874672143835776:12345-0@lo:501:mount.lustre.0 Request processed in 65us (191us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787827140.381356:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1787827140.381364:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143835776:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787827140.381381:0:26665:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787827140.381399:0:26665:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787827140.381404:0:26665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.381412:0:26665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d5471c81400/0xc0fefc09a7953576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795357d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827140.381433:0:26665:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d5445588000 10000000:01000000:0.0:1787827140.381437:0:26665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787827140.381441:0:26665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787827140.381443:0:26665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787827140.381447:0:26665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787827140.381449:0:26665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787827140.381467:0:26665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1a00/0xc0fefc09a79545d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.381474:0:26665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1a00/0xc0fefc09a79545d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.381483:0:26665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1a00/0xc0fefc09a79545d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827140.381502:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143835904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787827140.381525:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.381550:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d391b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787827140.381577:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143835904 00000100:00100000:3.0:1787827140.381584:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143835904 00000100:00100000:3.0:1787827140.381614:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1787827140.381642:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+21:26665:x1874672143835904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787827140.381652:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827140.381664:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d546e079000/0xc0fefc09a79545de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a79545d7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.381685:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d546e079000/0xc0fefc09a79545de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a79545d7 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.381696:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d546e079000/0xc0fefc09a79545de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79545d7 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.381705:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d546e079000, rc 0) 00000100:00100000:3.0:1787827140.381742:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143835904:12345-0@lo:101:mount.lustre.0 Request processed in 104us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.381750:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1787827140.381756:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143835904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787827140.381769:0:26665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1a00/0xc0fefc09a79545d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79545de expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.381778:0:26665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1a00/0xc0fefc09a79545d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a79545de expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787827140.381910:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 14 count 14 00000040:00080000:0.0:1787827140.382135:0:26665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787827140.383486:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].1, 224 off8416 00000040:00080000:0.0:1787827140.383517:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].2, 128 off8544 00000040:00080000:0.0:1787827140.383532:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].3, 112 off8656 00000040:00080000:0.0:1787827140.383547:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].4, 224 off8880 00000040:00080000:0.0:1787827140.383560:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].5, 224 off9104 00000040:00080000:0.0:1787827140.383573:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].6, 80 off9184 00000040:00080000:0.0:1787827140.383586:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].7, 224 off9408 00000040:00080000:0.0:1787827140.383598:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].8, 224 off9632 00000040:00080000:0.0:1787827140.383610:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].9, 80 off9712 00000040:00080000:0.0:1787827140.383623:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].10, 224 off9936 00000040:00080000:0.0:1787827140.383636:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].11, 224 off10160 00000040:00080000:0.0:1787827140.383649:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].12, 120 off10280 00000040:00080000:0.0:1787827140.383670:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].13, 224 off10504 00000040:00080000:0.0:1787827140.383676:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 13 count 14 00000100:00100000:0.0:1787827140.383761:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787827140.383805:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.383859:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54411ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827140.384027:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836032 00000100:00100000:1.0:1787827140.384049:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836032 00000100:00100000:1.0:1787827140.384093:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1787827140.384101:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827140.384200:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836032:12345-0@lo:501:mount.lustre.0 Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.384207:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1787827140.384253:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787827140.384302:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787827140.384344:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.384370:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54411ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827140.384386:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836160 00000100:00100000:1.0:1787827140.384390:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836160 00000100:00100000:1.0:1787827140.384415:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1787827140.384422:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787827140.384499:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836160:12345-0@lo:503:mount.lustre.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.384505:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1787827140.384517:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787827140.384950:0:26665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787827140.385004:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827140.385048:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.385067:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827140.385105:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836288 00000100:00100000:1.0:1787827140.385111:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836288 00000100:00100000:1.0:1787827140.385138:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1787827140.385145:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787827140.385250:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836288:12345-0@lo:502:mount.lustre.0 Request processed in 105us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.385257:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1787827140.385306:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787827140.385449:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].1, 224 off8416 00000040:00080000:0.0:1787827140.385472:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].2, 128 off8544 00000040:00080000:0.0:1787827140.385486:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].3, 112 off8656 00000040:00080000:0.0:1787827140.385495:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].4, 224 off8880 00000040:00080000:0.0:1787827140.385503:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].5, 224 off9104 00000040:00080000:0.0:1787827140.385516:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].6, 80 off9184 00000040:00080000:0.0:1787827140.385528:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].7, 224 off9408 00000040:00080000:0.0:1787827140.385543:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].8, 224 off9632 00000040:00080000:0.0:1787827140.385562:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].9, 80 off9712 00000040:00080000:0.0:1787827140.385573:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].10, 224 off9936 00000040:00080000:0.0:1787827140.385580:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].11, 224 off10160 00000040:00080000:0.0:1787827140.385587:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].12, 120 off10280 00000100:00100000:0.0:1787827140.385601:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827140.385627:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.385655:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e038cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827140.385768:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836416 00000100:00100000:3.0:1787827140.385773:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836416 00000100:00100000:3.0:1787827140.385842:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1787827140.385850:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827140.385928:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836416:12345-0@lo:502:mount.lustre.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.385934:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1787827140.385992:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787827140.386033:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].13, 224 off10504 00000040:00080000:0.0:1787827140.386042:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787827140.386678:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787827140.386686:0:26669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787827140.386691:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827140.386694:0:26669:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787827140.386699:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787827140.386711:0:26669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d5450e8cd28) 00000020:00000080:0.0:1787827140.386733:0:26669:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787827140.386739:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787827140.386798:0:26669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5445588000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787827140.386805:0:26669:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787827140.386811:0:26669:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0fefc09a79545ec 00010000:00010000:0.0:1787827140.389708:0:26669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:0.0:1787827140.389801:0:26669:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 34359738368 lx: 1874672143596416 gen 0 00000001:00080000:0.0:1787827140.389826:0:26669:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 30064771560 srv lr: 34359738368 lx: 1874672143801216 gen 0 00000001:00080000:0.0:1787827140.389834:0:26669:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2313f4ee-480a-47b2-8d93-5bb216a57733 idx: 2 lr: 34359738370 srv lr: 34359738368 lx: 1874672134305280 gen 0 00000001:00000004:0.0:1787827140.389845:0:26669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 34359738370 00080000:10000000:0.0:1787827140.391044:0:26669:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x11:0x0] (8/32) registered 00000020:00000080:0.0:1787827140.392073:0:26669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787827140.392090:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827140.392097:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827140.392100:0:26669:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787827140.392105:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787827140.392109:0:26669:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787827140.392110:0:26669:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787827140.392112:0:26669:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787827140.392113:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787827140.392117:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827140.392118:0:26669:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787827140.392128:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827140.392131:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827140.392133:0:26669:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787827140.392136:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787827140.392138:0:26669:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787827140.392140:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827140.392143:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827140.392144:0:26669:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787827140.392147:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827140.392149:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827140.392151:0:26669:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787827140.392155:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787827140.392177:0:26669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827140.392180:0:26669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827140.392182:0:26669:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787827140.392186:0:26669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x30:0x0] index 14 count 14 00000020:01000000:3.0:1787827140.392367:0:26665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787827140.392397:0:26665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787827140.392422:0:26665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1a00/0xc0fefc09a79545d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79545de expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.392434:0:26665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1a00/0xc0fefc09a79545d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a79545de expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827140.392453:0:26665:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d5445588000 from 1 10000000:01000000:3.0:1787827140.392456:0:26665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787827140.392489:0:26665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079400/0xc0fefc09a7954608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.392498:0:26665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d546e079400/0xc0fefc09a7954608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.392508:0:26665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d546e079400/0xc0fefc09a7954608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827140.392531:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787827140.392594:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.392636:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.392641:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836544 00000100:00100000:2.0:1787827140.392649:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836544 00000100:00100000:2.0:1787827140.392712:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1787827140.392722:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:26665:x1874672143836544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787827140.392735:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827140.392748:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d3800/0xc0fefc09a795460f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7954608 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.392789:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d3800/0xc0fefc09a795460f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7954608 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.392801:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d3800/0xc0fefc09a795460f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7954608 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.392811:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3800, rc 0) 00000100:00100000:2.0:1787827140.392876:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143836544:12345-0@lo:101:mount.lustre.0 Request processed in 156us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.392884:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1787827140.393320:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787827140.393350:0:26665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d546e079400/0xc0fefc09a7954608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795460f expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.393364:0:26665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d546e079400/0xc0fefc09a7954608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795460f expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787827140.393618:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 7 count 7 00000040:00080000:3.0:1787827140.393929:0:26665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787827140.394200:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].1, 224 off8416 00000040:00080000:3.0:1787827140.394268:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].2, 112 off8528 00000040:00080000:3.0:1787827140.394302:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].3, 224 off8752 00000040:00080000:3.0:1787827140.394326:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].4, 224 off8976 00000040:00080000:3.0:1787827140.394349:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].5, 112 off9088 00000040:00080000:3.0:1787827140.394379:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].6, 224 off9312 00000040:00080000:3.0:1787827140.394385:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 6 count 7 00000100:00100000:3.0:1787827140.394461:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787827140.394529:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.394586:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787827140.394779:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836672 00000100:00100000:1.0:1787827140.394787:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836672 00000100:00100000:1.0:1787827140.394839:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1787827140.394850:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143836672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827140.394994:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143836672:12345-0@lo:501:mount.lustre.0 Request processed in 141us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.395015:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1787827140.395071:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787827140.395138:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787827140.395201:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827140.395264:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447219600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827140.395285:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836800 00000100:00100000:1.0:1787827140.395301:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836800 00000100:00100000:1.0:1787827140.395343:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1787827140.395352:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143836800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787827140.395455:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143836800:12345-0@lo:503:mount.lustre.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.395463:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1787827140.395802:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836800:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787827140.396288:0:26665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827140.396369:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827140.396418:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.396447:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.396630:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143836928 00000100:00100000:2.0:1787827140.396637:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143836928 00000100:00100000:2.0:1787827140.396811:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1787827140.396822:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143836928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787827140.396972:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143836928:12345-0@lo:502:mount.lustre.0 Request processed in 152us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.396979:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1787827140.397396:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143836928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787827140.397814:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].1, 224 off8416 00000040:00080000:3.0:1787827140.397852:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].2, 112 off8528 00000040:00080000:3.0:1787827140.397869:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].3, 224 off8752 00000040:00080000:3.0:1787827140.397882:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].4, 224 off8976 00000040:00080000:3.0:1787827140.397895:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].5, 112 off9088 00000100:00100000:3.0:1787827140.397924:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787827140.397975:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.398015:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d53429d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787827140.398278:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837056 00000100:00100000:0.0:1787827140.398285:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837056 00000100:00100000:0.0:1787827140.398340:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1787827140.398349:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143837056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827140.398456:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143837056:12345-0@lo:502:mount.lustre.0 Request processed in 108us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827140.398464:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1787827140.398871:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787827140.399170:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].6, 224 off9312 00000040:00080000:3.0:1787827140.399182:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1787827140.399889:0:26673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827140.399898:0:26673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827140.399900:0:26673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787827140.399907:0:26673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5445588000 00000020:00000080:3.0:1787827140.399910:0:26673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787827140.399940:0:26673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827140.399943:0:26673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827140.399945:0:26673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787827140.399948:0:26673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827140.399950:0:26673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827140.399952:0:26673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787827140.399955:0:26673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d5445588000 00000020:00000080:3.0:1787827140.399957:0:26673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787827140.400013:0:26673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827140.400017:0:26673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827140.400018:0:26673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787827140.400021:0:26673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x32:0x0] index 7 count 7 00000020:01000000:0.0:1787827140.400099:0:26665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787827140.400127:0:26665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787827140.400151:0:26665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d546e079400/0xc0fefc09a7954608 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795460f expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.400162:0:26665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d546e079400/0xc0fefc09a7954608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795460f expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827140.400242:0:26665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787827140.400250:0:26665:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d5445588000 10000000:01000000:0.0:1787827140.400254:0:26665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d5445588000 10000000:01000000:0.0:1787827140.400259:0:26665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787827140.400264:0:26665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d5445588000 from 1 10000000:01000000:0.0:1787827140.400268:0:26665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787827140.400309:0:26665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7954616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.400322:0:26665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7954616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.400334:0:26665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7954616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827140.400354:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787827140.400405:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.400450:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547d272c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.400470:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837184 00000100:00100000:2.0:1787827140.400477:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837184 00000100:00100000:2.0:1787827140.400521:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1787827140.400531:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:26665:x1874672143837184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787827140.400550:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827140.400573:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d2000/0xc0fefc09a795461d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a7954616 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.400598:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d2000/0xc0fefc09a795461d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a7954616 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.400608:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d2000/0xc0fefc09a795461d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a7954616 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.400617:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2000, rc 0) 00000100:00100000:2.0:1787827140.400662:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837184:12345-0@lo:101:mount.lustre.0 Request processed in 133us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.400669:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1787827140.400741:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787827140.400755:0:26665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7954616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795461d expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827140.400766:0:26665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7954616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a795461d expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787827140.400970:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 52 count 51 00000040:00080000:0.0:1787827140.401249:0:26665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787827140.401484:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].1, 224 off8416 00000040:00080000:0.0:1787827140.401517:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].2, 120 off8536 00000040:00080000:0.0:1787827140.401537:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].3, 168 off8704 00000040:00080000:0.0:1787827140.401555:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].4, 224 off8928 00000040:00080000:0.0:1787827140.401602:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].5, 224 off9152 00000040:00080000:0.0:1787827140.401625:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].6, 120 off9272 00000040:00080000:0.0:1787827140.401642:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].7, 168 off9440 00000040:00080000:0.0:1787827140.401670:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].8, 224 off9664 00000040:00080000:0.0:1787827140.401686:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].9, 224 off9888 00000040:00080000:0.0:1787827140.401699:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].10, 120 off10008 00000040:00080000:0.0:1787827140.401714:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].11, 224 off10232 00000040:00080000:0.0:1787827140.401729:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].12, 224 off10456 00000040:00080000:0.0:1787827140.401747:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].13, 88 off10544 00000040:00080000:0.0:1787827140.401763:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].14, 128 off10672 00000040:00080000:0.0:1787827140.401777:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].15, 144 off10816 00000040:00080000:0.0:1787827140.401793:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].16, 160 off10976 00000040:00080000:0.0:1787827140.401808:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].17, 224 off11200 00000040:00080000:0.0:1787827140.401826:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].18, 224 off11424 00000040:00080000:0.0:1787827140.401842:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].19, 80 off11504 00000040:00080000:0.0:1787827140.401860:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].20, 224 off11728 00000040:00080000:0.0:1787827140.401877:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].21, 224 off11952 00000040:00080000:0.0:1787827140.401896:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].22, 88 off12040 00000040:00080000:0.0:1787827140.401928:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].23, 128 off12168 00000040:00080000:0.0:1787827140.401948:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].24, 144 off12312 00000040:00080000:0.0:1787827140.401963:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].25, 160 off12472 00000040:00080000:0.0:1787827140.401978:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].26, 224 off12696 00000040:00080000:0.0:1787827140.401993:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].27, 224 off12920 00000040:00080000:0.0:1787827140.402009:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].28, 80 off13000 00000040:00080000:0.0:1787827140.402025:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].29, 224 off13224 00000040:00080000:0.0:1787827140.402042:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].30, 224 off13448 00000040:00080000:0.0:1787827140.402058:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].31, 88 off13536 00000040:00080000:0.0:1787827140.402074:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].32, 128 off13664 00000040:00080000:0.0:1787827140.402090:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].33, 144 off13808 00000040:00080000:0.0:1787827140.402104:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].34, 128 off13936 00000040:00080000:0.0:1787827140.402116:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].35, 224 off14160 00000040:00080000:0.0:1787827140.402131:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].36, 224 off14384 00000040:00080000:0.0:1787827140.402145:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].37, 80 off14464 00000040:00080000:0.0:1787827140.402171:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].38, 224 off14688 00000040:00080000:0.0:1787827140.402183:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].39, 224 off14912 00000040:00080000:0.0:1787827140.402195:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].40, 88 off15000 00000040:00080000:0.0:1787827140.402208:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].41, 128 off15128 00000040:00080000:1.0:1787827140.402412:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].42, 144 off15272 00000040:00080000:1.0:1787827140.402440:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].43, 128 off15400 00000040:00080000:1.0:1787827140.402458:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].44, 224 off15624 00000040:00080000:1.0:1787827140.402473:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].45, 224 off15848 00000040:00080000:1.0:1787827140.402489:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].46, 80 off15928 00000040:00080000:1.0:1787827140.402504:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].47, 224 off16152 00000040:00080000:1.0:1787827140.402519:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].48, 232 off16384 00000040:00080000:1.0:1787827140.402738:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].49, 224 off16608 00000040:00080000:1.0:1787827140.402764:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].50, 120 off16728 00000040:00080000:1.0:1787827140.402789:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].51, 224 off16952 00000040:00080000:1.0:1787827140.402795:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 51 count 51 00000100:00100000:1.0:1787827140.402875:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827140.402928:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.403020:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447d83e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.403063:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837312 00000100:00100000:2.0:1787827140.403070:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837312 00000100:00100000:2.0:1787827140.403120:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1787827140.403129:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787827140.403403:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837312:12345-0@lo:501:mount.lustre.0 Request processed in 275us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.403411:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1787827140.403470:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787827140.403504:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787827140.403547:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.403666:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447d83e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.403698:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837440 00000100:00100000:2.0:1787827140.403703:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837440 00000100:00100000:2.0:1787827140.403768:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1787827140.403776:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787827140.403866:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837440:12345-0@lo:503:mount.lustre.0 Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.403883:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1787827140.403945:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787827140.404339:0:26665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787827140.404407:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787827140.404445:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.404473:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447d83e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827140.404481:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837568 00000100:00100000:0.0:1787827140.404488:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837568 00000100:00100000:0.0:1787827140.404673:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1787827140.404684:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827140.404787:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837568:12345-0@lo:502:mount.lustre.0 Request processed in 106us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827140.404795:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1787827140.404814:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787827140.404968:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].1, 224 off8416 00000040:00080000:1.0:1787827140.404995:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].2, 120 off8536 00000040:00080000:1.0:1787827140.405012:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].3, 168 off8704 00000040:00080000:1.0:1787827140.405029:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].4, 224 off8928 00000040:00080000:1.0:1787827140.405042:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].5, 224 off9152 00000040:00080000:1.0:1787827140.405058:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].6, 120 off9272 00000040:00080000:1.0:1787827140.405074:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].7, 168 off9440 00000040:00080000:1.0:1787827140.405101:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].8, 224 off9664 00000040:00080000:1.0:1787827140.405120:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].9, 224 off9888 00000040:00080000:1.0:1787827140.405138:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].10, 120 off10008 00000040:00080000:1.0:1787827140.405151:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].11, 224 off10232 00000040:00080000:1.0:1787827140.405167:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].12, 224 off10456 00000040:00080000:1.0:1787827140.405184:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].13, 88 off10544 00000040:00080000:1.0:1787827140.405202:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].14, 128 off10672 00000040:00080000:1.0:1787827140.405280:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].15, 144 off10816 00000040:00080000:1.0:1787827140.405310:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].16, 160 off10976 00000040:00080000:1.0:1787827140.405329:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].17, 224 off11200 00000040:00080000:1.0:1787827140.405346:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].18, 224 off11424 00000040:00080000:1.0:1787827140.405365:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].19, 80 off11504 00000040:00080000:1.0:1787827140.405382:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].20, 224 off11728 00000040:00080000:1.0:1787827140.405399:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].21, 224 off11952 00000040:00080000:1.0:1787827140.405411:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].22, 88 off12040 00000040:00080000:1.0:1787827140.405426:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].23, 128 off12168 00000040:00080000:1.0:1787827140.405443:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].24, 144 off12312 00000040:00080000:1.0:1787827140.405463:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].25, 160 off12472 00000040:00080000:1.0:1787827140.405487:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].26, 224 off12696 00000040:00080000:1.0:1787827140.405499:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].27, 224 off12920 00000040:00080000:1.0:1787827140.405511:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].28, 80 off13000 00000040:00080000:1.0:1787827140.405524:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].29, 224 off13224 00000040:00080000:1.0:1787827140.405544:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].30, 224 off13448 00000040:00080000:1.0:1787827140.405565:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].31, 88 off13536 00000040:00080000:1.0:1787827140.405656:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].32, 128 off13664 00000040:00080000:1.0:1787827140.405683:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].33, 144 off13808 00000040:00080000:1.0:1787827140.405699:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].34, 128 off13936 00000040:00080000:1.0:1787827140.405714:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].35, 224 off14160 00000040:00080000:1.0:1787827140.405733:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].36, 224 off14384 00000040:00080000:1.0:1787827140.405753:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].37, 80 off14464 00000040:00080000:1.0:1787827140.405772:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].38, 224 off14688 00000040:00080000:1.0:1787827140.405796:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].39, 224 off14912 00000040:00080000:1.0:1787827140.405818:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].40, 88 off15000 00000040:00080000:1.0:1787827140.405847:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].41, 128 off15128 00000040:00080000:1.0:1787827140.405907:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].42, 144 off15272 00000040:00080000:1.0:1787827140.405931:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].43, 128 off15400 00000040:00080000:1.0:1787827140.405952:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].44, 224 off15624 00000040:00080000:1.0:1787827140.405972:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].45, 224 off15848 00000040:00080000:1.0:1787827140.405994:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].46, 80 off15928 00000040:00080000:1.0:1787827140.406008:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].47, 224 off16152 00000040:00080000:1.0:1787827140.406026:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].48, 232 off16384 00000100:00100000:1.0:1787827140.406072:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787827140.406120:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.406162:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447d83e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827140.406243:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837696 00000100:00100000:0.0:1787827140.406249:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837696 00000100:00100000:0.0:1787827140.406280:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1787827140.406288:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787827140.406389:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837696:12345-0@lo:502:mount.lustre.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827140.406396:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1787827140.406490:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787827140.406717:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].49, 224 off16608 00000040:00080000:1.0:1787827140.406743:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].50, 120 off16728 00000100:00100000:1.0:1787827140.406768:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787827140.406812:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.406837:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447d83e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.406906:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837824 00000100:00100000:2.0:1787827140.406912:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837824 00000100:00100000:2.0:1787827140.406957:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1787827140.406967:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787827140.407050:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143837824:12345-0@lo:502:mount.lustre.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.407058:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1787827140.407085:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143837824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787827140.407130:0:26665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].51, 224 off16952 00000040:00080000:1.0:1787827140.407138:0:26665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787827140.409947:0:26676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787827140.409964:0:26676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d5460440000) 00000020:00000080:1.0:1787827140.409992:0:26676:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787827140.410079:0:26676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5445588000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827140.410083:0:26676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5445588000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827140.410086:0:26676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5445588000 3 00010000:00080000:1.0:1787827140.410120:0:26676:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5343808800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:1.0:1787827140.411902:0:26676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:1.0:1787827140.412093:0:26676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787827140.412144:0:26676:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787827140.412158:0:26676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0fefc09a795462b 00000100:00080000:1.0:1787827140.412167:0:26676:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827140.412173:0:26676:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d5343808800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827140.412205:0:26676:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5344bd6580 x1874672143837952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827140.412251:0:26676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787827140.412361:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787827140.412365:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787827140.412367:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787827140.412373:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:1.0:1787827140.412377:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787827140.412381:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827140.412404:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d5344bd43c0 x1874672143838592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827140.412437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787827140.412440:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787827140.412442:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787827140.412446:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:1.0:1787827140.412449:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787827140.412453:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827140.412468:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547fbecf00 x1874672143839104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787827140.412504:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.412571:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.412603:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143838848:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.412635:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.412659:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787827140.412666:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143838336:0@lo:400:kworker.0 00000100:00100000:3.0:1787827140.412674:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143837952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787827140.412713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.412742:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143838976:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.412773:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.412797:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.412816:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838208 00000100:00100000:1.0:1787827140.412823:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838208 00000100:00100000:3.0:1787827140.412831:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143838592:0@lo:8:kworker.0 00000100:00100000:1.0:1787827140.412868:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787827140.412868:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.412881:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143838208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827140.412891:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143839104:0@lo:8:kworker.0 00000100:00100000:3.0:1787827140.412922:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.412949:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143838208:12345-0@lo:400:kworker.0 Request processed in 70us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.412960:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838592 00000100:00100000:3.0:1787827140.412966:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838592 00000100:00100000:1.0:1787827140.412970:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787827140.412990:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787827140.412994:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838848 00000100:00100000:1.0:1787827140.412998:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838848 00000100:00100000:3.0:1787827140.412999:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143838592:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787827140.413034:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838336 00000100:00100000:1.0:1787827140.413038:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838336 00000100:00100000:3.0:1787827140.413049:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143838592:12345-0@lo:8:kworker.0 Request processed in 51us (183us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787827140.413056:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787827140.413063:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838976 00000100:00100000:1.0:1787827140.413067:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838976 00000100:00100000:3.0:1787827140.413071:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143839104 00000100:00100000:3.0:1787827140.413075:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143839104 00000100:00100000:1.0:1787827140.413086:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143837952 00000100:00100000:1.0:1787827140.413089:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143837952 00000100:00100000:3.0:1787827140.413097:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787827140.413103:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143839104:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787827140.413107:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1787827140.413113:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143838848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827140.413142:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143839104:12345-0@lo:8:kworker.0 Request processed in 37us (219us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787827140.413154:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143838848:12345-0@lo:400:kworker.0 Request processed in 38us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.413159:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787827140.413167:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1787827140.413187:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1787827140.413201:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787827140.413207:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1874672143837952:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787827140.413259:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:1.0:1787827140.413314:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0fefc09a7954632 00000004:00100000:1.0:1787827140.413329:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787827140.413360:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8d546eeb3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787827140.413397:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1874672143837952:12345-0@lo:38:llog_process_th.0 Request processed in 188us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.413404:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787827140.413420:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1787827140.413428:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143838976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413462:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143838976:12345-0@lo:400:kworker.0 Request processed in 35us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.413477:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00080000:1.0:1787827140.413499:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827140.413503:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787827140.413549:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547d368b40 x1874672143838976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827140.413563:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143838976:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413578:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413591:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143838848:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413625:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143838080:0@lo:400:kworker.0 00000100:00100000:2.0:1787827140.413648:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.413676:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143838720:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413712:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827140.413712:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.413735:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143838336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827140.413749:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143839232:0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413751:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838080 00000100:00100000:1.0:1787827140.413756:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838080 00000100:00100000:1.0:1787827140.413788:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1787827140.413792:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143838336:12345-0@lo:400:kworker.0 Request processed in 595us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.413793:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.413801:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143838080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827140.413807:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1787827140.413846:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143838080:12345-0@lo:400:kworker.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.413853:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1787827140.413855:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787827140.413864:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00100000:2.0:1787827140.413866:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838720 00000100:00080000:3.0:1787827140.413871:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:2.0:1787827140.413872:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838720 00000100:00080000:3.0:1787827140.413879:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787827140.413883:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5343808800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787827140.413888:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143838080:0@lo:400:kworker.0 00000100:00100000:3.0:1787827140.413892:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1874672143837952:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787827140.413913:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787827140.413918:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787827140.413919:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143839232 00000100:00100000:2.0:1787827140.413924:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143839232 00000100:00100000:3.0:1787827140.413924:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143838592:0@lo:8:kworker.0 00000100:00100000:1.0:1787827140.413939:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143838464 00000100:00080000:3.0:1787827140.413944:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787827140.413945:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143838464 00000100:00080000:3.0:1787827140.413951:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787827140.413956:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143839104:0@lo:8:kworker.0 00000100:00100000:2.0:1787827140.413961:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787827140.413973:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143838720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827140.413982:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787827140.413992:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143838464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827140.413998:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787827140.414011:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143839232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827140.414018:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143838720:12345-0@lo:400:kworker.0 Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.414026:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787827140.414053:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143838464:12345-0@lo:400:kworker.0 Request processed in 62us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.414061:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143839232:12345-0@lo:400:kworker.0 Request processed in 53us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.414063:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:2.0:1787827140.414065:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827140.414075:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00080000:2.0:1787827140.414091:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d5344bd6d00 x1874672143838720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827140.414103:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143838720:0@lo:400:kworker.0 00000100:00100000:3.0:1787827140.414109:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143838336:0@lo:400:kworker.0 00000100:00100000:2.0:1787827140.414149:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143838464:0@lo:400:kworker.0 00010000:00080000:2.0:1787827140.414165:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fbefc00 x1874672143839232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827140.414174:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143839232:0@lo:400:kworker.0 00000020:01000004:3.0:1787827140.414211:0:26676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787827140.414235:0:26676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d53437f3370) 00000020:00000080:3.0:1787827140.414253:0:26676:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1787827140.414346:0:26676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d5445588000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787827140.414351:0:26676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d5445588000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787827140.414353:0:26676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d5445588000 3 00010000:00080000:3.0:1787827140.414387:0:26676:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5344bde000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1787827140.416277:0:26676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:3.0:1787827140.416461:0:26676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787827140.416501:0:26676:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787827140.416514:0:26676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc0fefc09a7954640 00000100:00080000:3.0:1787827140.416523:0:26676:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787827140.416529:0:26676:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d5344bde000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1787827140.416556:0:26676:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547fbefc00 x1874672143839360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787827140.416578:0:26676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787827140.416620:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143839360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787827140.416679:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827140.416739:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143839360 00000100:00100000:0.0:1787827140.416745:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143839360 00000100:00100000:0.0:1787827140.416780:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787827140.416788:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3615:x1874672143839360:12345-0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787827140.416792:0:26676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x34:0x0] index 52 count 51 00010000:00080000:0.0:1787827140.416808:0:22268:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1787827140.416882:0:22268:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc0fefc09a7954647 00000004:00100000:0.0:1787827140.416898:0:22268:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787827140.416947:0:22268:0:(import.c:65:import_set_state_nolock()) ffff8d53494c5000 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1787827140.416962:0:26665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787827140.417004:0:26665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1787827140.417006:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1874672143839360:12345-0@lo:38:llog_process_th.0 Request processed in 218us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827140.417014:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00010000:3.0:1787827140.417017:0:26665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7954616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795461d expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.417027:0:26665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7a1c00/0xc0fefc09a7954616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a795461d expref: -99 pid: 26665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787827140.417062:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fbefc00 x1874672143839360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827140.417071:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787827140.417077:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000020:01000004:3.0:1787827140.417080:0:26665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787827140.417082:0:26665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000100:00080000:0.0:1787827140.417083:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:01000004:3.0:1787827140.417083:0:26665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827140.417085:0:26665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00080000:0.0:1787827140.417086:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787827140.417089:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5344bde000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000020:01000004:3.0:1787827140.417091:0:26665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827140.417093:0:26665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1787827140.417094:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1874672143839360:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1787827140.417094:0:26665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787827140.417096:0:26665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827140.417098:0:26665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787827140.417101:0:26665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787827140.417103:0:26665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787827140.417104:0:26665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787827140.417105:0:26665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827140.417106:0:26665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787827140.417108:0:26665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827140.417109:0:26665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787827140.417110:0:26665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787827140.417111:0:26665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827140.417113:0:26665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787827140.417127:0:26665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787827140.417139:0:26665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbecf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143839488:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787827140.417181:0:26665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.417205:0:26665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0bad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787827140.417245:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143839488 00000100:00100000:0.0:1787827140.417250:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143839488 00000100:00100000:0.0:1787827140.417287:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1787827140.417306:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143839488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787827140.417346:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787827140.417355:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787827140.418488:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787827140.418502:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787827140.418522:0:6501:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787827140.418527:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787827140.418546:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.418561:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.418583:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.418595:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.418603:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.418634:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.418649:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 9 pid: 6479 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.418661:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143839616:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787827140.418749:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.418770:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 24 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.418780:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143839744:0@lo:104: 00000100:00100000:1.0:1787827140.418815:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827140.418855:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 24 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827140.418855:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143839744 00000100:00100000:3.0:1787827140.418862:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143839744 00010000:00010000:1.0:1787827140.418868:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 24 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.418879:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d3552c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143839872:0@lo:104: 00000100:00100000:3.0:1787827140.418903:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787827140.418914:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143839744:12345-0@lo:104: 00000100:00100000:1.0:1787827140.418923:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827140.418938:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.418947:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5458778900 going to sleep for 11 seconds 00000100:00100000:2.0:1787827140.418948:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143839872 00000100:00100000:2.0:1787827140.418955:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143839872 00000100:00100000:2.0:1787827140.418991:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1787827140.418999:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787827140.419003:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143839872:12345-0@lo:104: 00000100:00100000:3.0:1787827140.419009:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+4:6501:x1874672143839744:12345-0@lo:104: Request processed in 94us (192us total) trans 0 rc 0/0 00010000:00010000:2.0:1787827140.419015:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827140.419019:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787827140.419059:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787827140.419068:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787827140.419075:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+3:6501:x1874672143839872:12345-0@lo:104: Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.419081:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1787827140.419138:0:10301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787827140.419145:0:10301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.419153:0:10301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2800 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:2.0:1787827140.419157:0:10301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.419167:0:10301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827140.419175:0:10301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.419188:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143839744:0@lo:104: 10000000:01000000:2.0:1787827140.419190:0:10301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1787827140.419204:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d3552c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143839872:0@lo:104: 00010000:00010000:3.0:1787827140.419245:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.419259:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078800 already unused, calling callback (ffffffffc13fec20) 10000000:00010000:3.0:1787827140.419263:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.419265:0:10301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.419275:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.419277:0:10301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1787827140.419286:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827140.419307:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827140.419312:0:10301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.419321:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143840000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787827140.419325:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2800/0xc0fefc09a79544e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79544e9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.419325:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.419345:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827140.419352:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827140.419356:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827140.419357:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827140.419360:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827140.419367:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.419376:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff8d546e078800/0xc0fefc09a79544f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0fefc09a79544f7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827140.419397:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827140.419399:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827140.419402:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827140.419415:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143840128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787827140.419444:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827140.419485:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:26665:x1874672143839488:12345-0@lo:253:mount.lustre.0 Request processed in 2181us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.419487:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840000 00000100:00100000:3.0:1787827140.419493:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840000 00000100:00100000:2.0:1787827140.419499:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1787827140.419502:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840128 00000100:00100000:1.0:1787827140.419507:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840128 00010000:00010000:3.0:1787827140.419512:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 24 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.419528:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 25 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827140.419555:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787827140.419563:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787827140.419567:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d356580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3619:x1874672143840000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787827140.419576:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+25:3616:x1874672143840128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787827140.419579:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827140.419587:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 25 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.419597:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827140.419598:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 25 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.419606:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 25 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827140.419616:0:26665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbecf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:26665:1874672143839488:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1787827140.419616:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345113400/0xc0fefc09a79544e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79544e2 expref: 25 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.419621:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 25 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827140.419628:0:26665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787827140.419632:0:26665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787827140.419634:0:26665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00010000:00010000:3.0:1787827140.419634:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000004:0.0:1787827140.419636:0:26665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827140.419637:0:26665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827140.419639:0:26665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827140.419641:0:26665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:2.0:1787827140.419641:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345112e00/0xc0fefc09a79544f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0fefc09a79544f0 expref: 24 pid: 9479 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787827140.419642:0:26665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827140.419645:0:26665:0:(tgt_mount.c:1204:server_mti_print()) LDD_F_IR_CAPABLE 00000020:01000004:0.0:1787827140.419653:0:26665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827140.419654:0:26665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787827140.419665:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d356580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:3619:x1874672143840000:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (310us total) trans 0 rc 0/0 00010000:00010000:2.0:1787827140.419669:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:02000000:0.0:1787827140.419670:0:26665:0:(tgt_mount.c:2687:server_calc_timeout()) lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 00000100:00100000:3.0:1787827140.419674:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787827140.419683:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143840000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787827140.419718:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:3616:x1874672143840128:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827140.419725:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787827140.419757:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143840128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787827140.421139:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6501:1874672143839616:192.168.203.6@tcp:104: 00010000:00010000:1.0:1787827140.421163:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827140.421275:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827140.421313:0:13703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134309760 00000100:00100000:1.0:1787827140.421319:0:13703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134309760 00010000:00010000:1.0:1787827140.421342:0:13703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 10 pid: 6479 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.421369:0:13703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 77 00000100:00100000:1.0:1787827140.421380:0:13703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134309760:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787827140.421390:0:13703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827140.421397:0:13703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 10 pid: 6479 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421409:0:13703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 10 pid: 6479 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421422:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d547f7a0200/0xc0fefc09a79544fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467609 expref: 10 pid: 6479 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421434:0:13703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421442:0:13703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787827140.421455:0:13703:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006998888s 00010000:00010000:1.0:1787827140.421459:0:13703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421466:0:13703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421483:0:13703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421491:0:13703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421497:0:13703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112c00 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:1.0:1787827140.421507:0:13703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421515:0:13703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421532:0:13703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827140.421542:0:13703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787827140.421554:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.421565:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827140.421572:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d5345112c00/0xc0fefc09a795464e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827140.421589:0:13703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53477dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:291f6693-430f-40e2-b9af-10afb9cb8617+9:2391:x1874672134309760:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 210us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827140.421598:0:13703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 77 00010000:00080000:3.0:1787827140.425531:0:26665:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 34359738370 00010000:00080000:3.0:1787827140.426023:0:26682:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 26682 00010000:00080000:3.0:1787827140.426104:0:26682:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1787827140.426108:0:26682:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:0.0:1787827140.426169:0:26665:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787827140.426198:0:26665:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787827140.426283:0:26665:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787827140.426320:0:26665:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787827140.427021:0:26665:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827140.427411:0:26665:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787827140.689433:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143840256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827140.689433:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787827140.689451:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143840384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827140.689508:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.689565:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827140.689568:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827140.689589:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840256 00000100:00100000:2.0:1787827140.689592:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143840512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827140.689594:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840384 00000100:00100000:0.0:1787827140.689598:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840256 00000100:00100000:1.0:1787827140.689600:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840384 00000100:00100000:2.0:1787827140.689638:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827140.689663:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787827140.689674:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787827140.689677:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143840384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827140.689687:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143840256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787827140.689712:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787827140.689713:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827140.689736:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840512 00000100:00100000:3.0:1787827140.689742:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840512 00000100:00100000:0.0:1787827140.689777:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143840256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.689781:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787827140.689787:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143840384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827140.689793:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787827140.689798:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143840512:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827140.689813:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000004:00000024:3.0:1787827140.689853:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827140.689909:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143840512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.689916:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00080000:3.0:1787827140.689954:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547f74d2c0 x1874672143840384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827140.689964:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53477de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143840512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827140.689974:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143840384:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787827140.690397:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d547fbbfc00 x1874672143840256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827140.690413:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143840256:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1787827140.776452:0:26731:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827140.776665:0:26731:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787827140.817563:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827141.713379:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143840640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827141.713481:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827141.713550:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840640 00000100:00100000:0.0:1787827141.713561:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840640 00000100:00100000:0.0:1787827141.713627:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787827141.713639:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143840640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827141.713674:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827141.713773:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143840640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827141.713780:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787827141.713929:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143840640:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827141.842713:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827142.033340:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827142.033377:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827142.033405:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827142.033420:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134309888 00000100:00100000:3.0:1787827142.033426:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827142.033429:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134309888 00000100:00100000:3.0:1787827142.033448:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827142.033471:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 621 00000100:00100000:3.0:1787827142.033475:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310144 00000100:00100000:3.0:1787827142.033478:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310144 00000100:00100000:1.0:1787827142.033482:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134309888:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827142.033494:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310272 00000100:00100000:0.0:1787827142.033508:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310272 00000100:00100000:3.0:1787827142.033519:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310016 00000100:00100000:3.0:1787827142.033524:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310016 00000100:00100000:0.0:1787827142.033542:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310400 00000100:00100000:0.0:1787827142.033547:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310400 00000100:00100000:1.0:1787827142.033558:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+9:2390:x1874672134309888:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827142.033562:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 610 00000100:00100000:1.0:1787827142.033568:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 621 00000100:00100000:3.0:1787827142.033571:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134310144:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827142.033587:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 238 00000100:00100000:0.0:1787827142.033595:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2389:x1874672134310272:12345-192.168.203.6@tcp:8:kworker.0 00000100:00100000:1.0:1787827142.033602:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 611 00000100:00100000:3.0:1787827142.033602:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134310144:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827142.033609:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 610 00000100:00100000:1.0:1787827142.033610:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134310016:12345-192.168.203.6@tcp:400:kworker.0 00010000:00080000:0.0:1787827142.033622:0:19009:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '2313f4ee-480a-47b2-8d93-5bb216a57733' at ffff8d5448301000, cookie 0xc0fefc09a7954601 00000100:00100000:3.0:1787827142.033629:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 239 00010000:00080000:0.0:1787827142.033632:0:19009:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp recovering/t34359738369 exp ffff8d5448301000 cur 516 last 1787827140 00000100:00100000:1.0:1787827142.033640:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134310016:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 28us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827142.033640:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134310400:12345-192.168.203.6@tcp:9:kworker.0 00010000:02000400:0.0:1787827142.033643:0:19009:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:1.0:1787827142.033650:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 611 00000020:00000080:3.0:1787827142.033657:0:19008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954505 00000100:00080000:3.0:1787827142.033668:0:19008:0:(import.c:65:import_set_state_nolock()) ffff8d5478926000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787827142.033715:0:19008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:1.0:1787827142.033825:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787827142.033830:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827142.033833:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827142.033838:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+2:2389:x1874672134310400:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 201us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827142.033846:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 239 00010000:00010000:1.0:1787827142.033854:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787827142.037249:0:19009:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:0.0:1787827142.037265:0:19009:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d5448301000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787827142.037277:0:19009:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787827142.037435:0:19009:0:(import.c:65:import_set_state_nolock()) ffff8d53494c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787827142.037501:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134310272:12345-192.168.203.6@tcp:8:kworker.0 Request processed in 3904us (4166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827142.037510:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 238 00000100:00100000:2.0:1787827142.042672:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827142.042734:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310528 00000100:00100000:0.0:1787827142.042743:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310528 00000100:00100000:0.0:1787827142.042801:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 240 00000100:00100000:0.0:1787827142.042813:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134310528:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787827142.042831:0:8401:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8d547f9c12c0 x1874672134310528/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:743/0 lens 328/0 e 0 to 0 dl 1787827153 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827142.042853:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134310528:12345-192.168.203.6@tcp:101:ldlm_lock_repla.0 Request processed in 43us (199us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787827142.042861:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 240 00010000:00080000:2.0:1787827142.042864:0:26682:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1787827142.161186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827142.161259:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310656 00000100:00100000:0.0:1787827142.161273:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310656 00000100:00100000:0.0:1787827142.161350:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 622 00000100:00100000:0.0:1787827142.161361:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+9:10866:x1874672134310656:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827142.161376:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827142.161394:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7a0c00/0xc0fefc09a7954655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346763a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827142.161421:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7a0c00/0xc0fefc09a7954655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346763a expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827142.161433:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7a0c00/0xc0fefc09a7954655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346763a expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827142.161443:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0c00, rc 0) 00000100:00100000:0.0:1787827142.161505:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5450e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134310656:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 139us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827142.161514:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 622 00000100:00100000:1.0:1787827142.162855:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827142.162897:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310784 00000100:00100000:2.0:1787827142.162905:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310784 00000100:00100000:2.0:1787827142.162951:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 623 00000100:00100000:2.0:1787827142.162960:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134310784:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787827142.162976:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787827142.162989:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787827142.162991:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787827142.164460:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:10866:x1874672134310784:12345-192.168.203.6@tcp:256:ll_cfg_requeue.0 Request processed in 1497us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.164472:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 623 10000000:01000000:2.0:1787827142.353303:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787827142.353310:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d54789ce800 from 14 10000000:01000000:2.0:1787827142.353317:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787827142.353358:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3a00/0xc0fefc09a795465c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.353370:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3a00/0xc0fefc09a795465c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.353381:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3a00/0xc0fefc09a795465c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827142.353406:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143840768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787827142.353468:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827142.353590:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840768 00000100:00100000:1.0:1787827142.353598:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840768 00000100:00100000:2.0:1787827142.353601:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827142.353643:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1787827142.353653:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+22:6482:x1874672143840768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787827142.353674:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827142.353686:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d5345112400/0xc0fefc09a7954663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795465c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827142.353708:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d5345112400/0xc0fefc09a7954663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795465c expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827142.353719:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d5345112400/0xc0fefc09a7954663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795465c expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827142.353726:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345112400, rc 0) 00000100:00100000:1.0:1787827142.353772:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143840768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.353779:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1787827142.353812:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143840768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827142.353839:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3a00/0xc0fefc09a795465c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954663 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.353849:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3a00/0xc0fefc09a795465c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954663 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827142.353902:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143840896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787827142.353926:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827142.353944:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827142.353972:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143840896 00000100:00100000:1.0:1787827142.353977:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143840896 00000100:00100000:1.0:1787827142.354006:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1787827142.354015:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143840896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787827142.354028:0:9479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787827142.354044:0:9479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787827142.354047:0:9479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787827142.354130:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143840896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.354137:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1787827142.354143:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143840896:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1787827142.354180:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d5342a60000 already not connected (conn 39, was 0): DISCONN 00010000:00080000:2.0:1787827142.354191:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d5342a60000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:2.0:1787827142.354195:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787827142.354201:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d5342a60000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1787827142.354242:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f9c30c0 x1874672143841024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787827142.354298:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143841024:0@lo:8:ll_cfg_requeue.0 10000000:01000000:2.0:1787827142.354300:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787827142.354309:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3a00/0xc0fefc09a795465c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954663 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.354319:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d3a00/0xc0fefc09a795465c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954663 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827142.354329:0:6482:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787827142.354331:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d5448400800 from 14 10000000:01000000:2.0:1787827142.354334:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1787827142.354347:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827142.354352:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2600/0xc0fefc09a795466a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.354361:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2600/0xc0fefc09a795466a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.354380:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2600/0xc0fefc09a795466a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827142.354386:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841024 00000100:00100000:1.0:1787827142.354390:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841024 00000100:00100000:2.0:1787827142.354395:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143841152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787827142.354433:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787827142.354435:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827142.354442:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3615:x1874672143841024:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1787827142.354462:0:10061:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8d5478923000, cookie 0xc0fefc09a79545f3 00000100:00100000:2.0:1787827142.354463:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d546e0ba600 going to sleep for 11 seconds 00010000:00080000:1.0:1787827142.354470:0:10061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5478923000 cur 517 last 1787827140 00000100:00100000:2.0:1787827142.354480:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841152 00000100:00100000:2.0:1787827142.354484:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841152 00002000:00100000:1.0:1787827142.354500:0:10061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d5478923000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787827142.354506:0:10061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787827142.354508:0:10061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787827142.354518:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1787827142.354527:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+23:6482:x1874672143841152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827142.354535:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827142.354544:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d547f7d3e00/0xc0fefc09a7954671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0fefc09a795466a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.354561:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d547f7d3e00/0xc0fefc09a7954671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0fefc09a795466a expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.354571:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d547f7d3e00/0xc0fefc09a7954671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0fefc09a795466a expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827142.354579:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3e00, rc 0) 00000100:00100000:2.0:1787827142.354618:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143841152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827142.354634:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143841152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787827142.354639:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00010000:00010000:0.0:1787827142.354650:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2600/0xc0fefc09a795466a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954671 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787827142.354651:0:10061:0:(import.c:65:import_set_state_nolock()) ffff8d54604ea800 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1787827142.354663:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2600/0xc0fefc09a795466a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0fefc09a7954671 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827142.354700:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143841024:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 257us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.354708:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787827142.354712:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143841280:0@lo:256:ll_cfg_requeue.0 00010000:00080000:1.0:1787827142.354744:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9c30c0 x1874672143841024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827142.354754:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787827142.354763:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:1.0:1787827142.354773:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00100000:0.0:1787827142.354774:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54765bd6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787827142.354779:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1787827142.354782:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:1.0:1787827142.354786:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d5342a60000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00100000:0.0:1787827142.354790:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841280 00000100:00080000:1.0:1787827142.354790:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787827142.354802:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841280 00000100:00100000:0.0:1787827142.354833:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1787827142.354841:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143841280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787827142.354853:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787827142.354865:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787827142.354868:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787827142.354915:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143841024:0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1787827142.354941:0:26965:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1787827142.354945:0:26965:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:1.0:1787827142.354950:0:26965:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1787827142.354954:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:6482:x1874672143841280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827142.354963:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00080000:1.0:1787827142.354991:0:26965:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787827142.355003:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:6482:1874672143841280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787827142.355028:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143841408:0@lo:400:ldlm_lock_repla.0 00000100:00080000:0.0:1787827142.355032:0:6482:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8d534380d800 already not connected (conn 39, was 0): DISCONN 00010000:00080000:0.0:1787827142.355041:0:6482:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8d534380d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.106@tcp, moved to head 00000100:00080000:0.0:1787827142.355044:0:6482:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787827142.355050:0:6482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d534380d800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1787827142.355060:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827142.355067:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d547f74f840 x1874672143841536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787827142.355094:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841408 10000000:01000000:0.0:1787827142.355098:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:1.0:1787827142.355100:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143841536:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1787827142.355101:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841408 00010000:00010000:0.0:1787827142.355107:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2600/0xc0fefc09a795466a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954671 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827142.355116:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff8d547f7d2600/0xc0fefc09a795466a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0fefc09a7954671 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827142.355133:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827142.355139:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787827142.355148:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143841408:12345-0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787827142.355160:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841536 00000100:00100000:0.0:1787827142.355165:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841536 00010000:00080000:2.0:1787827142.355166:0:9498:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d5344bd4b40 x1874672143841408/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:743/0 lens 224/0 e 0 to 0 dl 1787827153 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827142.355184:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672143841408:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (124us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787827142.355190:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787827142.355196:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787827142.355203:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3615:x1874672143841536:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787827142.355241:0:26682:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787827142.355396:0:19009:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8d5448305800, cookie 0xc0fefc09a79545fa 00010000:00080000:0.0:1787827142.355402:0:19009:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8d5448305800 cur 517 last 1787827140 00002000:00100000:0.0:1787827142.355412:0:19009:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d5448305800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113944 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787827142.355416:0:19009:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787827142.355418:0:19009:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1787827142.355436:0:19009:0:(import.c:65:import_set_state_nolock()) ffff8d53494c0000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787827142.355480:0:26682:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1787827142.355487:0:26682:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 34359738371 00000100:00100000:0.0:1787827142.355492:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143841536:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 286us (358us total) trans 0 rc 0/0 00010000:00080000:1.0:1787827142.355493:0:26682:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 34359738371 00010000:00080000:1.0:1787827142.355502:0:26682:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 34359738371 00000100:00100000:0.0:1787827142.355505:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:1.0:1787827142.355542:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74f840 x1874672143841536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827142.355557:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:1.0:1787827142.355564:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787827142.355567:0:3615:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1787827142.355569:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771560 gen 2 00000100:00080000:1.0:1787827142.355573:0:3615:0:(recover.c:53:ptlrpc_replay_next()) import ffff8d534380d800 from lustre-OST0000_UUID committed 30064771560 last 0 00000100:00080000:1.0:1787827142.355576:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787827142.355678:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143841536:0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1787827142.355689:0:26966:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1787827142.355693:0:26966:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:1.0:1787827142.355697:0:26966:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:1.0:1787827142.355730:0:26966:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787827142.355765:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143841664:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787827142.355793:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827142.355824:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841664 00000100:00100000:1.0:1787827142.355828:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841664 00000100:00100000:0.0:1787827142.355867:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787827142.355876:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143841664:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787827142.355886:0:10061:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f74f840 x1874672143841664/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:743/0 lens 224/0 e 0 to 0 dl 1787827153 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827142.355901:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672143841664:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 28us (108us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787827142.355907:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00080000:0.0:1787827142.355921:0:26682:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 34359738371 00010000:00080000:0.0:1787827142.355925:0:26682:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1787827142.355931:0:26682:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787827142.355933:0:26682:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787827142.355939:0:26682:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.6@tcp: req@ffff8d547f9c12c0 x1874672134310528/t0(0) o101->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:743/0 lens 328/0 e 0 to 0 dl 1787827153 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787827142.355963:0:26682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827142.355980:0:26682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346761e expref: -99 pid: 26682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827142.355998:0:26682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 26682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827142.356015:0:26682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 26682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827142.356023:0:26682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7a0400, rc 0) 00010000:00080000:0.0:1787827142.356113:0:26682:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787827142.356122:0:26682:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1787827142.357257:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827142.357298:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134310912 00000100:00100000:1.0:1787827142.357304:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134310912 00000100:00100000:1.0:1787827142.357339:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 320 00000100:00100000:1.0:1787827142.357348:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134310912:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1787827142.357367:0:8399:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8d547f9c0000 x1874672134310912/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:743/0 lens 224/0 e 0 to 0 dl 1787827153 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827142.357386:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134310912:12345-192.168.203.6@tcp:400:ptlrpcd_rcv.0 Request processed in 40us (135us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787827142.357394:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 320 00010000:00080000:2.0:1787827142.357400:0:26682:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1787827142.357547:0:26682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705664 00000001:00100000:2.0:1787827142.359516:0:26666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:2.0:1787827142.359523:0:26666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787827142.359527:0:26666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:1.0:1787827142.360211:0:26682:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1787827142.360247:0:26682:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d5344bd4b40 x1874672143841408/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:743/0 lens 224/0 e 0 to 0 dl 1787827153 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787827142.360358:0:26682:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8d547f74f840 x1874672143841664/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:743/0 lens 224/0 e 0 to 0 dl 1787827153 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787827142.360378:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787827142.360388:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d547d357840 x1874672143841408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787827142.360399:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d547d357840 x1874672143841408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787827142.360406:0:26682:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.6@tcp: req@ffff8d547f9c0000 x1874672134310912/t0(0) o400->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:743/0 lens 224/0 e 0 to 0 dl 1787827153 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787827142.360430:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d5342a60000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:0.0:1787827142.360443:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1787827142.360447:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00010000:02000000:1.0:1787827142.360561:0:26682:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:1.0:1787827142.367325:0:9485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143841920:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787827142.367388:0:9485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827142.367413:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841920 00000100:00100000:1.0:1787827142.367414:0:9485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d5447088f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787827142.367422:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841920 00000100:00100000:2.0:1787827142.367470:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787827142.367479:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143841920:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787827142.367532:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827142.367544:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143841792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827142.367574:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827142.367671:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143841792 00000100:00100000:2.0:1787827142.367675:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143841792 00000100:00100000:2.0:1787827142.367700:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787827142.367707:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143841792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787827142.367723:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8388608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:2.0:1787827142.367771:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143841792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827142.367777:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787827142.367817:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143841792:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1787827142.368237:0:26682:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787827142.368242:0:26682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00080000:0.0:1787827142.369766:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009f8725f1): req@ffff8d547d36bc00 x1874672143831424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787827142 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827142.369789:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1874672143841408:0@lo:400:ldlm_lock_repla.0 00000100:00080000:0.0:1787827142.369840:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787827142.369853:0:3615:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8d5344bd70c0 x1874672143841664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827142.369863:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787827142.369864:0:3615:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8d5344bd70c0 x1874672143841664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787827142.369875:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8d534380d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:0.0:1787827142.369897:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1787827142.369902:0:3615:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787827142.369908:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1874672143841664:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787827142.369917:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831424 00000100:00100000:1.0:1787827142.369923:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827142.369925:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831424 00000100:00100000:1.0:1787827142.369972:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143831552 00000100:00100000:1.0:1787827142.369977:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143831552 00000100:00100000:3.0:1787827142.369978:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000004:00080000:0.0:1787827142.369979:0:9503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 517232763457ns, next at 518232761134ns, rc = 0 00000100:00100000:3.0:1787827142.369993:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143831424:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827142.370006:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143842176:0@lo:7:osp-pre-0-0.0 00002000:00000024:3.0:1787827142.370012:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:1.0:1787827142.370017:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787827142.370032:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143831552:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827142.370038:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787827142.370047:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:0.0:1787827142.370063:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d54765bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827142.370069:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143831424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827142.370079:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787827142.370086:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143831552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.370095:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787827142.370105:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787827142.370119:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143842304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787827142.370120:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143842176 00000100:00100000:0.0:1787827142.370126:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143842176 00000100:00100000:1.0:1787827142.370143:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143831424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827142.370161:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827142.370167:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787827142.370167:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143831552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827142.370182:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:9503:x1874672143842176:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1787827142.370194:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143842048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827142.370247:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827142.370257:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143842304 00000100:00100000:0.0:1787827142.370261:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143842304 00000100:00100000:0.0:1787827142.370299:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787827142.370305:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143842048 00000100:00100000:0.0:1787827142.370306:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143842304:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787827142.370311:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143842048 00002000:00080000:0.0:1787827142.370322:0:10061:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:19 count 1 00000100:00100000:3.0:1787827142.370352:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787827142.370363:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874672143842048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827142.370375:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3918270464 avail 3686748160 00000100:00100000:3.0:1787827142.370417:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1874672143842048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827142.370425:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787827142.370467:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143842048:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787827142.370943:0:19008:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787827142.370953:0:19008:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787827142.371001:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:9485:x1874672143841920:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3523us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827142.371010:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787827142.371296:0:9485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5344bd43c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9485:1874672143841920:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787827142.371314:0:9485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00002000:00080000:0.0:1787827142.372673:0:19009:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787827142.372678:0:19009:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x41:0x0] 00000100:00100000:0.0:1787827142.372738:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:9503:x1874672143842176:12345-0@lo:7:osp-pre-0-0.0 Request processed in 2559us (2701us total) trans 0 rc 0/0 00002000:00010000:3.0:1787827142.372740:0:10061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 5242880, mtime: 0x6a9013af, atime: 0x0, ctime: 0x6a9013af, blocks: 0x2800 00010000:00010000:3.0:1787827142.372752:0:10061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827142.372765:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00010000:3.0:1787827142.372784:0:10061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 5 pid: 26682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.372795:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x13:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1787827142.372800:0:10061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787827142.372804:0:10061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827142.372807:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9503:1874672143842176:0@lo:7:osp-pre-0-0.0 00000004:00080000:0.0:1787827142.372821:0:9503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x41:0x0] 00010000:00010000:3.0:1787827142.372836:0:10061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 5 pid: 26682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.372848:0:10061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 5 pid: 26682 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827142.372860:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10061:1874672143842432:192.168.203.6@tcp:104: 00000100:00100000:3.0:1787827142.372929:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d547572b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787827142.374895:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10061:1874672143842432:192.168.203.6@tcp:104: 00010000:00010000:3.0:1787827142.374915:0:10061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827142.375027:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827142.375131:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311040 00000100:00100000:3.0:1787827142.375135:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311040 00010000:00010000:3.0:1787827142.375157:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 26682 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827142.375190:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 78 00000100:00100000:3.0:1787827142.375199:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134311040:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787827142.375229:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827142.375235:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 26682 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375248:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 26682 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375272:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e6025d/0xc0fefc09a7954678 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346761e expref: 6 pid: 26682 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375296:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787827142.375300:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787827142.375305:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375315:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375359:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787827142.375393:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134311040:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827142.375401:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 78 00010000:00010000:1.0:1787827142.375504:0:10061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827142.375514:0:10061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827142.375525:0:10061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827142.375531:0:10061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827142.375546:0:10061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787827142.375702:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143842304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5396us (5543us total) trans 38654705665 rc 0/0 00000100:00100000:1.0:1787827142.375709:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00010000:3.0:1787827142.375787:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827142.375793:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375802:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d546e078800 already unused, calling callback (ffffffffc0e0f420) 00010000:00010000:3.0:1787827142.375806:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375815:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375827:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375835:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fce4008e/0xc0fefc09a795467f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827142.375858:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827142.375860:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827142.375861:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787827142.376249:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d547f74e580/2, rc 0, transno 38654705665 00000100:00100000:0.0:1787827142.376257:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143842304:0@lo:6:osp-syn-0-0.0 00000001:02000400:2.0:1787827142.600665:0:27022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787827142.865476:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787827142.964103:0:27074:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787827142.964303:0:27074:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787827143.308181:0:27124:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827143.308689:0:27124:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787827143.890810:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827144.627302:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827144.627375:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311168 00000100:00100000:0.0:1787827144.627384:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311168 00000100:00100000:0.0:1787827144.627465:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 183 00000100:00100000:0.0:1787827144.627477:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23201:x1874672134311168:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787827144.627510:0:22268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827144.627579:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23201:x1874672134311168:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827144.627586:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 183 00000100:00080000:1.0:1787827144.627651:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827144.629354:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827144.629444:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311296 00000100:00100000:2.0:1787827144.629459:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311296 00000100:00080000:1.0:1787827144.629565:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827144.629611:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 184 00000100:00100000:2.0:1787827144.629629:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23201:x1874672134311296:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:2.0:1787827144.629659:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787827144.629720:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23201:x1874672134311296:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 100us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827144.629726:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 184 00000100:00100000:2.0:1787827144.631469:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827144.631524:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311424 00000100:00100000:1.0:1787827144.631532:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311424 00000100:00080000:2.0:1787827144.631584:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827144.631596:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 355 00000100:00100000:1.0:1787827144.631607:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23201:x1874672134311424:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787827144.631632:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827144.631694:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23201:x1874672134311424:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827144.631701:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 355 00000100:00100000:1.0:1787827144.632646:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827144.632696:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311552 00000100:00100000:2.0:1787827144.632701:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311552 00000100:00100000:2.0:1787827144.632734:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 246 00000100:00100000:2.0:1787827144.632740:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874672134311552:12345-192.168.203.6@tcp:8:lfs.0 00010000:00080000:2.0:1787827144.632766:0:8399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1787827144.632791:0:8399:0:(genops.c:1385:class_connect()) connect: client 2313f4ee-480a-47b2-8d93-5bb216a57733, cookie 0xc0fefc09a7954686 00002000:00100000:2.0:1787827144.632803:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2313f4ee-480a-47b2-8d93-5bb216a57733/ffff8d547f8e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113944 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787827144.632817:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787827144.632885:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787827144.632919:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8d547f8e4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827144.632963:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5344bd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2389:x1874672134311552:12345-192.168.203.6@tcp:8:lfs.0 Request processed in 221us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827144.632971:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 246 00000100:00100000:0.0:1787827144.634639:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827144.634715:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311680 00000100:00100000:3.0:1787827144.634723:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311680 00000100:00080000:2.0:1787827144.634777:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827144.634817:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 356 00000100:00100000:3.0:1787827144.634826:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:23201:x1874672134311680:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787827144.634843:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827144.634890:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+6:23201:x1874672134311680:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827144.634897:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 356 00010000:00010000:1.0:1787827144.913383:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827145.809377:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143842560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827145.809410:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143842688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827145.809463:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.809463:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.809552:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143842560 00000100:00100000:0.0:1787827145.809557:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143842688 00000100:00100000:2.0:1787827145.809560:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143842560 00000100:00100000:0.0:1787827145.809573:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143842688 00000100:00100000:2.0:1787827145.809609:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787827145.809621:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143842560:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827145.809634:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787827145.809648:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143842688:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:2.0:1787827145.809655:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00002000:00000024:0.0:1787827145.809665:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827145.809710:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143842560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.809719:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1787827145.809720:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827145.809765:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143842560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827145.809842:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143842688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.809849:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00080000:1.0:1787827145.809891:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74f0c0 x1874672143842688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.809906:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143842688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827145.810338:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143842944:0@lo:400:kworker.0 00000100:00100000:0.0:1787827145.810354:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143842816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827145.810379:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.810398:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.810426:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143843200:0@lo:400:kworker.0 00000100:00100000:0.0:1787827145.810433:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143843328:0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.810435:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143843456:0@lo:400:kworker.0 00000100:00100000:0.0:1787827145.810487:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.810492:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.810493:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.810511:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143843840:0@lo:400:kworker.0 00000100:00100000:0.0:1787827145.810538:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.810538:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143843712:0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.810540:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143843968:0@lo:400:kworker.0 00000100:00100000:0.0:1787827145.810571:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143842816 00000100:00100000:0.0:1787827145.810576:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143842816 00000100:00100000:1.0:1787827145.810589:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.810593:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.810631:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787827145.810633:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143844224:0@lo:400:kworker.0 00000100:00100000:0.0:1787827145.810647:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143842816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787827145.810664:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827145.810669:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143842944 00000100:00100000:2.0:1787827145.810674:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143842944 00000100:00100000:1.0:1787827145.810681:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.810711:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787827145.810714:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1787827145.810718:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143843072:0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.810734:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143842944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.810741:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.810769:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143843584:0@lo:400:kworker.0 00000100:00100000:0.0:1787827145.810789:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143842816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.810799:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787827145.810817:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.810817:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143842944:12345-0@lo:400:kworker.0 Request processed in 82us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.810829:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1787827145.810860:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143844096:0@lo:400:kworker.0 00010000:00080000:0.0:1787827145.810866:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74fc00 x1874672143842816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.810884:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143842816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827145.810889:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843328 00000100:00100000:1.0:1787827145.810898:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.810900:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843328 00000100:00100000:1.0:1787827145.810943:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843200 00000100:00100000:1.0:1787827145.810947:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843200 00000100:00100000:2.0:1787827145.810953:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787827145.810963:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143843328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827145.810981:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843456 00000100:00100000:1.0:1787827145.810982:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843840 00000100:00100000:1.0:1787827145.810986:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843840 00000100:00100000:3.0:1787827145.810992:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843456 00000100:00100000:1.0:1787827145.811013:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843712 00000100:00100000:1.0:1787827145.811016:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843712 00000100:00100000:2.0:1787827145.811018:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143843328:12345-0@lo:400:kworker.0 Request processed in 57us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.811029:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787827145.811046:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844224 00000100:00100000:1.0:1787827145.811050:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844224 00000100:00100000:3.0:1787827145.811054:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843968 00000100:00100000:3.0:1787827145.811059:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843968 00000100:00100000:2.0:1787827145.811067:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843584 00000100:00100000:2.0:1787827145.811074:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843584 00000100:00100000:1.0:1787827145.811079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143843072 00000100:00100000:1.0:1787827145.811084:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143843072 00000100:00100000:3.0:1787827145.811103:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787827145.811111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844096 00000100:00100000:3.0:1787827145.811119:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143843456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811120:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844096 00000100:00100000:2.0:1787827145.811131:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787827145.811142:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143843968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1787827145.811175:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143843200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827145.811242:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143843456:12345-0@lo:400:kworker.0 Request processed in 104us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.811251:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787827145.811300:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787827145.811310:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143843584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.811427:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143843968:12345-0@lo:400:kworker.0 Request processed in 285us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.811440:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787827145.811463:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143843584:12345-0@lo:400:kworker.0 Request processed in 153us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.811471:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143843200:12345-0@lo:400:kworker.0 Request processed in 286us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.811479:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787827145.811488:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:1.0:1787827145.811500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1787827145.811506:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143843840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:1.0:1787827145.811559:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143843712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.811565:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143843840:12345-0@lo:400:kworker.0 Request processed in 63us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.811566:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143843456:0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.811589:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1787827145.811615:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143843968:0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811616:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143843712:12345-0@lo:400:kworker.0 Request processed in 61us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.811628:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1787827145.811638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1787827145.811650:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143844224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827145.811658:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143842944:0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811663:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1787827145.811676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143843072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.811711:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874672143844224:12345-0@lo:400:kworker.0 Request processed in 69us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.811733:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1787827145.811737:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143843072:12345-0@lo:400:kworker.0 Request processed in 65us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.811750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1787827145.811758:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143843328:0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.811775:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00010000:00080000:3.0:1787827145.811787:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe92c0 x1874672143843840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827145.811794:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143844096:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787827145.811797:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827145.811806:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787827145.811813:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827145.811821:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143843840:0@lo:400:kworker.0 00000100:00080000:1.0:1787827145.811823:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827145.811878:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143843072:0@lo:400:kworker.0 00000100:00100000:2.0:1787827145.811880:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143844096:12345-0@lo:400:kworker.0 Request processed in 90us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.811892:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00010000:00080000:1.0:1787827145.811905:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbea1c0 x1874672143843584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.811920:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143843584:0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811934:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143844096:0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811950:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143843200:0@lo:400:kworker.0 00000100:00100000:1.0:1787827145.811971:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143843712:0@lo:400:kworker.0 00010000:00080000:1.0:1787827145.811981:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe8b40 x1874672143844224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.811988:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874672143844224:0@lo:400:kworker.0 00010000:00010000:3.0:1787827145.937353:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787827146.561753:0:27317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:0.0:1787827146.833403:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143844352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827146.833473:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827146.833510:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844352 00000100:00100000:1.0:1787827146.833517:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844352 00000100:00100000:1.0:1787827146.833561:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787827146.833571:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143844352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787827146.833602:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827146.833648:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143844352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827146.833656:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787827146.833690:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143844352:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787827146.961344:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787827147.133086:0:27365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1787827147.153488:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827147.153528:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827147.153539:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311808 00000100:00100000:3.0:1787827147.153549:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311808 00000100:00100000:2.0:1787827147.153561:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827147.153575:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134311936 00000100:00100000:0.0:1787827147.153580:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134311936 00000100:00100000:2.0:1787827147.153588:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827147.153608:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 629 00000100:00100000:3.0:1787827147.153619:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134311808:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827147.153625:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827147.153632:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312064 00000100:00100000:0.0:1787827147.153643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312064 00000100:00100000:2.0:1787827147.153650:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312192 00000100:00100000:2.0:1787827147.153653:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312192 00000100:00100000:0.0:1787827147.153674:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 618 00000100:00100000:0.0:1787827147.153683:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54532692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134311936:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827147.153690:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2393:x1874672134311808:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827147.153696:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312320 00000100:00100000:2.0:1787827147.153701:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312320 00000100:00100000:3.0:1787827147.153704:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 629 00000100:00100000:2.0:1787827147.153732:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 324 00000100:00100000:0.0:1787827147.153742:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54532692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134311936:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827147.153743:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134312192:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827147.153750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 618 00000100:00100000:0.0:1787827147.153772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 619 00000100:00100000:2.0:1787827147.153773:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134312192:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827147.153781:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134312064:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827147.153781:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 324 00000100:00100000:2.0:1787827147.153797:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 325 00000100:00100000:2.0:1787827147.153804:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134312320:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827147.153806:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134312064:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827147.153812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 619 00000100:00100000:2.0:1787827147.153827:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134312320:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 24us (206us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827147.153829:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827147.153833:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827147.153833:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 325 00000100:00080000:0.0:1787827147.153836:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827147.153838:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827147.857406:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827147.857424:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143844480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827147.857492:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827147.857539:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844480 00000100:00100000:3.0:1787827147.857548:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844480 00000100:00080000:0.0:1787827147.857591:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827147.857612:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787827147.857613:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787827147.857626:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143844480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787827147.857653:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787827147.857705:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143844480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827147.857714:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787827147.857732:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143844480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827147.857855:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143844608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827147.857900:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827147.857953:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844608 00000100:00100000:0.0:1787827147.857957:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844608 00000100:00100000:0.0:1787827147.858004:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787827147.858014:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143844608:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787827147.858021:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787827147.858025:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827147.858080:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874672143844608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827147.858088:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787827147.858288:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143844608:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787827147.858396:0:6464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 23 committed 00000001:00100000:2.0:1787827147.858442:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000001:00100000:2.0:1787827147.858452:0:9469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:2.0:1787827147.858455:0:9469:0:(genops.c:885:class_export_put()) final put ffff8d5478923800/2313f4ee-480a-47b2-8d93-5bb216a57733 00000020:00000080:0.0:1787827147.858536:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d5478923800/2313f4ee-480a-47b2-8d93-5bb216a57733 for lustre-OST0001 00000020:00000080:0.0:1787827147.858588:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d5478926000 for lustre-OST0001 00000001:00080000:3.0:1787827147.858847:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705665 is committed 00010000:00010000:2.0:1787827147.985387:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827148.437046:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827148.437091:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312448 00000100:00100000:0.0:1787827148.437099:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312448 00000100:00100000:0.0:1787827148.437149:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 185 00000100:00100000:0.0:1787827148.437158:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23668:x1874672134312448:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787827148.437192:0:22268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827148.437294:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23668:x1874672134312448:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 137us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827148.437303:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 185 00000100:00100000:3.0:1787827148.438141:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827148.438193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312576 00000100:00100000:0.0:1787827148.438199:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312576 00000100:00100000:0.0:1787827148.438260:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 186 00000100:00100000:0.0:1787827148.438270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23668:x1874672134312576:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:0.0:1787827148.438292:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827148.438328:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23668:x1874672134312576:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827148.438333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 186 00000100:00100000:2.0:1787827148.439392:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827148.439441:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312704 00000100:00100000:0.0:1787827148.439447:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312704 00000100:00100000:0.0:1787827148.439486:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 361 00000100:00100000:0.0:1787827148.439495:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23668:x1874672134312704:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:0.0:1787827148.439510:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787827148.439555:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23668:x1874672134312704:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 62us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827148.439563:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 361 00000100:00100000:1.0:1787827148.440280:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827148.440319:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312832 00000100:00100000:3.0:1787827148.440330:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312832 00000100:00100000:3.0:1787827148.440362:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 362 00000100:00100000:3.0:1787827148.440370:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23668:x1874672134312832:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1787827148.440387:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827148.440418:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23668:x1874672134312832:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827148.440425:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 362 00010000:00010000:2.0:1787827149.009339:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787827149.555537:0:27558:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 00000100:00100000:3.0:1787827149.592725:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827149.592768:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134312960 00000100:00100000:1.0:1787827149.592776:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134312960 00000100:00080000:2.0:1787827149.592824:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827149.592842:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 187 00000100:00100000:1.0:1787827149.592854:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23739:x1874672134312960:12345-192.168.203.6@tcp:101:checkstat.0 00010000:00010000:1.0:1787827149.592875:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827149.592896:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795468d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467641 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.592965:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.592980:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.592994:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593007:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593013:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593024:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593057:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593064:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593071:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593077:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112c00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827149.593081:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593096:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593109:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827149.593113:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827149.593118:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593125:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112c00/0xc0fefc09a7954694 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593137:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593144:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593156:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593162:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d5345112e00 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:1.0:1787827149.593165:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593172:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593181:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x49967031 (ffff8d5342888e00) 00010000:00010000:1.0:1787827149.593184:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827149.593187:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593192:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112e00/0xc0fefc09a795469b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x49967031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593254:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795468d lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467641 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593267:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:1.0:1787827149.593270:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787827149.593274:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d5345112a00/0xc0fefc09a795468d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467641 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827149.593283:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d5345112a00, rc 0) 00000100:00100000:1.0:1787827149.593349:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23739:x1874672134312960:12345-192.168.203.6@tcp:101:checkstat.0 Request processed in 497us (630us total) trans 0 rc 301/301 00000100:00100000:1.0:1787827149.593367:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 187 00010000:00010000:3.0:1787827150.034319:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827150.929457:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143844992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827150.929462:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827150.929478:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143844736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827150.929501:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143844864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827150.929535:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.929580:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844736 00000100:00100000:2.0:1787827150.929588:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844736 00000100:00100000:3.0:1787827150.929696:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.929713:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787827150.929727:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143844736:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827150.929729:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143845120:0@lo:400:kworker.0 00000100:00100000:3.0:1787827150.929740:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143845376:0@lo:400:kworker.0 00002000:00000024:2.0:1787827150.929761:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827150.929796:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827150.929796:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.929812:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143844736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.929823:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787827150.929848:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143845888:0@lo:400:kworker.0 00000100:00080000:2.0:1787827150.929854:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827150.929875:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844864 00000100:00100000:2.0:1787827150.929880:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844864 00000100:00100000:3.0:1787827150.929889:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787827150.929890:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f74cb40 x1874672143844736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.929908:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143845376 00000100:00100000:2.0:1787827150.929913:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143845376 00000100:00100000:0.0:1787827150.929915:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143844736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827150.929916:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143846400:0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.929936:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787827150.929944:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143844864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827150.929944:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.929955:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143845632:0@lo:400:kworker.0 00000100:00100000:3.0:1787827150.929963:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787827150.929972:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143845504:0@lo:400:kworker.0 00000004:00000024:2.0:1787827150.929979:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827150.929990:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827150.930006:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.930010:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846144:0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.930029:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143844864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.930031:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143846016:0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.930039:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787827150.930063:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827150.930070:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.930074:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143845632 00000100:00100000:2.0:1787827150.930091:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143845632 00000100:00100000:3.0:1787827150.930104:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143846528:0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930107:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787827150.930120:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787827150.930123:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143845248:0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.930131:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143845376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827150.930131:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.930178:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827150.930182:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d545326a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143844864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827150.930187:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143845376:12345-0@lo:400:kworker.0 Request processed in 59us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.930200:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787827150.930255:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143845760:0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.930256:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787827150.930268:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143845632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827150.930334:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143845376:0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930354:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.930369:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143845632:12345-0@lo:400:kworker.0 Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.930375:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787827150.930394:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143845888 00000100:00100000:3.0:1787827150.930399:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143845888 00000100:00100000:2.0:1787827150.930403:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143845120 00000100:00100000:2.0:1787827150.930405:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143845120 00000100:00100000:0.0:1787827150.930407:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846272:0@lo:400:kworker.0 00000100:00100000:3.0:1787827150.930431:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846400 00000100:00100000:3.0:1787827150.930435:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846400 00000100:00100000:0.0:1787827150.930438:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827150.930438:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143845504 00000100:00100000:1.0:1787827150.930445:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143845504 00000100:00100000:2.0:1787827150.930446:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1787827150.930455:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143845120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930483:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143845632:0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.930492:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143845120:12345-0@lo:400:kworker.0 Request processed in 37us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.930499:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143845120:0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.930500:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1787827150.930533:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846016 00000100:00100000:2.0:1787827150.930538:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846016 00000100:00100000:1.0:1787827150.930540:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846528 00000100:00100000:0.0:1787827150.930542:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846144 00000100:00100000:1.0:1787827150.930546:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846528 00000100:00100000:0.0:1787827150.930554:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846144 00000100:00100000:2.0:1787827150.930558:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143845248 00000100:00100000:2.0:1787827150.930562:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143845248 00000100:00100000:1.0:1787827150.930575:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1787827150.930585:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143845888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930592:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143845760 00000100:00100000:0.0:1787827150.930597:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143845760 00000100:00100000:0.0:1787827150.930621:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846272 00000100:00100000:0.0:1787827150.930625:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846272 00000100:00100000:1.0:1787827150.930634:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874672143845888:12345-0@lo:400:kworker.0 Request processed in 51us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.930652:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787827150.930661:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930699:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846144:12345-0@lo:400:kworker.0 Request processed in 40us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.930704:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787827150.930716:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1787827150.930718:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787827150.930725:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1787827150.930729:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143845760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827150.930740:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143845504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827150.930744:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1787827150.930754:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1787827150.930758:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143846400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930761:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143845760:12345-0@lo:400:kworker.0 Request processed in 34us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.930766:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143846016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930772:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787827150.930786:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874672143845504:12345-0@lo:400:kworker.0 Request processed in 51us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.930793:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787827150.930799:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1787827150.930806:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827150.930808:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143846400:12345-0@lo:400:kworker.0 Request processed in 55us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.930816:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143846016:12345-0@lo:400:kworker.0 Request processed in 52us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827150.930821:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1787827150.930832:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1787827150.930836:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1787827150.930842:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143846528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827150.930843:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1787827150.930858:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143845248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827150.930859:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846272:12345-0@lo:400:kworker.0 Request processed in 52us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.930869:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787827150.930888:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143846528:12345-0@lo:400:kworker.0 Request processed in 48us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827150.930896:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672143845248:12345-0@lo:400:kworker.0 Request processed in 43us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.930897:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1787827150.930905:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00080000:3.0:1787827150.930946:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787827150.930951:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787827150.930954:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827150.930956:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827150.930961:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.930971:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672143845248:0@lo:400:kworker.0 00000100:00100000:3.0:1787827150.930983:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874672143845504:0@lo:400:kworker.0 00000100:00100000:1.0:1787827150.930990:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143844992 00000100:00100000:0.0:1787827150.930993:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143845760:0@lo:400:kworker.0 00000100:00100000:1.0:1787827150.930996:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143844992 00010000:00080000:3.0:1787827150.931001:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386de00 x1874672143846016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827150.931013:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143846016:0@lo:400:kworker.0 00010000:00080000:0.0:1787827150.931017:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2da40 x1874672143846272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827150.931030:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846272:0@lo:400:kworker.0 00010000:00080000:3.0:1787827150.931030:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2c3c0 x1874672143846528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827150.931046:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143846528:0@lo:400:kworker.0 00000100:00100000:1.0:1787827150.931049:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787827150.931051:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705665 gen 2 00000100:00100000:1.0:1787827150.931061:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143844992:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787827150.931064:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d547f74e580, transno 38654705665 00000100:00100000:3.0:1787827150.931068:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874672143845888:0@lo:400:kworker.0 00002000:00000024:1.0:1787827150.931077:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827150.931082:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846144:0@lo:400:kworker.0 00000100:00100000:3.0:1787827150.931083:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143846400:0@lo:400:kworker.0 00000100:00100000:1.0:1787827150.931120:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143844992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827150.931131:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00080000:2.0:1787827150.931143:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386f840 x1874672143844992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.931157:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143844992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787827151.057414:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827151.953456:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827151.953526:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.953696:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846656 00000100:00100000:3.0:1787827151.953716:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846656 00000100:00100000:3.0:1787827151.953768:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787827151.953778:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827151.953808:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827151.953860:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.953867:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787827151.953921:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827152.081469:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827152.273750:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827152.273793:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827152.273806:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313216 00000100:00100000:3.0:1787827152.273816:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313216 00000100:00100000:1.0:1787827152.273839:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827152.273844:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313088 00000100:00100000:2.0:1787827152.273851:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313088 00000100:00100000:1.0:1787827152.273874:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827152.273890:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313344 00000100:00100000:3.0:1787827152.273896:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313344 00000100:00100000:2.0:1787827152.273900:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 631 00000100:00100000:0.0:1787827152.273903:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313472 00000100:00100000:0.0:1787827152.273910:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313472 00000100:00100000:2.0:1787827152.273915:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134313088:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827152.273930:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 626 00000100:00100000:3.0:1787827152.273943:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134313216:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827152.273952:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827152.273966:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313600 00000100:00100000:0.0:1787827152.273970:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313600 00000100:00100000:2.0:1787827152.273983:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134313088:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827152.273991:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2391:x1874672134313216:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827152.273998:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 631 00000100:00100000:3.0:1787827152.274005:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 626 00000100:00100000:0.0:1787827152.274010:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 329 00000100:00100000:0.0:1787827152.274023:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134313472:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827152.274061:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134313472:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 40us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827152.274062:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 627 00000100:00100000:0.0:1787827152.274077:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 329 00000100:00100000:2.0:1787827152.274078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134313344:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827152.274097:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 330 00000100:00100000:3.0:1787827152.274106:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134313600:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827152.274121:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134313344:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827152.274127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 627 00000100:00100000:3.0:1787827152.274170:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134313600:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827152.274177:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 330 00000100:00080000:3.0:1787827152.274284:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787827152.274289:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787827152.274291:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827152.274293:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827152.977371:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827152.977392:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827152.977462:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143846912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827152.977463:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827152.977514:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827152.977522:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846784 00000100:00100000:1.0:1787827152.977530:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846784 00000100:00080000:0.0:1787827152.977567:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827152.977578:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143846912 00000100:00100000:2.0:1787827152.977585:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143846912 00000100:00100000:1.0:1787827152.977602:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787827152.977614:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787827152.977653:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787827152.977679:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787827152.977691:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143846912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787827152.977705:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787827152.977711:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827152.977712:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143846784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827152.977723:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787827152.977748:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143846784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827152.977759:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143846912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827152.977767:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787827152.977800:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143846912:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787827153.105423:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787827153.660258:0:27828:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827153.660270:0:27828:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:3.0:1787827153.703929:0:27846:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787827153.703938:0:27846:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1787827153.721120:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827153.721174:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313728 00000100:00100000:3.0:1787827153.721182:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313728 00000100:00100000:3.0:1787827153.721254:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 188 00000100:00100000:3.0:1787827153.721265:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23948:x1874672134313728:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787827153.721299:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827153.721372:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:23948:x1874672134313728:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 108us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827153.721380:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 188 00000100:00100000:0.0:1787827153.722280:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827153.722654:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313856 00000100:00100000:3.0:1787827153.722669:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313856 00000100:00100000:3.0:1787827153.722746:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 189 00000100:00100000:3.0:1787827153.722758:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23948:x1874672134313856:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1787827153.722806:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827153.722895:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23948:x1874672134313856:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 139us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827153.722903:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 189 00000100:00100000:0.0:1787827153.724734:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827153.725027:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134313984 00000100:00100000:1.0:1787827153.725035:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134313984 00000100:00100000:1.0:1787827153.725093:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 367 00000100:00100000:1.0:1787827153.725104:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23948:x1874672134313984:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:1.0:1787827153.725129:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787827153.725191:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23948:x1874672134313984:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 89us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827153.725245:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 367 00000100:00100000:0.0:1787827153.726754:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827153.726787:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134314112 00000100:00100000:0.0:1787827153.726800:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134314112 00000100:00100000:0.0:1787827153.726841:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 368 00000100:00100000:0.0:1787827153.726851:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23948:x1874672134314112:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:0.0:1787827153.726877:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827153.726928:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2313f4ee-480a-47b2-8d93-5bb216a57733+5:23948:x1874672134314112:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 79us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827153.726937:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 368 00010000:00010000:3.0:1787827154.129322:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787827154.298732:0:27901:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: before: 7663128 after: 7663128 00010000:00010000:1.0:1787827155.153442:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827156.049376:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827156.049403:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143847040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827156.049470:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787827156.049478:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827156.049496:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5453269a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143847168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827156.049523:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847040 00000100:00100000:3.0:1787827156.049532:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847040 00000100:00100000:1.0:1787827156.049547:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827156.049569:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143847296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827156.049581:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.049620:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787827156.049629:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.049639:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143847040:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827156.049656:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847168 00000100:00100000:2.0:1787827156.049664:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847168 00002000:00000024:3.0:1787827156.049673:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827156.049675:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143847680:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.049723:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827156.049741:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787827156.049751:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143847040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827156.049762:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827156.049764:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143847168:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827156.049766:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143848192:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.049778:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787827156.049780:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143847552:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.049799:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847296 00000100:00100000:3.0:1787827156.049805:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847296 00000100:00100000:1.0:1787827156.049814:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1787827156.049822:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827156.049831:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143847808:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.049853:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787827156.049880:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143847296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827156.049886:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827156.049889:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847680 00000100:00100000:2.0:1787827156.049895:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545326a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143847168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827156.049897:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847680 00002000:00000024:3.0:1787827156.049897:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827156.049915:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787827156.049923:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143848320:0@lo:400:kworker.0 00000100:00100000:2.0:1787827156.049949:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847808 00000100:00100000:1.0:1787827156.049951:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848192 00000100:00100000:1.0:1787827156.049958:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848192 00000100:00100000:2.0:1787827156.049959:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847808 00000100:00100000:3.0:1787827156.049966:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143847296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.049975:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787827156.049982:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827156.050004:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1787827156.050020:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143847680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827156.050028:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787827156.050048:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143847808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827156.050065:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5453269a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143847168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827156.050086:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848320 00000100:00100000:3.0:1787827156.050093:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848320 00000100:00100000:1.0:1787827156.050100:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143847680:12345-0@lo:400:kworker.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00080000:0.0:1787827156.050102:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827156.050108:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827156.050113:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00080000:0.0:1787827156.050114:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827156.050136:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143847808:12345-0@lo:400:kworker.0 Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.050153:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787827156.050155:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1787827156.050158:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143847808:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.050159:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787827156.050176:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143848192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.050179:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143848320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050275:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143848192:12345-0@lo:400:kworker.0 Request processed in 101us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827156.050285:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1787827156.050291:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.050305:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143848320:12345-0@lo:400:kworker.0 Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.050314:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787827156.050328:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143848064:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050335:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847552 00000100:00100000:2.0:1787827156.050342:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143847424:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050343:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847552 00000100:00100000:0.0:1787827156.050362:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827156.050399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143848576:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050400:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848064 00000100:00100000:1.0:1787827156.050405:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848064 00000100:00100000:3.0:1787827156.050411:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1787827156.050417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.050431:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143847552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050458:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1787827156.050471:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827156.050478:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143848064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827156.050496:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143847936:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.050497:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143847552:12345-0@lo:400:kworker.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.050517:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1787827156.050529:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143847552:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050531:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143848064:12345-0@lo:400:kworker.0 Request processed in 61us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.050547:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848576 00000100:00100000:0.0:1787827156.050554:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143848064:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.050555:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848576 00000100:00100000:2.0:1787827156.050562:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827156.050564:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1787827156.050592:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1787827156.050607:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143848576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827156.050614:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143848448:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050630:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847936 00000100:00100000:1.0:1787827156.050637:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847936 00000100:00100000:0.0:1787827156.050638:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143848320:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.050678:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874672143848576:12345-0@lo:400:kworker.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.050679:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787827156.050684:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492bfc00 x1874672143848576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827156.050687:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787827156.050695:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1787827156.050707:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143847936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827156.050713:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874672143848576:0@lo:400:kworker.0 00000100:00100000:3.0:1787827156.050727:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848448 00000100:00100000:3.0:1787827156.050732:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848448 00010000:00080000:2.0:1787827156.050754:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d546f6a1a40 x1874672143847040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827156.050771:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1787827156.050772:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5453269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143847936:12345-0@lo:400:kworker.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.050779:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143847040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827156.050790:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143848448:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787827156.050792:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827156.050793:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:0.0:1787827156.050802:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827156.050808:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827156.050835:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143847936:0@lo:400:kworker.0 00010000:00080000:0.0:1787827156.050848:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492bc780 x1874672143848192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827156.050865:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143848192:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050866:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143847424 00000100:00100000:3.0:1787827156.050866:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874672143848448:12345-0@lo:400:kworker.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.050867:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874672143848448:0@lo:400:kworker.0 00000100:00100000:1.0:1787827156.050875:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143847424 00000100:00100000:3.0:1787827156.050890:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1787827156.050895:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f74e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143847680:0@lo:400:kworker.0 00010000:00080000:0.0:1787827156.050927:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2ed00 x1874672143847296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827156.050931:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1787827156.050945:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143847424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827156.050950:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143847296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827156.050993:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143847424:12345-0@lo:400:kworker.0 Request processed in 51us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827156.051006:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1787827156.051022:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143847424:0@lo:400:kworker.0 00010000:00010000:2.0:1787827156.177394:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787827156.606290:0:28095:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 8a: Verify redo io: redo io when get -EINPROGRESS error ========================================================== 06:39:16 (1787827156) 00000100:00100000:1.0:1787827157.057094:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827157.057141:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134314368 00000100:00100000:3.0:1787827157.057151:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134314368 00000100:00080000:1.0:1787827157.057211:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827157.057294:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 190 00000100:00100000:2.0:1787827157.057308:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:24679:x1874672134314368:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:2.0:1787827157.057327:0:22268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827157.057375:0:22268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79546a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c3467648 expref: -99 pid: 22268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.057470:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.057485:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.057497:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.057512:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.057524:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.057542:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787827157.057888:0:22268:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x14:0x0], index 0: 0 00010000:00010000:2.0:1787827157.058061:0:22268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79546b7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058070:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79546b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058077:0:22268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79546b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058120:0:22268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058127:0:22268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058133:0:22268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058138:0:22268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2200 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827157.058142:0:22268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058149:0:22268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058159:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d54605a1a00) 00010000:00010000:2.0:1787827157.058162:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827157.058173:0:22268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058192:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2200/0xc0fefc09a79546a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787827157.058203:0:22268:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea797642 reply state 000000002b42b8c5 transno 4294967407 ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058232:0:22268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058240:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc4abbe7a (ffff8d53428ddf00) 00010000:00010000:2.0:1787827157.058242:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787827157.058245:0:22268:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787827157.058270:0:22268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d3000/0xc0fefc09a79546a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467648 expref: 11 pid: 22268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058283:0:22268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2c00/0xc0fefc09a79546b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c3467648 expref: 10 pid: 22268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.058291:0:22268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x14:0x0].0x0 (ffff8d53428dd700) 00010000:00010000:2.0:1787827157.058293:0:22268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787827157.058295:0:22268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d2c00, rc 0) 00000100:00100000:2.0:1787827157.058351:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+11:24679:x1874672134314368:12345-192.168.203.6@tcp:101:dd.0 Request processed in 1047us (1265us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1787827157.058359:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 190 00000001:00080000:2.0:1787827157.060399:0:6464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967407 is committed 00010000:00010000:2.0:1787827157.060429:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.060448:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.060455:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.060461:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d547f7d2400 already unused, calling callback (ffffffffc1a0e4f0) 00010000:00010000:2.0:1787827157.060465:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.060472:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.060486:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc4abbe7a (ffff8d53428ddf00) 00010000:00010000:2.0:1787827157.060489:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787827157.060493:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.060499:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d547f7d2400/0xc0fefc09a79546b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc4abbe7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827157.061493:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827157.061544:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134314496 00000100:00100000:2.0:1787827157.061553:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134314496 00000100:00080000:3.0:1787827157.061588:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827157.061620:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 247 00000100:00100000:2.0:1787827157.061632:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:24679:x1874672134314496:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:2.0:1787827157.061647:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827157.061666:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001444e1c5/0xc0fefc09a79546c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33d55ea1c346764f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787827157.062028:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787827157.062050:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1787827157.062055:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787827157.062064:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444e1c5/0xc0fefc09a79546c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346764f expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.062084:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001444e1c5/0xc0fefc09a79546c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x33d55ea1c346764f expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.062096:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d547f7d3000, rc 0) 00000100:00100000:2.0:1787827157.062150:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:24679:x1874672134314496:12345-192.168.203.6@tcp:101:dd.0 Request processed in 521us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827157.062158:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 247 00000100:00100000:2.0:1787827157.063721:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827157.063784:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134314624 00000100:00100000:0.0:1787827157.063795:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134314624 00002000:00100000:0.0:1787827157.063844:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e2940 x1874672134314624/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:3/0 lens 4584/0 e 0 to 0 dl 1787827168 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827157.063872:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e2940 with x1874672134314624 ext(0->4095) 00002000:00010000:0.0:1787827157.063879:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e2940 00000100:00100000:0.0:1787827157.063923:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 555 00000100:00100000:0.0:1787827157.063940:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134314624:12345-192.168.203.6@tcp:4:dd.0 00002000:02000000:0.0:1787827157.064211:0:8407:0:(ofd_io.c:1321:ofd_commitrw_write()) *** cfs_fail_loc=230, val=0*** 00000100:00100000:0.0:1787827157.066188:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134314624:12345-192.168.203.6@tcp:4:dd.0 Request processed in 2239us (2453us total) trans 0 rc -115/-115 00000100:00100000:0.0:1787827157.066200:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 555 00002000:00100000:0.0:1787827157.066211:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e2940 x1874672134314624/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:3/0 lens 4584/448 e 0 to 0 dl 1787827168 ref 1 fl Complete:/600/0 rc -115/-115 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827157.066252:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e2940 with x1874672134314624 ext(0->4095) 00002000:00010000:0.0:1787827157.066259:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e2940 00000100:00100000:0.0:1787827157.073354:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143848704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827157.073427:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827157.073477:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848704 00000100:00100000:3.0:1787827157.073486:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848704 00000100:00100000:3.0:1787827157.073544:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787827157.073555:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143848704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827157.073587:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827157.073643:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143848704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827157.073651:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787827157.073729:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143848704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827157.201427:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827157.393211:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827157.393211:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827157.393294:0:9479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134314880 00000100:00100000:2.0:1787827157.393302:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134314752 00000100:00100000:1.0:1787827157.393305:0:9479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134314880 00000100:00100000:2.0:1787827157.393306:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134314752 00002000:00100000:2.0:1787827157.393354:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e3840 x1874672134314752/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:3/0 lens 4584/0 e 0 to 0 dl 1787827168 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827157.393365:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e3840 with x1874672134314752 ext(0->4095) 00002000:00010000:2.0:1787827157.393370:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e3840 00000100:00100000:1.0:1787827157.393371:0:9479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 633 00000100:00100000:2.0:1787827157.393398:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 556 00000100:00100000:1.0:1787827157.393399:0:9479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134314880:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827157.393410:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134314752:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 00000100:00100000:1.0:1787827157.393472:0:9479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:291f6693-430f-40e2-b9af-10afb9cb8617+10:2391:x1874672134314880:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827157.393479:0:9479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 633 00000100:00100000:0.0:1787827157.393584:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00002000:02000000:2.0:1787827157.393604:0:21857:0:(ofd_io.c:1321:ofd_commitrw_write()) *** cfs_fail_loc=230, val=0*** 00000100:00100000:0.0:1787827157.393623:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827157.393641:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315008 00000100:00100000:1.0:1787827157.393647:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315008 00000100:00100000:2.0:1787827157.393649:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134314752:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 Request processed in 241us (450us total) trans 0 rc -115/-115 00000100:00100000:2.0:1787827157.393656:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 556 00002000:00100000:2.0:1787827157.393662:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e3840 x1874672134314752/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:3/0 lens 4584/448 e 0 to 0 dl 1787827168 ref 1 fl Complete:/600/0 rc -115/-115 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827157.393668:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e3840 with x1874672134314752 ext(0->4095) 00002000:00010000:2.0:1787827157.393670:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e3840 00000100:00100000:1.0:1787827157.393706:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 634 00000100:00100000:1.0:1787827157.393717:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134315008:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827157.393719:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315136 00000100:00100000:3.0:1787827157.393725:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315136 00000100:00100000:3.0:1787827157.393764:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 333 00000100:00100000:3.0:1787827157.393778:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134315136:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:2.0:1787827157.394343:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787827157.394348:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827157.394426:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134315008:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 708us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827157.394427:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134315136:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 646us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827157.394442:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 634 00000100:00100000:3.0:1787827157.394444:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 333 00000100:00100000:0.0:1787827158.097385:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827158.097387:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787827158.097410:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143848960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827158.097410:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143848832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827158.097494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827158.097548:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848832 00000100:00100000:0.0:1787827158.097556:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848832 00000100:00100000:2.0:1787827158.097580:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827158.097611:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143848960 00000100:00100000:0.0:1787827158.097623:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143848960 00000100:00080000:2.0:1787827158.097625:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827158.097658:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787827158.097672:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143848832:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827158.097681:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787827158.097692:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143848960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787827158.097696:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691962368 00002000:00000024:0.0:1787827158.097708:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691962368 00000100:00100000:2.0:1787827158.097750:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143848832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827158.097757:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:3.0:1787827158.097760:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827158.097768:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143848960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827158.097779:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787827158.097779:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143848832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827158.097806:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143848960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787827158.225383:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827159.249502:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827159.441073:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827159.441148:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315264 00000100:00100000:1.0:1787827159.441157:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315264 00002000:00100000:1.0:1787827159.441276:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e21c0 x1874672134315264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:5/0 lens 4584/0 e 0 to 0 dl 1787827170 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827159.441287:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e21c0 with x1874672134315264 ext(0->4095) 00002000:00010000:1.0:1787827159.441293:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e21c0 00000100:00080000:3.0:1787827159.441302:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827159.441345:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 557 00000100:00100000:1.0:1787827159.441360:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134315264:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 00002000:02000000:1.0:1787827159.441525:0:8406:0:(ofd_io.c:1321:ofd_commitrw_write()) *** cfs_fail_loc=230, val=0*** 00000100:00100000:1.0:1787827159.445083:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134315264:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 Request processed in 3723us (4016us total) trans 0 rc -115/-115 00000100:00100000:1.0:1787827159.445093:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 557 00002000:00100000:1.0:1787827159.445103:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e21c0 x1874672134315264/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:5/0 lens 4584/448 e 0 to 0 dl 1787827170 ref 1 fl Complete:/600/0 rc -115/-115 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827159.445110:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e21c0 with x1874672134315264 ext(0->4095) 00002000:00010000:1.0:1787827159.445127:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e21c0 00010000:00010000:2.0:1787827160.273389:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827161.169391:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827161.169394:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143849344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827161.169397:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143849088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827161.169414:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143849472:0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.169469:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827161.169478:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.169478:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.169547:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143849216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827161.169551:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143849728:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.169552:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143849856:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.169605:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.169609:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827161.169624:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827161.169642:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143850368:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.169644:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849088 00000100:00100000:1.0:1787827161.169646:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143849984:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.169654:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849088 00000100:00100000:2.0:1787827161.169655:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143850240:0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.169685:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.169707:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849728 00000100:00100000:3.0:1787827161.169712:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849728 00000100:00100000:2.0:1787827161.169727:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.169729:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143850496:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.169730:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849984 00000100:00100000:0.0:1787827161.169733:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.169737:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849984 00000100:00100000:0.0:1787827161.169764:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143850880:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.169766:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787827161.169768:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143850752:0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.169776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.169783:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143849088:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827161.169803:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143851008:0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.169811:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1787827161.169816:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827161.169823:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.169847:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849472 00000100:00100000:1.0:1787827161.169852:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849472 00000100:00100000:2.0:1787827161.169870:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787827161.169881:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143849728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.169893:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1787827161.169900:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143849088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.169906:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143849472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.169914:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849856 00000100:00100000:3.0:1787827161.169914:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787827161.169920:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849856 00000100:00100000:2.0:1787827161.169930:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143849728:12345-0@lo:400:kworker.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827161.169939:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787827161.169950:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143849984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.169958:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143850368 00000100:00100000:2.0:1787827161.169959:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787827161.169964:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143850368 00000100:00100000:1.0:1787827161.169966:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143849472:12345-0@lo:400:kworker.0 Request processed in 62us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.169975:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1787827161.169992:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143850240 00000100:00100000:3.0:1787827161.169995:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143849984:12345-0@lo:400:kworker.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827161.169998:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143850240 00000100:00100000:3.0:1787827161.170006:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787827161.170018:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143850496 00000100:00100000:1.0:1787827161.170022:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143850880 00000100:00100000:0.0:1787827161.170023:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143850496 00000100:00100000:1.0:1787827161.170028:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143850880 00000100:00100000:3.0:1787827161.170042:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1787827161.170054:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143849856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.170057:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143850752 00000100:00100000:2.0:1787827161.170063:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143850752 00000100:00100000:2.0:1787827161.170097:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787827161.170116:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143850240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.170123:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874672143849856:12345-0@lo:400:kworker.0 Request processed in 70us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827161.170167:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143850240:12345-0@lo:400:kworker.0 Request processed in 62us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827161.170172:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787827161.170182:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787827161.170186:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143850752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.170207:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143850752:12345-0@lo:400:kworker.0 Request processed in 20us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827161.170212:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787827161.170305:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1787827161.170319:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143850368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.170319:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1787827161.170330:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1787827161.170335:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143850496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.170340:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1787827161.170353:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143850880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170388:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143850368:12345-0@lo:400:kworker.0 Request processed in 74us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827161.170400:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1787827161.170400:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143850496:12345-0@lo:400:kworker.0 Request processed in 69us (626us total) trans 0 rc 0/0 00010000:00080000:3.0:1787827161.170401:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386e940 x1874672143850752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827161.170409:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143850880:12345-0@lo:400:kworker.0 Request processed in 57us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.170419:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1787827161.170427:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143850752:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170428:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849344 00000100:00100000:2.0:1787827161.170446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1787827161.170450:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143849728:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170458:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849344 00010000:00080000:3.0:1787827161.170469:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386cf00 x1874672143850240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827161.170477:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.170488:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143850240:0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.170497:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849216 00000100:00100000:0.0:1787827161.170503:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787827161.170503:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849216 00000100:00100000:3.0:1787827161.170513:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143849088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827161.170518:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143849472:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170519:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143849344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827161.170540:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00002000:00000024:0.0:1787827161.170545:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827161.170551:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143849216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827161.170554:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143849984:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.170561:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851008 00000100:00100000:3.0:1787827161.170565:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851008 00002000:00000024:2.0:1787827161.170571:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1787827161.170574:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386c780 x1874672143850496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827161.170586:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143850496:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170591:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143849344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827161.170598:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1787827161.170603:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787827161.170610:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143851008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.170615:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143849216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.170616:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143849600:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170617:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787827161.170631:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:0.0:1787827161.170642:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827161.170647:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827161.170651:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827161.170660:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.170667:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143851008:12345-0@lo:400:kworker.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827161.170676:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1787827161.170680:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143849600 00000100:00100000:2.0:1787827161.170686:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143849600 00000100:00100000:1.0:1787827161.170687:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143850112:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170708:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143850368:0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.170720:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827161.170726:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143850880:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.170726:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1787827161.170742:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143849600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170745:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874672143849856:0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.170748:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143850624:0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.170751:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143850112 00000100:00100000:2.0:1787827161.170756:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143850112 00010000:00080000:0.0:1787827161.170762:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d53492bde00 x1874672143849344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827161.170774:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143849344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827161.170794:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787827161.170795:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.170800:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143849600:12345-0@lo:400:kworker.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827161.170810:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143850112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.170811:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1787827161.170833:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143850624 00010000:00080000:1.0:1787827161.170835:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547d36bc00 x1874672143851008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827161.170838:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143850624 00000100:00100000:1.0:1787827161.170849:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547d36bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143851008:0@lo:400:kworker.0 00000100:00100000:2.0:1787827161.170859:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143850112:12345-0@lo:400:kworker.0 Request processed in 53us (140us total) trans 0 rc 0/0 00000100:00080000:3.0:1787827161.170860:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787827161.170868:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe2d680 x1874672143849216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827161.170871:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787827161.170883:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787827161.170890:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143849216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827161.170897:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143850624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.170921:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143849600:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.170938:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143850624:12345-0@lo:400:kworker.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827161.170944:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787827161.171297:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143850112:0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.171310:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143850624:0@lo:400:kworker.0 00010000:00010000:2.0:1787827161.297388:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827162.193676:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787827162.193699:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143851136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787827162.193765:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827162.194168:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851136 00000100:00100000:0.0:1787827162.194177:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851136 00000100:00100000:0.0:1787827162.194275:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787827162.194291:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143851136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827162.194347:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827162.194401:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143851136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827162.194408:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787827162.194529:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d53492bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143851136:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787827162.321370:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827162.449097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827162.449164:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315392 00000100:00100000:3.0:1787827162.449175:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315392 00002000:00100000:3.0:1787827162.449290:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e0780 x1874672134315392/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:8/0 lens 4584/0 e 0 to 0 dl 1787827173 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827162.449303:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0780 with x1874672134315392 ext(0->4095) 00002000:00010000:3.0:1787827162.449308:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0780 00000100:00100000:3.0:1787827162.449333:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 558 00000100:00100000:3.0:1787827162.449353:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134315392:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 00002000:02000000:3.0:1787827162.449512:0:21856:0:(ofd_io.c:1321:ofd_commitrw_write()) *** cfs_fail_loc=230, val=0*** 00000100:00080000:0.0:1787827162.450264:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827162.451662:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134315392:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 Request processed in 2308us (2569us total) trans 0 rc -115/-115 00000100:00100000:3.0:1787827162.451673:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 558 00002000:00100000:3.0:1787827162.451684:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e0780 x1874672134315392/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:8/0 lens 4584/448 e 0 to 0 dl 1787827173 ref 1 fl Complete:/600/0 rc -115/-115 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827162.451696:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e0780 with x1874672134315392 ext(0->4095) 00002000:00010000:3.0:1787827162.451700:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e0780 00000100:00100000:0.0:1787827162.513115:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827162.513170:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827162.513181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315776 00000100:00100000:0.0:1787827162.513189:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827162.513193:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315776 00000100:00100000:3.0:1787827162.513243:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315648 00000100:00100000:3.0:1787827162.513248:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315648 00000100:00100000:1.0:1787827162.513255:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315904 00000100:00100000:0.0:1787827162.513263:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827162.513263:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315904 00000100:00100000:2.0:1787827162.513295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 641 00000100:00100000:3.0:1787827162.513296:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 635 00000100:00100000:0.0:1787827162.513303:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316032 00000100:00100000:0.0:1787827162.513307:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316032 00000100:00100000:1.0:1787827162.513311:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 642 00000100:00100000:2.0:1787827162.513318:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134315776:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827162.513318:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134315648:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827162.513327:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134315904:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827162.513344:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 338 00000100:00100000:0.0:1787827162.513356:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134316032:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827162.513398:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53492bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134315776:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827162.513398:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134315648:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827162.513399:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2393:x1874672134316032:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827162.513399:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134315904:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827162.513415:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 641 00000100:00100000:3.0:1787827162.513418:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 635 00000100:00100000:0.0:1787827162.513424:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 338 00000100:00100000:1.0:1787827162.513435:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 642 00000100:00080000:0.0:1787827162.513453:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827162.513458:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827162.513460:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827163.217420:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d546f6a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143851392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827163.217426:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143851264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827163.217497:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827163.217552:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851264 00000100:00100000:2.0:1787827163.217569:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851264 00000100:00100000:2.0:1787827163.217624:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787827163.217632:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143851264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787827163.217656:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787827163.217668:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827163.217743:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143851264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827163.217749:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787827163.217755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827163.217768:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851392 00000100:00100000:2.0:1787827163.217772:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851392 00000100:00100000:3.0:1787827163.217788:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143851264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827163.217803:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787827163.217810:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143851392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787827163.217821:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1787827163.217825:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827163.217868:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143851392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827163.217873:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787827163.217877:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d546f6a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143851392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787827163.345418:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827164.369470:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827165.393375:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827166.289532:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143851520:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.289628:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.289684:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143852032:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.289711:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.289732:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143852544:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.289764:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.289784:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143853056:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.289805:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.289846:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143851776:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.289855:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143851648:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.289876:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.289900:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143852288:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.289954:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.289958:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.289974:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143852800:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.290002:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.290015:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143852160:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.290023:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787827166.290030:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143851904:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.290070:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.290086:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.290110:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143852672:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.290133:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143852416:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.290160:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827166.290187:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.290257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852544 00000100:00100000:3.0:1787827166.290261:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143852928:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.290268:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852544 00000100:00100000:3.0:1787827166.290298:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.290331:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853056 00000100:00100000:1.0:1787827166.290335:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853056 00000100:00100000:1.0:1787827166.290358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851648 00000100:00100000:1.0:1787827166.290361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851648 00000100:00100000:3.0:1787827166.290369:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852032 00000100:00100000:3.0:1787827166.290378:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852032 00000100:00100000:1.0:1787827166.290379:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851904 00000100:00100000:1.0:1787827166.290382:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851904 00000100:00100000:0.0:1787827166.290392:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787827166.290398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852416 00000100:00100000:1.0:1787827166.290403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852416 00000100:00100000:0.0:1787827166.290408:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143853184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827166.290431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852928 00000100:00100000:1.0:1787827166.290438:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852928 00000100:00100000:3.0:1787827166.290446:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851776 00000100:00100000:3.0:1787827166.290454:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851776 00000100:00100000:1.0:1787827166.290466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1787827166.290470:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.290484:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143852544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.290498:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787827166.290519:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143852032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.290549:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787827166.290563:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143852544:12345-0@lo:400:kworker.0 Request processed in 83us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.290570:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143851776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.290577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1787827166.290597:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143852032:12345-0@lo:400:kworker.0 Request processed in 86us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827166.290611:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787827166.290620:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1787827166.290640:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1787827166.290641:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143851776:12345-0@lo:400:kworker.0 Request processed in 79us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.290647:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143853056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.290660:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1787827166.290666:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787827166.290667:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143851648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.290679:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143851904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.290707:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143853056:12345-0@lo:400:kworker.0 Request processed in 67us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.290708:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853184 00000100:00100000:0.0:1787827166.290714:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853184 00000100:00100000:2.0:1787827166.290722:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1787827166.290751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874672143851648:12345-0@lo:400:kworker.0 Request processed in 93us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827166.290751:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143851904:12345-0@lo:400:kworker.0 Request processed in 76us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.290766:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1787827166.290770:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787827166.290785:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1787827166.290794:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143853184:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827166.290794:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1787827166.290794:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143852416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.290817:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00002000:00000024:0.0:1787827166.290829:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827166.290835:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143852928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.290841:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852288 00000100:00100000:1.0:1787827166.290845:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852288 00000100:00100000:2.0:1787827166.290853:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672143852416:12345-0@lo:400:kworker.0 Request processed in 67us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.290863:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1787827166.290890:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852800 00000100:00100000:1.0:1787827166.290896:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852800 00000100:00100000:2.0:1787827166.290900:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852160 00000100:00100000:2.0:1787827166.290905:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852160 00000100:00100000:0.0:1787827166.290917:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874672143853184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827166.290919:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672143852928:12345-0@lo:400:kworker.0 Request processed in 91us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.290927:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143852672 00000100:00100000:1.0:1787827166.290937:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143852672 00000100:00100000:2.0:1787827166.290943:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787827166.290945:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1787827166.290954:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787827166.290972:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672143852288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.290983:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00080000:3.0:1787827166.290991:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827166.290997:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143852800:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787827166.290999:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827166.291011:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1787827166.291011:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787827166.291019:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827166.291038:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787827166.291040:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143852160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.291041:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143852288:12345-0@lo:400:kworker.0 Request processed in 78us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827166.291051:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143853312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827166.291053:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143852800:12345-0@lo:400:kworker.0 Request processed in 60us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.291062:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787827166.291074:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787827166.291091:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143852160:12345-0@lo:400:kworker.0 Request processed in 64us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.291093:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1787827166.291105:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787827166.291109:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827166.291127:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143852672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.291156:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853312 00000100:00100000:1.0:1787827166.291162:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853312 00000100:00100000:0.0:1787827166.291178:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874672143851648:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.291198:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143851904:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.291199:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143852160:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.291200:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143852672:12345-0@lo:400:kworker.0 Request processed in 94us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.291210:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787827166.291260:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143852672:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.291261:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787827166.291280:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672143852416:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.291306:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672143852928:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.291331:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143851776:0@lo:400:kworker.0 00010000:00080000:0.0:1787827166.291333:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0e580 x1874672143853184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827166.291344:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143853312:12345-0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787827166.291352:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386f480 x1874672143852288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827166.291361:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143853184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827166.291367:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143852288:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.291370:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143851520 00000004:00000024:1.0:1787827166.291373:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787827166.291381:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143851520 00010000:00080000:3.0:1787827166.291393:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386cf00 x1874672143852800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827166.291402:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143852800:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.291421:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143852032:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.291451:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00010000:00080000:0.0:1787827166.291455:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d534386c780 x1874672143852544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827166.291465:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827166.291466:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143853312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.291467:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143851520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.291480:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143853440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827166.291482:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d534386c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143852544:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.291495:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00080000:0.0:1787827166.291513:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fbe8b40 x1874672143853056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827166.291526:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143853056:0@lo:400:kworker.0 00000100:00100000:3.0:1787827166.291547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827166.291556:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3618:x1874672143851520:12345-0@lo:400:kworker.0 Request processed in 87us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.291568:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1787827166.291576:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5345ae30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3618:1874672143851520:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.291593:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853440 00000100:00100000:1.0:1787827166.291598:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853440 00000100:00100000:1.0:1787827166.291641:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787827166.291641:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143853312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827166.291661:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143853440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787827166.291675:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827166.291712:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143853440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.291717:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00080000:3.0:1787827166.291776:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e30c0 x1874672143853440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827166.291792:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143853440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787827166.417361:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827166.481070:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827166.481148:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134315520 00000100:00100000:1.0:1787827166.481160:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134315520 00000100:00080000:3.0:1787827166.481248:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1787827166.481294:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e1680 x1874672134315520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:12/0 lens 4584/0 e 0 to 0 dl 1787827177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827166.481307:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1680 with x1874672134315520 ext(0->4095) 00002000:00010000:1.0:1787827166.481314:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1680 00000100:00100000:1.0:1787827166.481350:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 559 00000100:00100000:1.0:1787827166.481365:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134315520:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 00002000:02000000:1.0:1787827166.481507:0:21860:0:(ofd_io.c:1321:ofd_commitrw_write()) *** cfs_fail_loc=230, val=0*** 00000100:00100000:1.0:1787827166.483567:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134315520:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 Request processed in 2203us (2499us total) trans 0 rc -115/-115 00000100:00100000:1.0:1787827166.483579:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 559 00002000:00100000:1.0:1787827166.483590:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e1680 x1874672134315520/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:12/0 lens 4584/448 e 0 to 0 dl 1787827177 ref 1 fl Complete:/600/0 rc -115/-115 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827166.483601:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1680 with x1874672134315520 ext(0->4095) 00002000:00010000:1.0:1787827166.483606:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1680 00000100:00100000:1.0:1787827167.313551:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787827167.313596:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143853568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827167.313710:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827167.313870:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853568 00000100:00100000:3.0:1787827167.313882:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853568 00000100:00100000:3.0:1787827167.313956:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787827167.313967:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343b0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143853568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787827167.314017:0:7435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787827167.314075:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343b0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143853568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827167.314083:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787827167.314139:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143853568:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787827167.441436:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827167.633147:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827167.633203:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827167.633204:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316416 00000100:00100000:1.0:1787827167.633262:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316416 00000100:00100000:3.0:1787827167.633264:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316288 00000100:00100000:3.0:1787827167.633270:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316288 00000100:00100000:0.0:1787827167.633290:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827167.633328:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827167.633343:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316544 00000100:00100000:3.0:1787827167.633343:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 637 00000100:00100000:1.0:1787827167.633349:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316544 00000100:00100000:3.0:1787827167.633374:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134316288:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827167.633381:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827167.633399:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 649 00000100:00100000:1.0:1787827167.633410:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134316416:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827167.633426:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 650 00000100:00100000:0.0:1787827167.633443:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316672 00000100:00100000:0.0:1787827167.633450:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316672 00000100:00100000:2.0:1787827167.633457:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134316544:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827167.633481:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134316416:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827167.633482:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134316288:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 120us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827167.633499:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316800 00000100:00100000:1.0:1787827167.633501:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 649 00000100:00100000:3.0:1787827167.633505:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 637 00000100:00100000:0.0:1787827167.633507:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316800 00000100:00100000:1.0:1787827167.633543:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 343 00000100:00080000:3.0:1787827167.633564:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827167.633567:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134316672:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:3.0:1787827167.633572:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827167.633578:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827167.633579:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 344 00000100:00100000:0.0:1787827167.633592:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134316800:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827167.633604:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134316544:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827167.633616:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134316672:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 62us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827167.633617:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 650 00000100:00100000:1.0:1787827167.633645:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 343 00000100:00100000:0.0:1787827167.633661:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2391:x1874672134316800:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827167.633672:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 344 00000100:00100000:3.0:1787827168.337396:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787827168.337420:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143853696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827168.337515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827168.337572:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853696 00000100:00100000:0.0:1787827168.337581:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853696 00000100:00100000:0.0:1787827168.337666:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787827168.337683:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143853696:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827168.337684:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827168.337700:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143853824:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787827168.337719:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787827168.337737:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787827168.337737:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827168.337783:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143853696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827168.337792:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787827168.337804:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853824 00000100:00100000:1.0:1787827168.337818:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853824 00000100:00100000:3.0:1787827168.337847:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143853696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787827168.337899:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787827168.337911:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143853824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787827168.337937:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787827168.337971:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827168.338020:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143853824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827168.338051:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143853824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827168.338092:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:2.0:1787827168.465423:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827169.490156:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827170.513361:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827171.409439:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143854080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827171.409473:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143854336:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.409488:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143854208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827171.409569:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.409577:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.409671:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.409683:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143854464:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.409685:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143854720:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.409722:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143854848:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.409747:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.409768:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.409784:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854208 00000100:00100000:0.0:1787827171.409793:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854208 00000100:00100000:3.0:1787827171.409807:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143854976:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.409808:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143855360:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.409856:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.409864:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.409897:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143855488:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.409900:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143855872:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.409912:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787827171.409947:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143854208:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827171.409963:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.409967:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787827171.409986:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827171.410058:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854336 00000100:00100000:2.0:1787827171.410068:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854336 00000100:00100000:0.0:1787827171.410071:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143854208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827171.410091:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854976 00000100:00100000:0.0:1787827171.410100:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787827171.410101:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854976 00000100:00100000:2.0:1787827171.410161:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00080000:0.0:1787827171.410165:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827171.410168:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143855488 00000100:00100000:3.0:1787827171.410174:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143855488 00000100:00080000:0.0:1787827171.410176:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827171.410182:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143854336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.410208:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854080 00000100:00100000:0.0:1787827171.410253:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827171.410267:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854080 00000100:00100000:3.0:1787827171.410293:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787827171.410310:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143854976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.410315:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143855232:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.410344:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854848 00000100:00100000:2.0:1787827171.410352:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3616:x1874672143854336:12345-0@lo:400:kworker.0 Request processed in 174us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.410353:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854848 00000100:00100000:2.0:1787827171.410378:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1787827171.410382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.410390:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143854976:12345-0@lo:400:kworker.0 Request processed in 84us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827171.410406:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787827171.410440:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143855744:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.410447:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787827171.410469:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143855488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.410499:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.410538:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143855488:12345-0@lo:400:kworker.0 Request processed in 78us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.410543:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00010000:00080000:0.0:1787827171.410555:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0c3c0 x1874672143854208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827171.410558:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787827171.410565:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143854080:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827171.410592:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143854208:0@lo:13:osp-pre-1-1.0 00000004:00000024:1.0:1787827171.410597:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787827171.410614:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787827171.410615:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854464 00000100:00100000:2.0:1787827171.410624:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854464 00000100:00100000:0.0:1787827171.410626:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143853952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827171.410655:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874672143854080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.410665:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787827171.410666:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827171.410690:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787827171.410695:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143854592:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.410700:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143855360 00000100:00100000:1.0:1787827171.410706:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143854848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.410708:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143855360 00000100:00100000:2.0:1787827171.410715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143855872 00000100:00100000:2.0:1787827171.410722:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143855872 00000100:00100000:0.0:1787827171.410737:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.410753:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854720 00000100:00100000:3.0:1787827171.410760:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854720 00000100:00100000:0.0:1787827171.410764:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143855104:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.410768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143855232 00000100:00100000:2.0:1787827171.410775:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143855232 00000100:00100000:1.0:1787827171.410789:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143854848:12345-0@lo:400:kworker.0 Request processed in 85us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827171.410792:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143855744 00000100:00100000:3.0:1787827171.410798:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143855744 00000100:00100000:1.0:1787827171.410806:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787827171.410827:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.410834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1787827171.410836:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143854592 00000100:00100000:1.0:1787827171.410845:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143854592 00000100:00100000:2.0:1787827171.410858:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143854464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.410866:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1787827171.410871:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143855616:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.410886:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143855360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.410890:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787827171.410909:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143854592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.410937:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.410950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874672143854464:12345-0@lo:400:kworker.0 Request processed in 102us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.410963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1787827171.411001:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874672143855360:12345-0@lo:400:kworker.0 Request processed in 112us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.411010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1787827171.411011:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143854592:12345-0@lo:400:kworker.0 Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.411024:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787827171.411036:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1787827171.411047:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1787827171.411048:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143855872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.411056:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143854720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411064:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1787827171.411091:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143855232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.411096:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1787827171.411118:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143855744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.411134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672143855872:12345-0@lo:400:kworker.0 Request processed in 92us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.411144:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1787827171.411150:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874672143854720:12345-0@lo:400:kworker.0 Request processed in 102us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.411157:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1787827171.411179:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874672143855232:12345-0@lo:400:kworker.0 Request processed in 104us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.411187:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1787827171.411191:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874672143855744:12345-0@lo:400:kworker.0 Request processed in 79us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.411199:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143855104 00000100:00100000:0.0:1787827171.411206:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143853952 00000100:00100000:3.0:1787827171.411208:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1787827171.411209:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143855104 00000100:00100000:0.0:1787827171.411265:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143853952 00000100:00100000:2.0:1787827171.411319:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143855616 00000100:00100000:2.0:1787827171.411325:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143855616 00000100:00100000:0.0:1787827171.411335:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787827171.411340:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787827171.411349:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143853952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827171.411355:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143855104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.411367:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00002000:00000024:0.0:1787827171.411369:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827171.411383:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546e295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143855616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411424:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143855104:12345-0@lo:400:kworker.0 Request processed in 72us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.411433:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143853952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.411438:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787827171.411453:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546e295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3619:x1874672143855616:12345-0@lo:400:kworker.0 Request processed in 70us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.411454:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787827171.411479:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:3.0:1787827171.411501:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787827171.411510:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787827171.411513:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787827171.411517:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787827171.411552:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e12c0 x1874672143853952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827171.411578:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143854976:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411585:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143853952:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787827171.411591:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0c780 x1874672143855360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827171.411617:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143855488:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.411619:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874672143855360:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411630:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143854592:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.411679:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143854080:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1787827171.411684:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb2d680 x1874672143855872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787827171.411688:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d5343b0fc00 x1874672143855104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827171.411713:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874672143854464:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.411727:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672143855872:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411728:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143855104:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.411779:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3616:1874672143854336:0@lo:400:kworker.0 00010000:00080000:1.0:1787827171.411788:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb2e940 x1874672143855616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827171.411801:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143855616:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.411827:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143854848:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411840:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874672143855232:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411869:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874672143855744:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.411898:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d5343b0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874672143854720:0@lo:400:kworker.0 00010000:00010000:1.0:1787827171.537459:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827171.665746:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827171.665808:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316160 00000100:00100000:3.0:1787827171.665821:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316160 00002000:00100000:3.0:1787827171.665924:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e1e00 x1874672134316160/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:17/0 lens 4584/0 e 0 to 0 dl 1787827182 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00000100:00080000:0.0:1787827171.665935:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1787827171.665936:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1e00 with x1874672134316160 ext(0->4095) 00002000:00010000:3.0:1787827171.665943:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1e00 00000100:00100000:3.0:1787827171.665973:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 560 00000100:00100000:3.0:1787827171.665983:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134316160:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 00002000:02000000:3.0:1787827171.666258:0:21855:0:(ofd_io.c:1321:ofd_commitrw_write()) *** cfs_fail_loc=230, val=0*** 00000100:00100000:3.0:1787827171.668474:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134316160:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 Request processed in 2481us (2731us total) trans 0 rc -115/-115 00000100:00100000:3.0:1787827171.668488:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 560 00002000:00100000:3.0:1787827171.668509:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547f9e1e00 x1874672134316160/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:17/0 lens 4584/448 e 0 to 0 dl 1787827182 ref 1 fl Complete:/600/0 rc -115/-115 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827171.668520:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547f9e1e00 with x1874672134316160 ext(0->4095) 00002000:00010000:3.0:1787827171.668526:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547f9e1e00 00000100:00100000:1.0:1787827172.433523:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827172.433555:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143856000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827172.433626:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827172.433702:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856000 00000100:00100000:2.0:1787827172.433717:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856000 00000100:00100000:2.0:1787827172.433804:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787827172.433819:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143856000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787827172.433866:0:19325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787827172.433972:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143856000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827172.433982:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787827172.434034:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143856000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827172.561404:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827172.753355:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827172.753402:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827172.753406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317184 00000100:00100000:2.0:1787827172.753417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317184 00000100:00100000:3.0:1787827172.753441:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827172.753480:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827172.753494:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317056 00000100:00100000:2.0:1787827172.753503:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317312 00000100:00100000:2.0:1787827172.753510:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317312 00000100:00100000:0.0:1787827172.753511:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317056 00000100:00100000:3.0:1787827172.753523:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827172.753543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 657 00000100:00100000:2.0:1787827172.753563:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134317184:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827172.753563:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 658 00000100:00100000:3.0:1787827172.753579:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134317312:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827172.753605:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 639 00000100:00100000:0.0:1787827172.753619:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134317056:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827172.753655:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134317312:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827172.753663:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827172.753666:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 658 00000100:00080000:1.0:1787827172.753669:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827172.753682:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317440 00000100:00100000:1.0:1787827172.753686:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317440 00000100:00100000:0.0:1787827172.753695:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5443e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2392:x1874672134317056:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827172.753706:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 639 00000100:00100000:3.0:1787827172.753726:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317568 00000100:00100000:1.0:1787827172.753729:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 349 00000100:00100000:3.0:1787827172.753733:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317568 00000100:00100000:1.0:1787827172.753740:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134317440:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1787827172.753782:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134317440:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 44us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827172.753790:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 349 00000100:00100000:3.0:1787827172.753803:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 350 00000100:00100000:2.0:1787827172.753825:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2393:x1874672134317184:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 264us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827172.753825:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134317568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827172.753838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 657 00000100:00100000:3.0:1787827172.753863:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2392:x1874672134317568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827172.753871:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 350 00000100:00080000:2.0:1787827172.753891:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827173.457417:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143856128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827173.457489:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827173.457536:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856128 00000100:00100000:0.0:1787827173.457544:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856128 00000100:00100000:2.0:1787827173.457545:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143856256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827173.457569:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787827173.457609:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827173.457618:0:22265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856256 00000100:00100000:0.0:1787827173.457622:0:22265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856256 00000100:00100000:3.0:1787827173.457644:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787827173.457658:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787827173.457660:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143856128:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787827173.457673:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547f9e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143856256:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787827173.457680:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787827173.457694:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691991040 00002000:00000024:1.0:1787827173.457696:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 8639936 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787827173.457756:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143856128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827173.457765:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547f9e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874672143856256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827173.457769:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787827173.457778:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787827173.457797:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143856128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787827173.457814:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874672143856256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787827173.585384:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827174.609365:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827175.633407:0:6474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827176.529437:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143856384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827176.529461:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143856768:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.529536:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143856512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827176.529564:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827176.529589:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143856640:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.529645:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827176.529646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827176.529659:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.529675:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143857152:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.529706:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143857024:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.529718:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143857408:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.529734:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143856896:0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.529736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.529776:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143857664:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.529787:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827176.529797:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827176.529808:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.529833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.529840:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143857792:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.529851:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143857536:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.529860:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fe0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143857280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827176.529878:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143858176:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.529887:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827176.529925:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.529930:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143858304:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.529944:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.529948:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827176.529978:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143858048:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.529990:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143857920:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.530074:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827176.530113:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.530115:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856384 00000100:00100000:2.0:1787827176.530124:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856384 00000100:00100000:3.0:1787827176.530147:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856768 00000100:00100000:1.0:1787827176.530154:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857152 00000100:00100000:3.0:1787827176.530156:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856768 00000100:00100000:1.0:1787827176.530162:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857152 00000100:00100000:2.0:1787827176.530190:0:7435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856896 00000100:00100000:0.0:1787827176.530192:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857408 00000100:00100000:2.0:1787827176.530196:0:7435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856896 00000100:00100000:0.0:1787827176.530201:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857408 00000100:00100000:1.0:1787827176.530211:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787827176.530247:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857024 00000100:00100000:3.0:1787827176.530255:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857024 00000100:00100000:1.0:1787827176.530285:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547d36ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143856384:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827176.530288:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857664 00000100:00100000:3.0:1787827176.530295:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857664 00000100:00100000:2.0:1787827176.530317:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787827176.530331:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857536 00000004:00000024:1.0:1787827176.530337:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787827176.530339:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857792 00000100:00100000:0.0:1787827176.530340:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857536 00000100:00100000:2.0:1787827176.530340:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143857152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.530352:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857792 00000100:00100000:3.0:1787827176.530389:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143858176 00000100:00100000:0.0:1787827176.530395:0:10061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143858048 00000100:00100000:3.0:1787827176.530396:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143858176 00000100:00100000:0.0:1787827176.530401:0:10061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143858048 00000100:00100000:3.0:1787827176.530440:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143858304 00000100:00100000:1.0:1787827176.530441:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547d36ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874672143856384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827176.530442:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d53424430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874672143857152:12345-0@lo:400:kworker.0 Request processed in 111us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.530449:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143858304 00000100:00100000:2.0:1787827176.530466:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787827176.530473:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787827176.530489:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787827176.530489:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1787827176.530493:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143857408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.530506:0:7435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787827176.530519:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143856768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.530528:0:7435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143856896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.530547:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1787827176.530563:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143857024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.530588:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874672143857408:12345-0@lo:400:kworker.0 Request processed in 99us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.530598:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787827176.530601:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874672143856768:12345-0@lo:400:kworker.0 Request processed in 89us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.530617:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1787827176.530625:0:7435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143856896:12345-0@lo:400:kworker.0 Request processed in 96us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.530637:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787827176.530648:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672143857024:12345-0@lo:400:kworker.0 Request processed in 86us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.530650:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1787827176.530652:0:7435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787827176.530661:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143857536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.530677:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1787827176.530677:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143857664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.530697:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856640 00000100:00100000:2.0:1787827176.530704:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856640 00000100:00100000:1.0:1787827176.530724:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1787827176.530733:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672143857536:12345-0@lo:400:kworker.0 Request processed in 75us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827176.530741:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143857792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.530747:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787827176.530761:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874672143857664:12345-0@lo:400:kworker.0 Request processed in 88us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827176.530762:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1787827176.530777:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1787827176.530784:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143856640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.530794:0:10061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787827176.530802:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874672143857792:12345-0@lo:400:kworker.0 Request processed in 62us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.530814:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1787827176.530815:0:10061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143858048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.530824:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1787827176.530831:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143858176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.530847:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1+24:3619:x1874672143856640:12345-0@lo:400:kworker.0 Request processed in 71us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827176.530853:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1787827176.530869:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1787827176.530876:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fb461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143858304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.530884:0:10061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143858048:12345-0@lo:400:kworker.0 Request processed in 73us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.530893:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5342440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874672143858176:12345-0@lo:400:kworker.0 Request processed in 67us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.530896:0:10061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787827176.530903:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1787827176.530939:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143856512 00000100:00100000:1.0:1787827176.530943:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fb461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874672143858304:12345-0@lo:400:kworker.0 Request processed in 78us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827176.530946:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143856512 00000100:00100000:1.0:1787827176.530954:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00080000:0.0:1787827176.530992:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827176.530999:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874672143857408:0@lo:400:kworker.0 00000100:00080000:0.0:1787827176.531001:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827176.531003:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857280 00000100:00080000:0.0:1787827176.531013:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827176.531014:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857280 00000100:00080000:0.0:1787827176.531023:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827176.531035:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874672143857152:0@lo:400:kworker.0 00010000:00080000:3.0:1787827176.531037:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb2f0c0 x1874672143857792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827176.531068:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874672143857792:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.531076:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874672143857664:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.531077:0:22265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00010000:00080000:3.0:1787827176.531097:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb2d680 x1874672143858304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827176.531098:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787827176.531113:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874672143858176:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.531114:0:22265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143856512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787827176.531124:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143857280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827176.531159:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874672143858304:0@lo:400:kworker.0 00002000:00000024:0.0:1787827176.531166:0:22265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787827176.531179:0:16591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827176.531190:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874672143856384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827176.531192:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874672143856768:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.531276:0:22265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672143856512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.531289:0:22265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1787827176.531296:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874672143857280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 179us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827176.531309:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787827176.531339:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.531381:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143857920 00000100:00100000:3.0:1787827176.531394:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143857920 00000100:00100000:0.0:1787827176.531399:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dd3d68a-8e8c-43d6-9c70-ef3b136f61d1:3619:1874672143856640:0@lo:400:kworker.0 00010000:00080000:1.0:1787827176.531423:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb2c000 x1874672143858048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827176.531428:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143856896:0@lo:400:kworker.0 00000100:00080000:2.0:1787827176.531436:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827176.531457:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143858048:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.531459:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00010000:00080000:0.0:1787827176.531471:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fe0de00 x1874672143857280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827176.531479:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143857920:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787827176.531496:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547f9e12c0 x1874672143856512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827176.531501:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fe0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874672143857280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827176.531536:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547f9e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874672143856512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827176.531546:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143857920:12345-0@lo:400:kworker.0 Request processed in 70us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.531555:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787827176.531563:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143857920:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.531573:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672143857024:0@lo:400:kworker.0 00010000:00080000:1.0:1787827176.531595:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d547fb2cf00 x1874672143857536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827176.531601:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fb2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874672143857536:0@lo:400:kworker.0 00010000:00010000:2.0:1787827176.657439:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827177.553363:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d547fbe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143858432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827177.553484:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827177.553544:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672143858432 00000100:00100000:0.0:1787827177.553560:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672143858432 00000100:00100000:0.0:1787827177.553624:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787827177.553637:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143858432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787827177.553683:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827177.553755:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874672143858432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827177.553764:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787827177.553805:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d547fbe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874672143858432:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787827177.681389:0:10301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827177.873169:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827177.873283:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.873301:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134316928 00000100:00100000:1.0:1787827177.873316:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134316928 00000100:00100000:0.0:1787827177.873329:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827177.873369:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318208 00000100:00100000:2.0:1787827177.873371:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317824 00000100:00100000:0.0:1787827177.873379:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827177.873379:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318208 00000100:00100000:2.0:1787827177.873380:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317824 00002000:00100000:1.0:1787827177.873407:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547fbe8b40 x1874672134316928/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787827177.873429:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00002000:00100000:1.0:1787827177.873432:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8b40 with x1874672134316928 ext(0->4095) 00002000:00010000:1.0:1787827177.873441:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8b40 00000100:00100000:3.0:1787827177.873468:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318080 00000100:00100000:2.0:1787827177.873473:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 665 00000100:00100000:1.0:1787827177.873479:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 561 00000100:00100000:3.0:1787827177.873483:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318080 00000100:00100000:2.0:1787827177.873494:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134317824:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827177.873496:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.873501:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2390:x1874672134316928:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 00000100:00100000:0.0:1787827177.873532:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317696 00000100:00100000:3.0:1787827177.873532:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 355 00000100:00100000:0.0:1787827177.873537:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317696 00000100:00100000:3.0:1787827177.873553:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134318080:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1787827177.873575:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 641 00000100:00100000:0.0:1787827177.873583:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134317696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1787827177.873593:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+9:2391:x1874672134317824:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827177.873600:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 665 00000100:00100000:2.0:1787827177.873619:0:22268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134317952 00000100:00100000:2.0:1787827177.873623:0:22268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134317952 00000100:00100000:0.0:1787827177.873632:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d54470db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:291f6693-430f-40e2-b9af-10afb9cb8617+10:2390:x1874672134317696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827177.873632:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134318080:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827177.873644:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 641 00000100:00100000:3.0:1787827177.873649:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 355 00000100:00100000:2.0:1787827177.873652:0:22268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 666 00000100:00100000:2.0:1787827177.873665:0:22268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134317952:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1787827177.873691:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 248 00000100:00100000:3.0:1787827177.873700:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2389:x1874672134318208:12345-192.168.203.6@tcp:9:kworker.0 00000100:00100000:2.0:1787827177.873714:0:22268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+5:2390:x1874672134317952:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000020:00000080:3.0:1787827177.873724:0:8402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc0fefc09a7954686 00000100:00100000:2.0:1787827177.873735:0:22268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 666 00000100:00080000:3.0:1787827177.873739:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8d547f8e4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787827177.873796:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:2.0:1787827177.873797:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787827177.873802:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787827177.873805:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787827177.873810:0:6481:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787827177.873842:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827177.873939:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fe0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+2:2389:x1874672134318208:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 240us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827177.873944:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 248 00000100:00100000:1.0:1787827177.874278:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2390:x1874672134316928:12345-192.168.203.6@tcp:4:ptlrpcd_00_00.0 Request processed in 786us (1118us total) trans 38654705666 rc 0/0 00000100:00100000:1.0:1787827177.874288:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 561 00002000:00100000:1.0:1787827177.874296:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x14:0x0] (0->4095) req@ffff8d547fbe8b40 x1874672134316928/t38654705666(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.874305:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbe8b40 with x1874672134316928 ext(0->4095) 00002000:00010000:1.0:1787827177.874309:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbe8b40 00000100:00100000:0.0:1787827177.875142:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.875194:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318336 00000100:00100000:1.0:1787827177.875200:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318336 00000100:00100000:1.0:1787827177.875252:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 191 00000100:00100000:1.0:1787827177.875260:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+9:24679:x1874672134318336:12345-192.168.203.6@tcp:44:dd.0 00000100:00100000:1.0:1787827177.875344:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+9:24679:x1874672134318336:12345-192.168.203.6@tcp:44:dd.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827177.875353:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 191 00000100:00100000:0.0:1787827177.875988:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.876027:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318464 00000100:00100000:2.0:1787827177.876044:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318464 00000100:00100000:2.0:1787827177.876072:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 249 00000100:00100000:2.0:1787827177.876077:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+7:2391:x1874672134318464:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:3.0:1787827177.876868:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705666 is committed 00000100:00100000:2.0:1787827177.876948:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2391:x1874672134318464:12345-192.168.203.6@tcp:16:dd.0 Request processed in 870us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827177.876954:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 249 00000100:00100000:2.0:1787827177.878168:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.878225:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318592 00000100:00100000:1.0:1787827177.878230:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318592 00002000:00100000:1.0:1787827177.878261:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x14:0x0] (4096->8191) req@ffff8d547fbf43c0 x1874672134318592/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.878272:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf43c0 with x1874672134318592 ext(4096->8191) 00002000:00010000:1.0:1787827177.878277:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf43c0 00000100:00100000:1.0:1787827177.878297:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 562 00000100:00100000:1.0:1787827177.878307:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2390:x1874672134318592:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:1.0:1787827177.878690:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2390:x1874672134318592:12345-192.168.203.6@tcp:4:dd.0 Request processed in 384us (522us total) trans 38654705667 rc 0/0 00000100:00100000:1.0:1787827177.878707:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 562 00002000:00100000:1.0:1787827177.878715:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x14:0x0] (4096->8191) req@ffff8d547fbf43c0 x1874672134318592/t38654705667(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.878724:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf43c0 with x1874672134318592 ext(4096->8191) 00002000:00010000:1.0:1787827177.878727:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf43c0 00000100:00100000:0.0:1787827177.879484:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827177.879520:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318720 00000100:00100000:3.0:1787827177.879527:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318720 00000100:00100000:3.0:1787827177.879572:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 250 00000100:00100000:3.0:1787827177.879595:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134318720:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:2.0:1787827177.880334:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705667 is committed 00000100:00100000:3.0:1787827177.880431:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134318720:12345-192.168.203.6@tcp:16:dd.0 Request processed in 838us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827177.880440:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 250 00000100:00100000:0.0:1787827177.881681:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.881725:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318848 00000100:00100000:1.0:1787827177.881731:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318848 00002000:00100000:1.0:1787827177.881756:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x14:0x0] (8192->12287) req@ffff8d534386e940 x1874672134318848/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.881763:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386e940 with x1874672134318848 ext(8192->12287) 00002000:00010000:1.0:1787827177.881767:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386e940 00000100:00100000:1.0:1787827177.881788:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 563 00000100:00100000:1.0:1787827177.881793:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134318848:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:1.0:1787827177.882147:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134318848:12345-192.168.203.6@tcp:4:dd.0 Request processed in 353us (468us total) trans 38654705668 rc 0/0 00000100:00100000:1.0:1787827177.882153:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 563 00002000:00100000:1.0:1787827177.882158:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x14:0x0] (8192->12287) req@ffff8d534386e940 x1874672134318848/t38654705668(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.882165:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386e940 with x1874672134318848 ext(8192->12287) 00002000:00010000:1.0:1787827177.882167:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386e940 00000100:00100000:2.0:1787827177.882750:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827177.882783:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134318976 00000100:00100000:0.0:1787827177.882787:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134318976 00000100:00100000:0.0:1787827177.882814:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 251 00000100:00100000:0.0:1787827177.882820:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134318976:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:2.0:1787827177.883421:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705668 is committed 00000100:00100000:0.0:1787827177.883494:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134318976:12345-192.168.203.6@tcp:16:dd.0 Request processed in 674us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827177.883503:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 251 00000100:00100000:0.0:1787827177.884676:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.884724:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134319104 00000100:00100000:2.0:1787827177.884731:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134319104 00002000:00100000:2.0:1787827177.884759:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x14:0x0] (12288->16383) req@ffff8d534386cb40 x1874672134319104/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.884769:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386cb40 with x1874672134319104 ext(12288->16383) 00002000:00010000:2.0:1787827177.884775:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386cb40 00000100:00100000:2.0:1787827177.884799:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 564 00000100:00100000:2.0:1787827177.884807:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134319104:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:2.0:1787827177.885162:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134319104:12345-192.168.203.6@tcp:4:dd.0 Request processed in 356us (488us total) trans 38654705669 rc 0/0 00000100:00100000:2.0:1787827177.885175:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 564 00002000:00100000:2.0:1787827177.885180:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x14:0x0] (12288->16383) req@ffff8d534386cb40 x1874672134319104/t38654705669(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.885186:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386cb40 with x1874672134319104 ext(12288->16383) 00002000:00010000:2.0:1787827177.885189:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386cb40 00000100:00100000:3.0:1787827177.885831:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827177.885869:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134319232 00000100:00100000:0.0:1787827177.885877:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134319232 00000100:00100000:0.0:1787827177.885903:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 252 00000100:00100000:0.0:1787827177.885909:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134319232:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:2.0:1787827177.886484:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705669 is committed 00000100:00100000:0.0:1787827177.886546:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134319232:12345-192.168.203.6@tcp:16:dd.0 Request processed in 637us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827177.886551:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 252 00000100:00100000:0.0:1787827177.887514:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.887566:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134319360 00000100:00100000:1.0:1787827177.887572:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134319360 00002000:00100000:1.0:1787827177.887597:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x14:0x0] (16384->20479) req@ffff8d534386fc00 x1874672134319360/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.887620:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386fc00 with x1874672134319360 ext(16384->20479) 00002000:00010000:1.0:1787827177.887625:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386fc00 00000100:00100000:1.0:1787827177.887648:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 565 00000100:00100000:1.0:1787827177.887659:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134319360:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:1.0:1787827177.888027:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134319360:12345-192.168.203.6@tcp:4:dd.0 Request processed in 370us (511us total) trans 38654705670 rc 0/0 00000100:00100000:1.0:1787827177.888052:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 565 00002000:00100000:1.0:1787827177.888063:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x14:0x0] (16384->20479) req@ffff8d534386fc00 x1874672134319360/t38654705670(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.888072:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d534386fc00 with x1874672134319360 ext(16384->20479) 00002000:00010000:1.0:1787827177.888076:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d534386fc00 00000100:00100000:1.0:1787827177.888720:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.888768:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134319488 00000100:00100000:2.0:1787827177.888773:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134319488 00000100:00100000:2.0:1787827177.888809:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 253 00000100:00100000:2.0:1787827177.888820:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134319488:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:3.0:1787827177.889403:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705670 is committed 00000100:00100000:2.0:1787827177.889499:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134319488:12345-192.168.203.6@tcp:16:dd.0 Request processed in 681us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827177.889508:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 253 00000100:00100000:3.0:1787827177.890470:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.890515:0:21856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134319616 00000100:00100000:2.0:1787827177.890520:0:21856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134319616 00002000:00100000:2.0:1787827177.890542:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x14:0x0] (20480->24575) req@ffff8d545aa7f480 x1874672134319616/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.890554:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7f480 with x1874672134319616 ext(20480->24575) 00002000:00010000:2.0:1787827177.890558:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7f480 00000100:00100000:2.0:1787827177.890580:0:21856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 566 00000100:00100000:2.0:1787827177.890587:0:21856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134319616:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:2.0:1787827177.890870:0:21856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134319616:12345-192.168.203.6@tcp:4:dd.0 Request processed in 283us (399us total) trans 38654705671 rc 0/0 00000100:00100000:2.0:1787827177.890877:0:21856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 566 00002000:00100000:2.0:1787827177.890886:0:21856:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x14:0x0] (20480->24575) req@ffff8d545aa7f480 x1874672134319616/t38654705671(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.890892:0:21856:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7f480 with x1874672134319616 ext(20480->24575) 00002000:00010000:2.0:1787827177.890895:0:21856:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7f480 00000100:00100000:0.0:1787827177.891518:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827177.891550:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134319744 00000100:00100000:3.0:1787827177.891553:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134319744 00000100:00100000:3.0:1787827177.891577:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:3.0:1787827177.891584:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134319744:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:2.0:1787827177.892166:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705671 is committed 00000100:00100000:3.0:1787827177.892249:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134319744:12345-192.168.203.6@tcp:16:dd.0 Request processed in 664us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827177.892257:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 254 00000100:00100000:1.0:1787827177.893163:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.893234:0:21860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134319872 00000100:00100000:2.0:1787827177.893240:0:21860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134319872 00002000:00100000:2.0:1787827177.893265:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x14:0x0] (24576->28671) req@ffff8d5343ac5a40 x1874672134319872/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.893275:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343ac5a40 with x1874672134319872 ext(24576->28671) 00002000:00010000:2.0:1787827177.893280:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343ac5a40 00000100:00100000:2.0:1787827177.893302:0:21860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 567 00000100:00100000:2.0:1787827177.893311:0:21860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5343ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134319872:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:2.0:1787827177.893682:0:21860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5343ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134319872:12345-192.168.203.6@tcp:4:dd.0 Request processed in 372us (519us total) trans 38654705672 rc 0/0 00000100:00100000:2.0:1787827177.893691:0:21860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 567 00002000:00100000:2.0:1787827177.893699:0:21860:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x14:0x0] (24576->28671) req@ffff8d5343ac5a40 x1874672134319872/t38654705672(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.893708:0:21860:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5343ac5a40 with x1874672134319872 ext(24576->28671) 00002000:00010000:2.0:1787827177.893711:0:21860:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5343ac5a40 00000100:00100000:0.0:1787827177.894331:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.894375:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320000 00000100:00100000:2.0:1787827177.894379:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320000 00000100:00100000:2.0:1787827177.894412:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 255 00000100:00100000:2.0:1787827177.894421:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134320000:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:3.0:1787827177.895018:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705672 is committed 00000100:00100000:2.0:1787827177.895103:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d534386f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134320000:12345-192.168.203.6@tcp:16:dd.0 Request processed in 683us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827177.895117:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 255 00000100:00100000:0.0:1787827177.896208:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827177.896267:0:21855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320128 00000100:00100000:3.0:1787827177.896271:0:21855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320128 00002000:00100000:3.0:1787827177.896290:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x14:0x0] (28672->32767) req@ffff8d5345ae1a40 x1874672134320128/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827177.896297:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1a40 with x1874672134320128 ext(28672->32767) 00002000:00010000:3.0:1787827177.896300:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1a40 00000100:00100000:3.0:1787827177.896322:0:21855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 568 00000100:00100000:3.0:1787827177.896327:0:21855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134320128:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:3.0:1787827177.896681:0:21855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134320128:12345-192.168.203.6@tcp:4:dd.0 Request processed in 353us (473us total) trans 38654705673 rc 0/0 00000100:00100000:3.0:1787827177.896697:0:21855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 568 00002000:00100000:3.0:1787827177.896704:0:21855:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x14:0x0] (28672->32767) req@ffff8d5345ae1a40 x1874672134320128/t38654705673(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787827177.896719:0:21855:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae1a40 with x1874672134320128 ext(28672->32767) 00002000:00010000:3.0:1787827177.896724:0:21855:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae1a40 00000100:00100000:3.0:1787827177.897339:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827177.897374:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320256 00000100:00100000:0.0:1787827177.897377:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320256 00000100:00100000:0.0:1787827177.897401:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 256 00000100:00100000:0.0:1787827177.897406:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134320256:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:3.0:1787827177.898074:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705673 is committed 00000100:00100000:0.0:1787827177.898147:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134320256:12345-192.168.203.6@tcp:16:dd.0 Request processed in 739us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827177.898153:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 256 00000100:00100000:0.0:1787827177.899304:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.899350:0:16779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320384 00000100:00100000:1.0:1787827177.899355:0:16779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320384 00002000:00100000:1.0:1787827177.899376:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x14:0x0] (32768->36863) req@ffff8d5345ae30c0 x1874672134320384/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.899383:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae30c0 with x1874672134320384 ext(32768->36863) 00002000:00010000:1.0:1787827177.899386:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae30c0 00000100:00100000:1.0:1787827177.899404:0:16779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 569 00000100:00100000:1.0:1787827177.899409:0:16779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134320384:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:1.0:1787827177.899728:0:16779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134320384:12345-192.168.203.6@tcp:4:dd.0 Request processed in 318us (431us total) trans 38654705674 rc 0/0 00000100:00100000:1.0:1787827177.899740:0:16779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 569 00002000:00100000:1.0:1787827177.899746:0:16779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x14:0x0] (32768->36863) req@ffff8d5345ae30c0 x1874672134320384/t38654705674(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.899753:0:16779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae30c0 with x1874672134320384 ext(32768->36863) 00002000:00010000:1.0:1787827177.899756:0:16779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae30c0 00000100:00100000:2.0:1787827177.900379:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.900419:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320512 00000100:00100000:1.0:1787827177.900423:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320512 00000100:00100000:1.0:1787827177.900446:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 257 00000100:00100000:1.0:1787827177.900452:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134320512:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:3.0:1787827177.901248:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705674 is committed 00000100:00100000:1.0:1787827177.901329:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134320512:12345-192.168.203.6@tcp:16:dd.0 Request processed in 876us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827177.901338:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 257 00000100:00100000:3.0:1787827177.902505:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.902558:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320640 00000100:00100000:1.0:1787827177.902565:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320640 00002000:00100000:1.0:1787827177.902587:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x14:0x0] (36864->40959) req@ffff8d545aa7cf00 x1874672134320640/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.902595:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7cf00 with x1874672134320640 ext(36864->40959) 00002000:00010000:1.0:1787827177.902598:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7cf00 00000100:00100000:1.0:1787827177.902615:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 570 00000100:00100000:1.0:1787827177.902620:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134320640:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:1.0:1787827177.902961:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134320640:12345-192.168.203.6@tcp:4:dd.0 Request processed in 339us (463us total) trans 38654705675 rc 0/0 00000100:00100000:1.0:1787827177.902967:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 570 00002000:00100000:1.0:1787827177.902972:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x14:0x0] (36864->40959) req@ffff8d545aa7cf00 x1874672134320640/t38654705675(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.902983:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7cf00 with x1874672134320640 ext(36864->40959) 00002000:00010000:1.0:1787827177.902986:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7cf00 00000100:00100000:0.0:1787827177.903727:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827177.903791:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320768 00000100:00100000:3.0:1787827177.903801:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320768 00000100:00100000:3.0:1787827177.903851:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 258 00000100:00100000:3.0:1787827177.903861:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134320768:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:3.0:1787827177.904596:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705675 is committed 00000100:00100000:2.0:1787827177.904684:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134320768:12345-192.168.203.6@tcp:16:dd.0 Request processed in 821us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827177.904694:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 258 00000100:00100000:2.0:1787827177.905807:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1787827177.905853:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134320896 00000100:00100000:1.0:1787827177.905859:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134320896 00002000:00100000:1.0:1787827177.905883:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x14:0x0] (40960->45055) req@ffff8d547fbf7c00 x1874672134320896/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.905889:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf7c00 with x1874672134320896 ext(40960->45055) 00002000:00010000:1.0:1787827177.905892:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf7c00 00000100:00100000:1.0:1787827177.905908:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 571 00000100:00100000:1.0:1787827177.905915:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d547fbf7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134320896:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:1.0:1787827177.906313:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d547fbf7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134320896:12345-192.168.203.6@tcp:4:dd.0 Request processed in 398us (505us total) trans 38654705676 rc 0/0 00000100:00100000:1.0:1787827177.906320:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 571 00002000:00100000:1.0:1787827177.906326:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x14:0x0] (40960->45055) req@ffff8d547fbf7c00 x1874672134320896/t38654705676(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787827177.906336:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d547fbf7c00 with x1874672134320896 ext(40960->45055) 00002000:00010000:1.0:1787827177.906340:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d547fbf7c00 00000100:00100000:3.0:1787827177.906980:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.907020:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134321024 00000100:00100000:2.0:1787827177.907025:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134321024 00000100:00100000:2.0:1787827177.907063:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 259 00000100:00100000:2.0:1787827177.907068:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134321024:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:3.0:1787827177.907689:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705676 is committed 00000100:00100000:2.0:1787827177.907771:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d545aa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134321024:12345-192.168.203.6@tcp:16:dd.0 Request processed in 698us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827177.907779:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 259 00000100:00100000:0.0:1787827177.908884:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1787827177.908934:0:21857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134321152 00000100:00100000:2.0:1787827177.908939:0:21857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134321152 00002000:00100000:2.0:1787827177.908964:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x14:0x0] (45056->49151) req@ffff8d5345ae12c0 x1874672134321152/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.908974:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae12c0 with x1874672134321152 ext(45056->49151) 00002000:00010000:2.0:1787827177.908978:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae12c0 00000100:00100000:2.0:1787827177.909000:0:21857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 572 00000100:00100000:2.0:1787827177.909010:0:21857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5345ae12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134321152:12345-192.168.203.6@tcp:4:dd.0 00000100:00100000:2.0:1787827177.909356:0:21857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5345ae12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2393:x1874672134321152:12345-192.168.203.6@tcp:4:dd.0 Request processed in 348us (474us total) trans 38654705677 rc 0/0 00000100:00100000:2.0:1787827177.909362:0:21857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 572 00002000:00100000:2.0:1787827177.909371:0:21857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x14:0x0] (45056->49151) req@ffff8d5345ae12c0 x1874672134321152/t38654705677(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/448 e 0 to 0 dl 1787827188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787827177.909378:0:21857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d5345ae12c0 with x1874672134321152 ext(45056->49151) 00002000:00010000:2.0:1787827177.909380:0:21857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d5345ae12c0 00000100:00100000:0.0:1787827177.909995:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1787827177.910029:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134321280 00000100:00100000:3.0:1787827177.910042:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134321280 00000100:00100000:3.0:1787827177.910065:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 260 00000100:00100000:3.0:1787827177.910070:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+8:2392:x1874672134321280:12345-192.168.203.6@tcp:16:dd.0 00000001:00080000:0.0:1787827177.910809:0:26666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705677 is committed 00000100:00100000:3.0:1787827177.910877:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d546f6a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2392:x1874672134321280:12345-192.168.203.6@tcp:16:dd.0 Request processed in 805us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827177.910883:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 260 00000100:00100000:3.0:1787827177.911971:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1787827177.912009:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672134321408 00000100:00100000:0.0:1787827177.912014:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672134321408 00002000:00100000:0.0:1787827177.912044:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x14:0x0] (49152->53247) req@ffff8d545aa7ed00 x1874672134321408/t0(0) o4->2313f4ee-480a-47b2-8d93-5bb216a57733@192.168.203.6@tcp:23/0 lens 4584/0 e 0 to 0 dl 1787827188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787827177.912052:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d545aa7ed00 with x1874672134321408 ext(49152->53247) 00002000:00010000:0.0:1787827177.912060:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d545aa7ed00 00000100:00100000:0.0:1787827177.912079:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 573 00000100:00100000:0.0:1787827177.912087:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d545aa7ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2313f4ee-480a-47b2-8d93-5bb216a57733+6:2393:x1874672134321408:12345-192.168.203.6@tcp:4:dd.0 Debug log: 54334 lines, 54334 kept, 0 dropped, 0 bad.